-- Logs begin at Wed 2022-08-24 05:23:27 UTC, end at Wed 2022-08-24 07:08:54 UTC. -- Aug 24 06:07:49.351390 dv-cinder-854269-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 06:07:49.358822 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 06:07:49 2022] *** Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: nodename: dv-cinder-854269-1-iscsi Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: machine: x86_64 Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: clock source: unix Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: pcre jit disabled Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: detected number of CPU cores: 4 Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: current working directory: / Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: detected binary path: /usr/bin/uwsgi-core Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: your processes number limit is 47680 Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: your memory page size is 4096 bytes Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: detected max file descriptor number: 2048 Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: lock engine: pthread robust mutexes Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: thunder lock: enabled Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 06:07:49.364000 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 06:07:49.401613 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: Python main interpreter initialized at 0x5568657089c0 Aug 24 06:07:49.401613 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: python threads support enabled Aug 24 06:07:49.401613 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: your server socket listen backlog is limited to 100 connections Aug 24 06:07:49.401613 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: your mercy for graceful operations on workers is 90 seconds Aug 24 06:07:49.402032 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 06:07:49.402032 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: *** Operational MODE: preforking *** Aug 24 06:07:49.402389 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: *** uWSGI is running in multiple interpreter mode *** Aug 24 06:07:49.402389 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: spawned uWSGI master process (pid: 106159) Aug 24 06:07:49.402599 dv-cinder-854269-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 06:07:49.403366 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: spawned uWSGI worker 1 (pid: 106160, cores: 1) Aug 24 06:07:49.403560 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: spawned uWSGI worker 2 (pid: 106161, cores: 1) Aug 24 06:07:49.403713 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 06:07:50.070249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:07:50.072031 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:07:51.162593 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:07:51.162593 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: from cryptography.utils import int_from_bytes Aug 24 06:07:51.163263 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:07:51.163263 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: from cryptography.utils import int_from_bytes Aug 24 06:07:51.166358 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:07:51.166358 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: from cryptography.utils import int_from_bytes Aug 24 06:07:51.166795 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:07:51.166795 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: from cryptography.utils import int_from_bytes Aug 24 06:07:53.649357 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:07:53.649933 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:07:53.650288 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:07:53.650376 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:07:53.650456 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:07:53.650545 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:07:53.650624 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:07:53.650784 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:07:53.650865 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:07:53.650943 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:07:53.651070 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.651172 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.651391 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.651480 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.651709 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.651803 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.652025 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.652134 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.652341 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.652442 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.652682 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.652781 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.652992 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.653100 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.653307 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.653395 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.653625 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.653712 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.653880 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.653969 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.654186 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.654278 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.654502 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854269-1-iscsi {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.654595 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854269-1-iscsi {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.654815 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.654901 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.655115 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.655208 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.655418 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.655503 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.655729 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.655822 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.656023 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.656109 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.656337 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.656423 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.656657 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.656758 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.657147 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.658030 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.658208 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.658336 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.658455 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.658571 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.658677 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.658781 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.658989 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.659131 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.659296 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.659425 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.659598 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.659685 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.659911 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.659997 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.660215 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.660301 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.660553 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.660642 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.660860 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.660948 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.661252 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854269-1-iscsi {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.661351 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854269-1-iscsi {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.661562 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.661655 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.661867 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.661960 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.662177 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.662281 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.662578 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.662699 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.662884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.663027 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.663183 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.663277 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.663493 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.663587 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.663807 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.663893 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.664107 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.664203 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.664423 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.664537 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.664761 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.664849 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.665073 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.665160 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.665384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.665479 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.665678 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.665764 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.665980 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.666110 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.666282 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.666369 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.666592 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.666687 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.666891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.666984 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.667190 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.667430 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.667517 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.667731 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.667817 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.668044 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.668134 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.668358 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.668442 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.668700 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.668807 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.668949 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.669049 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.669198 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.669324 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.669508 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.669625 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.669819 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.670225 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.670426 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.670517 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.670727 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.670817 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.671026 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.671124 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.671325 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.671422 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.671625 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.671716 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.671928 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.672026 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.672227 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.672323 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.672552 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.672658 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.672867 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.672971 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.673223 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.673314 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.674020 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.674124 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.674333 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.674432 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.674975 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.675076 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.675231 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.675329 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.675535 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.675639 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.675867 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.675957 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.676179 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.676273 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.676482 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.676610 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.676818 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.676923 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.677131 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.677221 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.677435 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.677541 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.677734 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.677821 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.678035 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.678129 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.678346 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.678434 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.678673 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.678760 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.678973 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.679058 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.679218 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.679363 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.679513 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.679599 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.679814 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.679915 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.680127 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.680214 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.680428 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.680537 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.680756 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.680841 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.681060 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.681166 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.681355 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.681446 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.681655 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.681760 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.681956 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.682059 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.682266 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.682361 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685025 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685158 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685158 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685307 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685375 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685440 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685504 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685578 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685654 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685719 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685784 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685854 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.685920 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686000 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686068 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686183 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686267 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686333 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686406 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686472 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686536 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686617 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686692 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686764 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686829 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686901 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.686973 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.687045 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.687111 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.687176 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.687239 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.687311 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.687376 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.687439 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.687530 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.687612 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.687827 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.687940 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.688132 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.688217 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.688431 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.688564 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.688769 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.688863 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.689098 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.689175 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.689439 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.689528 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.689707 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.689782 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.690046 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.690144 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.690304 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.690392 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.690601 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.690687 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.690899 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.690994 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.691196 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.691291 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.691494 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.691579 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.691787 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.691871 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.692084 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.692179 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.692391 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.692525 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.692711 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.692846 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.693026 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.693165 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.693329 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.693464 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.693629 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.693755 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.693930 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.694065 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.694239 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.694370 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:07:53.694571 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.694697 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.694895 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.695036 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.695230 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.695363 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.695537 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.695664 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.695866 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.696001 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.696189 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.696358 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.696526 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.696654 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.696835 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.696965 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.697144 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.697271 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.697462 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.697588 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.697768 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.697895 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.698076 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.698211 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.698381 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.698520 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.698693 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.698819 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.699006 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.699232 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.699372 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.699517 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.699652 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.699778 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.699928 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.700056 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.700242 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.700368 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.700570 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.700701 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.700886 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.701014 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.701209 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.701354 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.701527 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.701662 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.701832 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.701969 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.702170 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.702301 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.702511 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.702608 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.702810 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.702905 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.703135 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.703244 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.703455 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.703549 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.703762 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.703855 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.704063 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.704154 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.704367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.704479 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.704733 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.704825 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.705070 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.705221 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.705362 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.705498 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.705679 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.705828 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.705981 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.706120 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.706266 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.706404 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.706567 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.706714 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.706863 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.707001 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.707605 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.707717 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.707717 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.707881 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.707962 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.708040 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.708119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.708205 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.708371 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.708577 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.708747 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.708893 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.709048 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.709190 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.709339 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.709500 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.709640 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.709787 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.709928 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.710066 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.710214 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.710367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.710514 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.710653 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.710791 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.710938 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.711088 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.711237 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.711384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.711531 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.711676 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.711815 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.711969 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.712117 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.712256 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.712394 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.712552 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.712798 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.712945 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.713086 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.713242 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.713382 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.713528 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.713675 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.713821 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.713986 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.714131 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.714277 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.714423 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.714576 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.714715 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.714853 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.714992 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.715143 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.715293 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.715442 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.715581 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.715719 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.715863 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.716013 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.716163 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.716302 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.716519 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.716668 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.716817 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.716956 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.717117 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.717265 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.717404 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.717549 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.717695 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.717833 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.717979 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.718135 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.718275 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.718414 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.718554 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.718701 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.718849 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.718988 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.719126 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.719271 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.719417 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.719568 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.719707 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.719857 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.720004 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.720652 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.720805 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.720950 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.721090 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.721237 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.721376 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.721522 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.721660 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.721812 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.722002 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.722146 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.722285 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.722431 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.722571 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.722719 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.722965 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.723167 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.723322 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.723470 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.723619 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.723765 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.723913 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.724051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.724189 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.724328 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.724484 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.724706 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.724853 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.724992 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.725129 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.725277 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.725424 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.725562 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.725715 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.725866 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.726011 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.726150 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.726369 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.726554 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.726700 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.726839 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.726976 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.727134 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.727279 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.727416 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.727554 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.727693 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.727832 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.727978 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.728117 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.728255 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.728393 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.728549 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.728705 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.728858 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.729007 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.729146 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.729283 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.729420 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.729558 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.729708 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.729847 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.729985 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.730123 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.730261 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.730406 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.730551 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.730690 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.730837 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.730976 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.731113 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.731264 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.731403 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.731548 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.731686 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.731823 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.731961 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.732107 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.732246 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.732385 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.732590 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.732754 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.732893 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.733124 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.733278 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.733418 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.733564 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.733710 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.733865 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.734006 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.734145 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.734282 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.734427 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.734566 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.734722 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.734861 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.734999 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.735138 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.735284 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.735423 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.735569 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.735749 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.736401 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.736635 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.736783 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.736783 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.737056 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.737207 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.737345 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.737491 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.737629 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.737766 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.737913 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.738059 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.738206 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.738353 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.738497 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.738644 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.738782 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.738931 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.739069 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.739207 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.739347 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.739493 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.739638 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.739776 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.739923 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.740062 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.740208 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.740356 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.740528 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.740686 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.740840 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.740986 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.741123 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.741276 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.741416 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.741554 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.741691 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.741829 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.741975 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.742113 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.742251 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.742398 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.742536 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.742685 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.742832 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.742996 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.743160 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.743371 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.743518 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.743656 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.743804 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.743943 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.744089 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.744227 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.744372 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.744567 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.744734 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.744875 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.745013 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.745158 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.745296 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.745443 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.745583 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.745729 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.745871 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.746010 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.746147 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.746294 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.746432 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.746582 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.746764 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.746916 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.747055 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.747203 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.747341 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.747479 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.747618 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.747763 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.747910 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.748058 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.748235 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.748388 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.748586 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.748735 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.748883 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.749022 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.749171 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.749310 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.749447 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.749584 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.749731 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.749869 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.750015 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.750183 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.750349 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.750491 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.750637 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.750784 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.750922 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.751059 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.751197 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.751367 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.751517 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.751657 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.751794 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.751941 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.752080 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.752229 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.752382 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.752544 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.752698 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.752837 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.752976 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.753127 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.753266 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.753494 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.753640 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.753780 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.753919 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.754162 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.754303 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.754452 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.754591 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.754781 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.754937 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.755111 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.755259 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.755426 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.755572 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.755742 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.755904 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.756046 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.756203 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.756343 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.756481 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.756699 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.756893 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.757038 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.757184 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.757323 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.757476 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.757628 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.757780 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.757927 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.758066 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.758225 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.758364 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.758502 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.758640 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.758778 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.758915 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.759062 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.759202 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.759348 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.759486 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.759631 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.759780 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.759918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.760066 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.760206 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.760352 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.760540 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.760701 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.760841 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.760978 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.761116 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.761254 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.761427 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.761582 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.761722 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.761870 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.762016 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.762155 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.762294 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.762441 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.762602 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.762749 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.762887 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.763031 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.763179 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.763319 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.763482 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.763694 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.763849 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.763986 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.764133 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.764273 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.764413 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.764601 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.764755 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.764895 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.765046 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.765185 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.765323 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.765471 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.765610 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.765771 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.765951 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.766096 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.766243 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.766381 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.766520 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.766667 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.766806 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.767008 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.767159 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.767308 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.767446 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.767604 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.767743 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.767882 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.768019 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.768156 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.768301 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.768448 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.768630 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.768771 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.768922 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.769061 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.769218 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.769358 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.769507 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.769646 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.769792 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.769930 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.770081 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.770227 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.770366 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.770504 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.770642 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.770780 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.770932 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.771083 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.771222 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.771371 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.771510 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.771648 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.771801 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.771939 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.772078 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.772215 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.772361 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.772558 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.772705 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.772915 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.773089 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.773236 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.773388 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.773541 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.773697 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.773909 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.774052 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.774199 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.774345 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.774491 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.774640 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.774778 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.774917 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.775063 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.775210 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.775367 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.775507 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.775651 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.775798 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.775954 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.776110 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.776255 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.776408 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.776579 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.776728 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.776872 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.777150 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.777323 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.777471 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.777616 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.777790 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.777939 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.778095 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.778255 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.778408 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.778554 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.778700 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.778845 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.778998 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.779154 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.779310 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.779464 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.779617 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.779771 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.779926 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.780080 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.780227 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.780372 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.780580 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.780746 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.780893 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.781038 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.781184 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.781348 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.781501 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.781657 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.781802 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.781947 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.782092 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.782237 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.782382 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.783058 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.783221 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.783377 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.783525 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.783670 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.783843 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.784015 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.784164 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.784309 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.784455 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.784630 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.784790 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.784945 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.785090 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.785235 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.785388 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.785533 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.785688 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.785851 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.785998 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.786143 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.786288 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.786452 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.786608 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.786761 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.786908 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.787053 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.787245 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.787391 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.787546 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.787703 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.787848 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.788001 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.788147 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.788301 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.788454 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.788643 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.788819 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.788997 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.789154 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.789300 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.789403 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.789491 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.789575 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.789657 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.789737 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.789832 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.789916 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790009 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790097 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790177 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790255 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790349 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790447 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790529 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790609 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790689 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790783 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790865 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.790943 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.791022 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.791101 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.791332 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.791450 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.791637 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.791728 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.791943 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.792039 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.792257 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.792366 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.792576 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.792669 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.792881 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.792969 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.793177 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.793280 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.793473 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.793564 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.793779 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.793875 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.794080 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.794257 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.794406 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.794550 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.794694 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.794840 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.794995 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.795149 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.795304 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.795457 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.795619 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.795772 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.795929 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.796076 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.796240 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.796394 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.796586 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.796740 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.796899 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.797047 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.797234 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.797384 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.797530 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.797688 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.797835 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.797980 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.798126 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.798828 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.798981 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.799148 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.799296 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.799442 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.799596 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.800009 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.800160 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.800314 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.800460 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.800641 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.800641 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.800920 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.801076 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.801235 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.801382 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.801527 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.801679 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.801832 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.801986 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.802139 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.802286 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.802441 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.802587 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.802732 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.802905 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.803053 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.803206 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.803351 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.803351 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.803632 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.803787 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.803938 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.804108 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.804262 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.804407 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.804596 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.804766 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.804931 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.805086 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.805231 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.805377 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.805597 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.805745 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.805890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.806035 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.806189 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.806336 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.806489 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.806660 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.806819 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.806975 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.807128 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.807315 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.807466 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.807613 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.807769 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.807915 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.808061 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.808205 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.808351 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.808530 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.808696 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.808843 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.809000 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.809156 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.809303 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.809457 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.809612 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.809759 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.809912 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.809912 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.810188 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.810188 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.810472 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.810618 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.810773 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.810919 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.811064 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.811217 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.811370 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.811516 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.811662 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.811814 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.811959 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.812119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.812265 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.812412 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.812583 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.812744 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.812889 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.813048 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.813195 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.813340 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.813485 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.813630 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.813811 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.813965 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.814118 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.814264 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.814409 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.814554 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.814723 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.814871 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.815023 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.815169 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.815313 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.815465 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.815688 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.815845 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.815991 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.816137 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.816281 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.816427 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.816633 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.816782 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.816928 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.817080 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.817225 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.817419 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.817577 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.817730 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.817876 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.818030 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.818183 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.818338 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.818484 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.818648 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.818794 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.818941 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.819094 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.819252 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.819399 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.819544 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.819689 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.819834 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.819980 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.820138 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.820285 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.820429 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.820602 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.820694 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.820794 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.820879 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.820959 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.821039 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.821119 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.821198 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.821293 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.821375 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.821456 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.821650 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.821749 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.821950 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.822049 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.822254 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.822368 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.822555 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.822654 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.822855 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.823023 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.823163 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.823250 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.823441 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.823532 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.823737 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.823827 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.824031 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.824132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.824347 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.824511 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.824657 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.824748 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.824943 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.825032 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.825242 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.825331 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.825543 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.825639 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.825842 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.825935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.826136 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.826224 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.826432 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.826521 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.826728 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.826825 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.827051 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.827147 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.827349 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.827484 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.827665 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.827755 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.827967 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.828064 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.828278 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.828367 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.828610 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.828714 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.828922 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.829023 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.829237 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.829326 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.829576 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.829664 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.829886 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.830036 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.830195 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.830284 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.830500 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.830588 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.830804 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.830892 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.831114 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.831203 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.831425 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.831514 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.831736 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.831986 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.832285 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.832382 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.832630 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.832724 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.832939 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.833038 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.833245 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.833333 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.833550 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.833638 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.833856 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.833945 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.834159 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.834248 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.834464 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.834612 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.834768 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.834857 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.835070 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.835166 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.835377 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.835475 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.835694 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.835789 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.836005 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.836093 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.836324 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.836415 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.836678 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.836772 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.836990 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.837078 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.837297 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.837386 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.837603 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.837691 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.837910 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.837998 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.838253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.838342 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.838555 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.838644 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.838854 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.838956 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.839161 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.839253 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.839467 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.839563 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.839770 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.839867 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.840071 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.840162 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.840375 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.840463 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.840707 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.840797 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.841014 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.841109 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.841318 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.841407 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.841622 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.841719 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.841930 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.842021 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.842237 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.842326 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.842554 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.842647 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.842864 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.842951 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.843171 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.843346 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.843475 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.843563 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.843779 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.843874 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.844087 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.844291 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.844617 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.844712 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.844930 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.845019 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.845771 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.845864 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.846089 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.846165 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.846409 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.846514 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.846722 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.846833 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.847035 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.847157 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.847357 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.847457 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.847659 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.847742 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.847959 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.848036 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.848262 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.848348 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.848591 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.848677 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.848892 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.848970 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.849211 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.849290 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.849515 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.849594 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.849821 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.849914 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.850197 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.850365 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.850455 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.850660 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.850948 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.851039 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.851291 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.851393 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.851605 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.851694 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.851922 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.852009 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.852235 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.852332 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.852558 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.852668 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.852863 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.852952 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.853165 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.853261 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.853466 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.853556 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.853763 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.853857 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.854067 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.854162 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.854366 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.854469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.854693 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.854794 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.854956 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.855048 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.855258 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.855359 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.855558 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.855655 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.855855 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.855943 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.856185 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.856281 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.856446 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.856595 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.856784 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.856873 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.857084 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.857172 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.857379 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.857475 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.857676 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.857764 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.857973 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.858060 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.858271 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.858376 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.858570 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.858658 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.858865 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.858953 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.859163 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.859264 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.859458 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.859551 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.859761 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.859863 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.860057 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.860156 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.860355 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.860455 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.860693 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.860794 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.861527 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.861770 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.861861 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.862174 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.862278 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.862478 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.862729 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.862820 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.863137 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.863232 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.863446 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.863678 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.863780 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.864062 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.864150 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.864371 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.864461 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.864705 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.864868 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.865031 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.865122 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.865344 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.865580 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.865670 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.865918 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.866059 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.866241 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.866330 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.866578 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.866822 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.866913 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.867158 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.867249 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.867479 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.867569 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.867783 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.867938 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.868106 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.868198 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.868414 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.868540 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.868747 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.868875 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.869053 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.869145 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.869357 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.869455 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.869665 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.869754 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.869970 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.870067 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.870276 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.870388 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.870585 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.870686 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.870887 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.870974 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.871190 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.871293 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.875026 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.875208 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.875208 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.875398 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.875492 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.875575 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.875661 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.875743 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.875743 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.875877 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.875972 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.876075 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.876172 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.876261 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.876390 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.876478 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.876674 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.876768 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.876854 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.876943 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877025 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877114 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877196 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877276 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877355 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877435 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877435 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877589 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877589 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877743 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877896 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.877982 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.878073 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.878167 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.878256 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.878336 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.878415 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.878495 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.878573 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.878663 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.878753 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.878835 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.878915 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879037 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879135 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879218 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879298 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879378 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879465 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879546 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879635 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879718 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879798 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879885 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.879967 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.880055 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.880145 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.880226 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.880306 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.880395 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.880629 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.880768 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.880940 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.881044 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.881263 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.881360 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.881569 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.881668 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.881871 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.881969 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.882175 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.882272 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.882489 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.882588 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.882787 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.882878 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.883084 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.883173 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.883383 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.883474 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.883688 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.883778 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.883987 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.884077 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.884283 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.884372 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.884603 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.884706 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.884903 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.885001 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.885200 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.885291 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.885492 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.885587 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.885786 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.885874 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.886080 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.886169 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.886378 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.886467 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.886671 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.886767 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.886966 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.887054 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.887259 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.887353 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.887554 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.887650 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.887847 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.887934 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.888144 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.888237 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.888441 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.888564 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.888763 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.888851 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.889063 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.889160 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.889361 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.889459 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.889667 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.889755 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.889965 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.890054 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.890293 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.890391 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.890605 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.890708 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.890909 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.891002 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.891222 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.891310 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.891526 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.891616 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.891839 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.891957 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.892167 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.892257 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.892481 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.892615 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.892816 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.892913 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.893125 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.893215 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.893429 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.893518 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.893737 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.893832 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.894041 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.894130 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.894345 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.894433 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.894652 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.894749 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.894956 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.895084 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.895259 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.895349 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.895558 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.895660 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.895879 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.895968 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.896198 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.896295 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.896516 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.896609 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.896829 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.896918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.897143 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.897232 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.897449 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.897537 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.897756 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.897846 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.898061 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.898157 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.898365 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.898462 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.898671 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.898762 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.898976 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.899072 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.899279 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.899413 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.899587 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.899676 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.899893 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.899997 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.900201 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.900288 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.900517 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.900608 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.900830 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.901084 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.901084 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.901329 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.901456 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.901598 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.901764 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.901922 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.902149 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.902287 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.902415 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.902599 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.902753 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.902922 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.903076 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.903244 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.903387 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.903587 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.903690 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.903899 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.903989 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.904205 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106160) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:07:53.904293 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.904590 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.904905 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.905214 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.905514 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:07:53.905753 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106161) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:07:54.059763 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO dbcounter [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Registered counter for database nova_api Aug 24 06:07:54.062425 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO dbcounter [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Registered counter for database nova_api Aug 24 06:07:54.083577 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_db.sqlalchemy.engines [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:07:54.084741 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG oslo_db.sqlalchemy.engines [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:07:54.088127 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writer thread running {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:07:54.091174 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG dbcounter [-] [106161] Writer thread running {{(pid=106161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:07:54.145584 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.context [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e60b15ba-de69-41e8-86da-b79c2f77052b(cell1) {{(pid=106160) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:07:54.146810 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.context [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e60b15ba-de69-41e8-86da-b79c2f77052b(cell1) {{(pid=106161) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:07:54.149666 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:54.150085 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:54.150802 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG oslo_concurrency.lockutils [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:54.151277 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG oslo_concurrency.lockutils [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:54.151651 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:54.152387 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:54.152898 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG oslo_concurrency.lockutils [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:54.153005 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:54.153644 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG oslo_concurrency.lockutils [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:07:54.154086 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG oslo_concurrency.lockutils [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:07:54.154896 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:54.156070 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG oslo_concurrency.lockutils [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106161) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:07:54.156887 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO dbcounter [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Registered counter for database nova_cell0 Aug 24 06:07:54.158667 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO dbcounter [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Registered counter for database nova_cell0 Aug 24 06:07:54.163181 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO dbcounter [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Registered counter for database nova_cell1 Aug 24 06:07:54.164204 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO dbcounter [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Registered counter for database nova_cell1 Aug 24 06:07:54.170706 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_db.sqlalchemy.engines [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:07:54.172972 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG oslo_db.sqlalchemy.engines [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:07:54.175854 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writer thread running {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:07:54.176513 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_db.sqlalchemy.engines [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:07:54.177985 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG oslo_db.sqlalchemy.engines [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:07:54.178647 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG dbcounter [-] [106161] Writer thread running {{(pid=106161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:07:54.317592 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writer thread running {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:07:54.319310 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG dbcounter [-] [106161] Writer thread running {{(pid=106161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:07:54.327193 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO dbcounter [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Registered counter for database nova_cell0 Aug 24 06:07:54.328515 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO dbcounter [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Registered counter for database nova_cell0 Aug 24 06:07:54.337366 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_db.sqlalchemy.engines [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106160) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:07:54.339065 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG oslo_db.sqlalchemy.engines [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106161) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:07:54.342386 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writer thread running {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:07:54.343590 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG dbcounter [-] [106161] Writer thread running {{(pid=106161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:07:54.775682 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: WARNING keystonemiddleware.auth_token [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:07:54.783069 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: WARNING keystonemiddleware.auth_token [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:07:54.794357 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: WARNING keystonemiddleware.auth_token [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:07:54.802380 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: WARNING keystonemiddleware.auth_token [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:07:55.129251 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: WARNING keystonemiddleware.auth_token [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:07:55.135293 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: WARNING keystonemiddleware.auth_token [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:07:55.140671 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568657089c0 pid: 106160 (default app) Aug 24 06:07:55.142938 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:07:55.144153 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] 10.222.0.62 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001900 Aug 24 06:07:55.144594 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 788 bytes} [Wed Aug 24 06:07:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:07:55.149482 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: WARNING keystonemiddleware.auth_token [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:07:55.155666 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: WARNING keystonemiddleware.auth_token [None req-029b0f35-db36-4559-9cd7-0e0147295c09 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:07:55.161688 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5568657089c0 pid: 106161 (default app) Aug 24 06:09:16.889704 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:16.891372 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002100 Aug 24 06:09:16.892236 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 2/2] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:16.904775 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG dbcounter [-] [106161] Writing DB stats nova_api:SELECT=3 {{(pid=106161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:09:16.905854 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG dbcounter [-] [106161] Writing DB stats nova_cell0:SELECT=3 {{(pid=106161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:09:16.906855 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG dbcounter [-] [106161] Writing DB stats nova_cell1:SELECT=3 {{(pid=106161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:09:16.907882 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG dbcounter [-] [106161] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:09:17.770098 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-9203bcc0-372e-481d-8f3b-d1c9429bacda admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:17.804137 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-9203bcc0-372e-481d-8f3b-d1c9429bacda admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.905071 Aug 24 06:09:17.804935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 1/3] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Aug 24 06:09:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:09:20.186367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:20.187609 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-14cf939f-5b95-4d9d-9bd3-c9ce09d2a582 None None] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 24 06:09:20.197049 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 3/4] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:20 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:20.648365 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-9084c21b-7461-4c4b-8c6d-566891b09146 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:20.667181 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:09:20.667181 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: warnings.warn(msg) Aug 24 06:09:20.765336 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-9084c21b-7461-4c4b-8c6d-566891b09146 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.571125 Aug 24 06:09:20.772677 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 2/5] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 24 06:09:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:09:20.780483 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writing DB stats nova_api:SELECT=3 {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:09:20.781580 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writing DB stats nova_cell0:SELECT=3 {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:09:20.782850 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writing DB stats nova_cell1:SELECT=3 {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:09:20.783897 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:09:21.000056 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-92853757-0e4f-4efa-af85-3c27328cf7db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:21.004426 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:09:21.004426 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: warnings.warn(msg) Aug 24 06:09:21.158096 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-92853757-0e4f-4efa-af85-3c27328cf7db admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.383525 Aug 24 06:09:21.158599 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 4/6] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Aug 24 06:09:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:09:23.525030 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-9084c21b-7461-4c4b-8c6d-566891b09146 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:23.526188 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-9084c21b-7461-4c4b-8c6d-566891b09146 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Aug 24 06:09:23.526993 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 3/7] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:24.201305 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-777152e1-e1b4-4015-a307-8c6612ef7c2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "disk": 5}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:24.221788 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:09:24.221788 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: warnings.warn(msg) Aug 24 06:09:24.337198 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-777152e1-e1b4-4015-a307-8c6612ef7c2e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.803729 Aug 24 06:09:24.338137 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 5/8] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 24 06:09:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:09:24.351215 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-c2fdfb71-ac06-4f8c-8909-f4a826144b11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:24.354179 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:09:24.354179 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: warnings.warn(msg) Aug 24 06:09:24.477626 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-c2fdfb71-ac06-4f8c-8909-f4a826144b11 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130418 Aug 24 06:09:24.478212 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 4/9] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Aug 24 06:09:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:09:26.836817 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-777152e1-e1b4-4015-a307-8c6612ef7c2e admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:26.837833 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-777152e1-e1b4-4015-a307-8c6612ef7c2e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Aug 24 06:09:26.838243 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 6/10] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:27.237146 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-8c5eb673-1a6b-4bbd-af7b-03c3e0165b3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "id": "d2", "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:27.390768 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-8c5eb673-1a6b-4bbd-af7b-03c3e0165b3c admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.545746 Aug 24 06:09:27.391255 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 5/11] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 24 06:09:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:09:27.403586 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-88738a00-8395-47a8-a459-7ba845500ef3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:27.479285 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-88738a00-8395-47a8-a459-7ba845500ef3 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079481 Aug 24 06:09:27.479905 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 7/12] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Aug 24 06:09:27 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:09:29.849115 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-8c5eb673-1a6b-4bbd-af7b-03c3e0165b3c admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:29.850208 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-8c5eb673-1a6b-4bbd-af7b-03c3e0165b3c admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Aug 24 06:09:29.850697 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 6/13] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:30.285672 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-4c764b98-b61a-433c-b1b3-202d66e20436 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:30.365353 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-4c764b98-b61a-433c-b1b3-202d66e20436 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.508453 Aug 24 06:09:30.366186 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 8/14] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 24 06:09:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:09:30.379034 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-93f05a33-1033-457b-b6b8-222514e540bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:30.497967 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-93f05a33-1033-457b-b6b8-222514e540bb admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122194 Aug 24 06:09:30.498706 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 7/15] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Aug 24 06:09:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:09:32.975334 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-4c764b98-b61a-433c-b1b3-202d66e20436 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:32.976333 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-4c764b98-b61a-433c-b1b3-202d66e20436 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 24 06:09:32.976761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 9/16] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:33.426743 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-249be1ce-ed6a-42e7-bf42-ae7584be628e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "name": "ds4G"}} {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:33.519046 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-249be1ce-ed6a-42e7-bf42-ae7584be628e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.535435 Aug 24 06:09:33.519602 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 8/17] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 24 06:09:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:09:33.531842 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-98333b2a-6cf0-4b35-a212-cac66724576a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:33.634951 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-98333b2a-6cf0-4b35-a212-cac66724576a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103234 Aug 24 06:09:33.634951 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 10/18] 10.222.0.62 () {64 vars in 1336 bytes} [Wed Aug 24 06:09:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:09:36.078983 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-249be1ce-ed6a-42e7-bf42-ae7584be628e admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:36.079920 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-249be1ce-ed6a-42e7-bf42-ae7584be628e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 24 06:09:36.080330 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 9/19] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:36.489007 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-7849aec4-fe03-4b7a-8123-a5d5e9e7eec0 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:36.514263 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-7849aec4-fe03-4b7a-8123-a5d5e9e7eec0 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.427870 Aug 24 06:09:36.514823 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Aug 24 06:09:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:09:38.938721 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-249be1ce-ed6a-42e7-bf42-ae7584be628e admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:38.940053 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-249be1ce-ed6a-42e7-bf42-ae7584be628e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001997 Aug 24 06:09:38.940586 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 10/21] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:39.364865 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-53429575-f7c0-4c2a-b08e-ecf7ff623b3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:39.444219 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-53429575-f7c0-4c2a-b08e-ecf7ff623b3a admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.497386 Aug 24 06:09:39.444855 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 12/22] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 24 06:09:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:09:39.457233 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-f6a47464-de0d-43ec-b226-5c223d0b454b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:39.542559 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-f6a47464-de0d-43ec-b226-5c223d0b454b admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088911 Aug 24 06:09:39.543367 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 11/23] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Aug 24 06:09:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:09:41.952147 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-53429575-f7c0-4c2a-b08e-ecf7ff623b3a admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:41.953203 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-53429575-f7c0-4c2a-b08e-ecf7ff623b3a admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 24 06:09:41.953627 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:42.378391 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-f396ec81-70cb-49c8-9145-a470c75fff4e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "name": "m1.small"}} {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:42.485464 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-f396ec81-70cb-49c8-9145-a470c75fff4e admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.525282 Aug 24 06:09:42.486210 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 12/25] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 24 06:09:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:09:42.498456 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-4c5eee30-6f21-4502-937d-ff49f02f9b13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:42.579503 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-4c5eee30-6f21-4502-937d-ff49f02f9b13 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084740 Aug 24 06:09:42.580085 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 14/26] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Aug 24 06:09:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:09:45.094223 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-f396ec81-70cb-49c8-9145-a470c75fff4e admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:45.094223 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-f396ec81-70cb-49c8-9145-a470c75fff4e admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001693 Aug 24 06:09:45.094223 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 13/27] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:45.595726 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-ef36c6f5-2819-4163-b2c8-1fa4f4401743 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "id": "3"}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:45.725267 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-ef36c6f5-2819-4163-b2c8-1fa4f4401743 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.636248 Aug 24 06:09:45.726180 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 15/28] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 24 06:09:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:09:45.739686 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-2942da31-afee-4196-b1c0-b0b45373eee3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:45.832370 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-2942da31-afee-4196-b1c0-b0b45373eee3 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096488 Aug 24 06:09:45.845137 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 14/29] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Aug 24 06:09:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:09:48.247849 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-ef36c6f5-2819-4163-b2c8-1fa4f4401743 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:48.249001 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-ef36c6f5-2819-4163-b2c8-1fa4f4401743 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Aug 24 06:09:48.249488 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 16/30] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:48.758574 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-22f14638-017c-4a00-93d3-11b6df626bf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:48.765100 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG dbcounter [-] [106161] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:09:48.833875 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-22f14638-017c-4a00-93d3-11b6df626bf0 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.577889 Aug 24 06:09:48.834583 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 15/31] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 24 06:09:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:09:48.848028 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-037eb991-77b1-4bd9-823c-3e0cff2a92d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:48.956893 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-037eb991-77b1-4bd9-823c-3e0cff2a92d9 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112394 Aug 24 06:09:48.960327 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 17/32] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Aug 24 06:09:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:09:51.376848 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-22f14638-017c-4a00-93d3-11b6df626bf0 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:09:51.377772 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-22f14638-017c-4a00-93d3-11b6df626bf0 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 24 06:09:51.378341 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 16/33] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:09:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:09:51.932285 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-577dd39f-0743-4270-a0e9-8ff1adae3306 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:52.007508 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-577dd39f-0743-4270-a0e9-8ff1adae3306 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.622590 Aug 24 06:09:52.008389 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 18/34] 10.222.0.62 () {64 vars in 1283 bytes} [Wed Aug 24 06:09:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:09:52.024993 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-9023364d-047d-4682-abf9-212209184f27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:09:52.120447 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-9023364d-047d-4682-abf9-212209184f27 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103677 Aug 24 06:09:52.121783 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 17/35] 10.222.0.62 () {64 vars in 1333 bytes} [Wed Aug 24 06:09:52 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:10:11.914131 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-577dd39f-0743-4270-a0e9-8ff1adae3306 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:11.915154 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-577dd39f-0743-4270-a0e9-8ff1adae3306 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Aug 24 06:10:11.915561 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 19/36] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:10:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:10:12.317850 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-c2295fc3-b752-4511-87a0-0d7c6e41328a admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:12.336713 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-c2295fc3-b752-4511-87a0-0d7c6e41328a admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.414424 Aug 24 06:10:12.337246 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 18/37] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Aug 24 06:10:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:10:13.409479 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-577dd39f-0743-4270-a0e9-8ff1adae3306 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:13.410498 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-577dd39f-0743-4270-a0e9-8ff1adae3306 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 24 06:10:13.410905 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 20/38] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:10:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:10:13.937915 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-3c26444f-01f1-46c1-a24e-5f718dc3a08b admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:13.943489 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.wsgi [None req-3c26444f-01f1-46c1-a24e-5f718dc3a08b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-3c26444f-01f1-46c1-a24e-5f718dc3a08b admin admin] Request method failure captured: Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Accept: application/json Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Accept-Encoding: gzip, deflate Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Connection: keep-alive Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Content-Length: 0 Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Host: 10.222.0.62 Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Openstack-Api-Version: compute 2.90 Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Openstack-System-Scope: None Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: User-Agent: python-novaclient Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Auth-Token: gAAAAABjBcDFqOYuLH8GOs1udxwg1EMy5mETMEGm8XXK7me7QPmCF9PmkN1Ro_QjwRE5DnSsFddcw0VdQFTr6ddbU5_9oeREmPgVV45OID4v9Me7GkyburDDvfvm8gwwC80nkERCFT5uHrK4FMYqbOm_vQNQj_WNHG4eoHKCWux6QKZQIkCShY4 Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Domain-Id: None Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Domain-Name: None Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Identity-Status: Confirmed Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Is-Admin-Project: True Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Domain-Id: default Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Domain-Name: Default Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Name: admin Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Role: reader,member,admin Aug 24 06:10:13.946745 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Roles: reader,member,admin Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_632e93ce840f4853b64b4d659536e045", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Tenant: admin Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Tenant-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Tenant-Name: admin Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User: admin Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Domain-Id: default Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Domain-Name: Default Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Id: 8b2c3a376af245f2a0e347e2f08885a5 Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Name: admin Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: method: > Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: exception: Flavor 42 could not be found. Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: action_args: {'id': '42'} Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:10:13.948935 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:13.949918 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:13.951103 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-3c26444f-01f1-46c1-a24e-5f718dc3a08b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:10:13.952196 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-3c26444f-01f1-46c1-a24e-5f718dc3a08b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.399041 Aug 24 06:10:13.952196 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 19/39] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Aug 24 06:10:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:10:13.958310 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-71e19f83-afbe-4845-8378-a5df559b1c75 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:13.963340 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:10:13.982002 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-71e19f83-afbe-4845-8378-a5df559b1c75 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027212 Aug 24 06:10:13.982611 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 21/40] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 24 06:10:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:10:13.992428 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-85195606-ea0b-40ee-8113-f0eaf46120dc admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:14.018218 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-85195606-ea0b-40ee-8113-f0eaf46120dc admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029391 Aug 24 06:10:14.018793 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 20/41] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 24 06:10:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:10:14.028283 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-4e3f1289-ce75-4831-80d2-55ed8ec956ca admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:14.034348 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.wsgi [None req-4e3f1289-ce75-4831-80d2-55ed8ec956ca admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-4e3f1289-ce75-4831-80d2-55ed8ec956ca admin admin] Request method failure captured: Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Accept: application/json Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Accept-Encoding: gzip, deflate Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Connection: keep-alive Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Content-Length: 0 Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Host: 10.222.0.62 Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Openstack-Api-Version: compute 2.90 Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Openstack-System-Scope: None Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: User-Agent: python-novaclient Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Auth-Token: gAAAAABjBcDFqOYuLH8GOs1udxwg1EMy5mETMEGm8XXK7me7QPmCF9PmkN1Ro_QjwRE5DnSsFddcw0VdQFTr6ddbU5_9oeREmPgVV45OID4v9Me7GkyburDDvfvm8gwwC80nkERCFT5uHrK4FMYqbOm_vQNQj_WNHG4eoHKCWux6QKZQIkCShY4 Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Domain-Id: None Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Domain-Name: None Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Identity-Status: Confirmed Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Is-Admin-Project: True Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Domain-Id: default Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Domain-Name: Default Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Name: admin Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Role: reader,member,admin Aug 24 06:10:14.037614 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Roles: reader,member,admin Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_632e93ce840f4853b64b4d659536e045", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Tenant: admin Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Tenant-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Tenant-Name: admin Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User: admin Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Domain-Id: default Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Domain-Name: Default Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Id: 8b2c3a376af245f2a0e347e2f08885a5 Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Name: admin Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: method: > Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: exception: Flavor 42 could not be found. Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: action_args: {'id': '42'} Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:10:14.039971 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:14.041119 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:14.042253 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-4e3f1289-ce75-4831-80d2-55ed8ec956ca admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:10:14.043238 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-4e3f1289-ce75-4831-80d2-55ed8ec956ca admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014329 Aug 24 06:10:14.043238 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 22/42] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Aug 24 06:10:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 06:10:15.000809 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-85195606-ea0b-40ee-8113-f0eaf46120dc admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:15.001819 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-85195606-ea0b-40ee-8113-f0eaf46120dc admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 24 06:10:15.002210 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 21/43] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:10:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:10:15.517558 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-25341f72-191e-4d80-8fd8-f0382ecb54b3 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:15.522843 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.wsgi [None req-25341f72-191e-4d80-8fd8-f0382ecb54b3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-25341f72-191e-4d80-8fd8-f0382ecb54b3 admin admin] Request method failure captured: Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Accept: application/json Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Accept-Encoding: gzip, deflate Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Connection: keep-alive Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Content-Length: 0 Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Host: 10.222.0.62 Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Openstack-Api-Version: compute 2.90 Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Openstack-System-Scope: None Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: User-Agent: python-novaclient Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Auth-Token: gAAAAABjBcDGD-9K2fQlDVA-kdynbNUrhi_tdF0O2b8E_pz2Fwgw066aUA9QIg7jyR-F-FaFu5B5lsnH_bUl4np2wFGT5sctxnkJ38rKJtGoN6C_4QXQmKumlWBJ0bmG3AUs0rmPS5r2WzBqVkzbDttlDYpbLBcYDBdicjwurZFSX4WWD3FhEOU Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Domain-Id: None Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Domain-Name: None Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Identity-Status: Confirmed Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Is-Admin-Project: True Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Domain-Id: default Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Domain-Name: Default Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Name: admin Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Role: reader,member,admin Aug 24 06:10:15.524337 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Roles: reader,member,admin Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_632e93ce840f4853b64b4d659536e045", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Tenant: admin Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Tenant-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Tenant-Name: admin Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User: admin Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Domain-Id: default Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Domain-Name: Default Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Id: 8b2c3a376af245f2a0e347e2f08885a5 Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Name: admin Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: method: > Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: exception: Flavor 84 could not be found. Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: action_args: {'id': '84'} Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:10:15.525891 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:15.526761 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:15.527884 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-25341f72-191e-4d80-8fd8-f0382ecb54b3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:10:15.528921 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-25341f72-191e-4d80-8fd8-f0382ecb54b3 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.385643 Aug 24 06:10:15.528921 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 23/44] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Aug 24 06:10:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:10:15.535252 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-e722fd65-230e-4871-a03d-9b301397186f admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:15.549970 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-e722fd65-230e-4871-a03d-9b301397186f admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018237 Aug 24 06:10:15.550759 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 22/45] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 24 06:10:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:10:15.560534 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-9de30509-a52e-4542-b1cc-298e2681501b admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:15.575775 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-9de30509-a52e-4542-b1cc-298e2681501b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019292 Aug 24 06:10:15.576292 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 24 06:10:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:10:15.585321 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-62cebbfa-76e5-4ec9-8894-5bff4654d71b admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:15.590561 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.wsgi [None req-62cebbfa-76e5-4ec9-8894-5bff4654d71b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-62cebbfa-76e5-4ec9-8894-5bff4654d71b admin admin] Request method failure captured: Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Accept: application/json Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Accept-Encoding: gzip, deflate Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Connection: keep-alive Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Content-Length: 0 Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Host: 10.222.0.62 Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Openstack-Api-Version: compute 2.90 Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Openstack-System-Scope: None Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: User-Agent: python-novaclient Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Auth-Token: gAAAAABjBcDGD-9K2fQlDVA-kdynbNUrhi_tdF0O2b8E_pz2Fwgw066aUA9QIg7jyR-F-FaFu5B5lsnH_bUl4np2wFGT5sctxnkJ38rKJtGoN6C_4QXQmKumlWBJ0bmG3AUs0rmPS5r2WzBqVkzbDttlDYpbLBcYDBdicjwurZFSX4WWD3FhEOU Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Domain-Id: None Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Domain-Name: None Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Identity-Status: Confirmed Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Is-Admin-Project: True Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Domain-Id: default Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Domain-Name: Default Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Name: admin Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Role: reader,member,admin Aug 24 06:10:15.592051 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Roles: reader,member,admin Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_632e93ce840f4853b64b4d659536e045", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Tenant: admin Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Tenant-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Tenant-Name: admin Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User: admin Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Domain-Id: default Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Domain-Name: Default Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Id: 8b2c3a376af245f2a0e347e2f08885a5 Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Name: admin Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: method: > Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: exception: Flavor 84 could not be found. Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: action_args: {'id': '84'} Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:10:15.593547 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:15.594469 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:15.595550 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-62cebbfa-76e5-4ec9-8894-5bff4654d71b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:10:15.596545 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-62cebbfa-76e5-4ec9-8894-5bff4654d71b admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011597 Aug 24 06:10:15.596545 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 23/47] 10.222.0.62 () {60 vars in 1190 bytes} [Wed Aug 24 06:10:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:10:16.569721 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-9de30509-a52e-4542-b1cc-298e2681501b admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:16.570729 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-9de30509-a52e-4542-b1cc-298e2681501b admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 24 06:10:16.571136 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 25/48] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:10:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:10:17.114500 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-998d7da0-8489-4910-84a6-0055a6393a91 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:17.120882 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.wsgi [None req-998d7da0-8489-4910-84a6-0055a6393a91 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-998d7da0-8489-4910-84a6-0055a6393a91 admin admin] Request method failure captured: Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Accept: application/json Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Accept-Encoding: gzip, deflate Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Connection: keep-alive Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Content-Length: 0 Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Host: 10.222.0.62 Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Openstack-Api-Version: compute 2.90 Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Openstack-System-Scope: None Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: User-Agent: python-novaclient Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Auth-Token: gAAAAABjBcDIbNgxOkBL32SxVt8czu2sNDx6QmCM_0vHKb4jViVBheiR2-VKOQZ90uplx12W4UBRGcmYSkLwbkuWklf7VJ5gQ4e46IytB4Rgsd_JX41gej5Tiae6UrmC2DJ9k6Q3mlnPdm3S8f4rPBuNv3iBDi_X5wvbYOypCKVfug-5J6SqgkY Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Domain-Id: None Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Domain-Name: None Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Identity-Status: Confirmed Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Is-Admin-Project: True Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Domain-Id: default Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Domain-Name: Default Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Project-Name: admin Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Role: reader,member,admin Aug 24 06:10:17.122384 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Roles: reader,member,admin Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_632e93ce840f4853b64b4d659536e045", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Tenant: admin Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Tenant-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-Tenant-Name: admin Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User: admin Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Domain-Id: default Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Domain-Name: Default Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Id: 8b2c3a376af245f2a0e347e2f08885a5 Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: X-User-Name: admin Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: method: > Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: exception: Flavor 451 could not be found. Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: action_args: {'id': '451'} Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:10:17.124102 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:17.129890 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: ERROR nova.api.openstack.wsgi Aug 24 06:10:17.131249 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-998d7da0-8489-4910-84a6-0055a6393a91 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106161) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:10:17.132369 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-998d7da0-8489-4910-84a6-0055a6393a91 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.412526 Aug 24 06:10:17.132369 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 24/49] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 24 06:10:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:10:17.133520 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-301895fe-e9e6-4092-9820-b9a83ebc8534 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:17.148820 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-301895fe-e9e6-4092-9820-b9a83ebc8534 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018778 Aug 24 06:10:17.149343 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 24 06:10:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:10:17.158938 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:17.174035 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018614 Aug 24 06:10:17.174578 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 25/51] 10.222.0.62 () {60 vars in 1210 bytes} [Wed Aug 24 06:10:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:10:17.184720 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-3507cda3-2bc2-4e0d-b67f-069f8d38d727 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:17.190082 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.wsgi [None req-3507cda3-2bc2-4e0d-b67f-069f8d38d727 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-3507cda3-2bc2-4e0d-b67f-069f8d38d727 admin admin] Request method failure captured: Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Accept: application/json Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Accept-Encoding: gzip, deflate Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Connection: keep-alive Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Content-Length: 0 Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Host: 10.222.0.62 Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Openstack-Api-Version: compute 2.90 Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Openstack-System-Scope: None Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: User-Agent: python-novaclient Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Auth-Token: gAAAAABjBcDIbNgxOkBL32SxVt8czu2sNDx6QmCM_0vHKb4jViVBheiR2-VKOQZ90uplx12W4UBRGcmYSkLwbkuWklf7VJ5gQ4e46IytB4Rgsd_JX41gej5Tiae6UrmC2DJ9k6Q3mlnPdm3S8f4rPBuNv3iBDi_X5wvbYOypCKVfug-5J6SqgkY Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Domain-Id: None Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Domain-Name: None Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Identity-Status: Confirmed Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Is-Admin-Project: True Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Domain-Id: default Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Domain-Name: Default Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Project-Name: admin Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Role: reader,member,admin Aug 24 06:10:17.191565 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Roles: reader,member,admin Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/632e93ce840f4853b64b4d659536e045"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/632e93ce840f4853b64b4d659536e045"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_632e93ce840f4853b64b4d659536e045", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Tenant: admin Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Tenant-Id: 632e93ce840f4853b64b4d659536e045 Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-Tenant-Name: admin Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User: admin Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Domain-Id: default Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Domain-Name: Default Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Id: 8b2c3a376af245f2a0e347e2f08885a5 Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: X-User-Name: admin Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: method: > Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: exception: Flavor 451 could not be found. Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: action_args: {'id': '451'} Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:10:17.193132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:17.194079 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: ERROR nova.api.openstack.wsgi Aug 24 06:10:17.195367 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-3507cda3-2bc2-4e0d-b67f-069f8d38d727 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106160) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:10:17.196763 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-3507cda3-2bc2-4e0d-b67f-069f8d38d727 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012251 Aug 24 06:10:17.196763 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 27/52] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 24 06:10:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 06:10:18.157509 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:18.158522 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 24 06:10:18.158910 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 26/53] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:10:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:10:18.674926 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-b980aabf-f977-4a33-9015-f363843aa160 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:10:18.789329 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-b980aabf-f977-4a33-9015-f363843aa160 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.491795 Aug 24 06:10:18.789896 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 28/54] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Aug 24 06:10:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:10:19.774439 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:19.775456 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 06:10:19.775860 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 27/55] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:10:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:10:20.315158 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-99d8f921-3862-45da-9efe-91f423b876b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:10:20.400021 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-99d8f921-3862-45da-9efe-91f423b876b4 admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.481007 Aug 24 06:10:20.400489 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Aug 24 06:10:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:10:21.378734 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:21.379732 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 06:10:21.380219 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 28/57] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:10:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:10:21.914975 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-df175044-e675-4e23-a0ea-ac99c99c462f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:10:21.992947 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-df175044-e675-4e23-a0ea-ac99c99c462f admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.475609 Aug 24 06:10:21.993522 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Aug 24 06:10:21 2022] POST /compute/v2.1/flavors => generated 407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:10:22.981659 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:22.982662 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 24 06:10:22.983048 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 29/59] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:10:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:10:23.511076 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-e1f77727-5cb6-4370-912a-2b67cf2783be admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:10:23.600087 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-e1f77727-5cb6-4370-912a-2b67cf2783be admin admin] 10.222.0.62 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.479157 Aug 24 06:10:23.600686 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 31/60] 10.222.0.62 () {64 vars in 1235 bytes} [Wed Aug 24 06:10:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:10:24.576939 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:24.577955 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 24 06:10:24.578350 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 30/61] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:10:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:10:25.104366 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-f2c95e8f-afea-4f1b-974f-d4674b76b038 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:10:25.125212 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-f2c95e8f-afea-4f1b-974f-d4674b76b038 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408444 Aug 24 06:10:25.125750 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 32/62] 10.222.0.62 () {60 vars in 1202 bytes} [Wed Aug 24 06:10:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:11:18.959043 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:11:18.960059 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-a7d5c60b-a9e7-43cd-9edd-6ce411d07e84 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 06:11:18.960462 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 31/63] 10.222.0.62 () {54 vars in 931 bytes} [Wed Aug 24 06:11:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:11:18.971358 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:11:19.366943 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-ac628060-375e-45d8-91ba-611b38477eb0 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:11:19.388356 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-ac628060-375e-45d8-91ba-611b38477eb0 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.421438 Aug 24 06:11:19.388913 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1292 bytes} [Wed Aug 24 06:11:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:11:19.410337 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG dbcounter [-] [106161] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106161) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:11:19.414112 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-4a6a00a3-86dd-4f03-bb0f-ec3497ff8566 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:11:19.423096 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-4a6a00a3-86dd-4f03-bb0f-ec3497ff8566 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013096 Aug 24 06:11:19.423096 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 32/65] 10.222.0.62 () {60 vars in 1283 bytes} [Wed Aug 24 06:11:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:11:19.435809 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-e9b23da5-f703-4e63-a1da-c8978548e80c admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:11:19.444889 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-e9b23da5-f703-4e63-a1da-c8978548e80c admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013363 Aug 24 06:11:19.445420 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 34/66] 10.222.0.62 () {60 vars in 1286 bytes} [Wed Aug 24 06:11:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:11:19.459964 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-7ba21d58-cd62-411f-9916-da076c6be6c4 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:11:19.469310 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-7ba21d58-cd62-411f-9916-da076c6be6c4 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014033 Aug 24 06:11:19.469891 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 33/67] 10.222.0.62 () {60 vars in 1286 bytes} [Wed Aug 24 06:11:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:11:19.483628 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-e7b8f81b-6531-4e90-9842-30c8282972c6 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:11:19.491393 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-e7b8f81b-6531-4e90-9842-30c8282972c6 admin admin] 10.222.0.62 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011673 Aug 24 06:11:19.491916 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 35/68] 10.222.0.62 () {60 vars in 1283 bytes} [Wed Aug 24 06:11:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:14:27.772805 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-7ba21d58-cd62-411f-9916-da076c6be6c4 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:14:27.773811 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-7ba21d58-cd62-411f-9916-da076c6be6c4 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 24 06:14:27.774200 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 34/69] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:14:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:14:27.914836 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writing DB stats nova_api:SELECT=6 {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:14:28.071689 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-d615197c-f58f-4878-a962-19d91203cba5 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:14:28.074073 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:14:28.074073 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: warnings.warn(msg) Aug 24 06:14:28.075215 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-d615197c-f58f-4878-a962-19d91203cba5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:14:28.075717 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-d615197c-f58f-4878-a962-19d91203cba5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:14:28.076139 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-d615197c-f58f-4878-a962-19d91203cba5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:14:28.076885 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-d615197c-f58f-4878-a962-19d91203cba5 admin admin] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:14:28.077329 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-d615197c-f58f-4878-a962-19d91203cba5 admin admin] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:14:28.077738 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-d615197c-f58f-4878-a962-19d91203cba5 admin admin] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:14:28.112153 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-d615197c-f58f-4878-a962-19d91203cba5 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198664 Aug 24 06:14:28.112735 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 36/70] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 24 06:14:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:14:28.937803 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-7ba21d58-cd62-411f-9916-da076c6be6c4 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:14:28.938843 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-7ba21d58-cd62-411f-9916-da076c6be6c4 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 06:14:28.939230 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 35/71] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:14:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:14:29.126184 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-e54fc4c5-9db7-4ed1-bd7f-7198deade600 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:14:29.129246 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:14:29.129246 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: warnings.warn(msg) Aug 24 06:14:29.130351 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-e54fc4c5-9db7-4ed1-bd7f-7198deade600 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:14:29.130853 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-e54fc4c5-9db7-4ed1-bd7f-7198deade600 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:14:29.131284 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-e54fc4c5-9db7-4ed1-bd7f-7198deade600 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:14:29.131993 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-e54fc4c5-9db7-4ed1-bd7f-7198deade600 admin admin] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:14:29.132439 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-e54fc4c5-9db7-4ed1-bd7f-7198deade600 admin admin] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:14:29.132873 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-e54fc4c5-9db7-4ed1-bd7f-7198deade600 admin admin] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:14:29.152287 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-e54fc4c5-9db7-4ed1-bd7f-7198deade600 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076660 Aug 24 06:14:29.152870 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 37/72] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 24 06:14:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:14:40.383749 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-7ba21d58-cd62-411f-9916-da076c6be6c4 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:14:40.384784 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-7ba21d58-cd62-411f-9916-da076c6be6c4 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 24 06:14:40.385178 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 36/73] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:14:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:14:40.530056 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writing DB stats nova_cell0:SELECT=4 {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:14:40.530783 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writing DB stats nova_cell1:SELECT=4 {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:14:40.531389 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG dbcounter [-] [106160] Writing DB stats nova_api:SELECT=8 {{(pid=106160) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:14:40.579230 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-329f4b36-87a3-4e5a-b48a-b3b77e8de21e admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:14:40.581652 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:14:40.581652 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: warnings.warn(msg) Aug 24 06:14:40.582767 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-329f4b36-87a3-4e5a-b48a-b3b77e8de21e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:14:40.588392 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-329f4b36-87a3-4e5a-b48a-b3b77e8de21e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:14:40.588392 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-329f4b36-87a3-4e5a-b48a-b3b77e8de21e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:14:40.588392 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-329f4b36-87a3-4e5a-b48a-b3b77e8de21e admin admin] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:14:40.588392 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-329f4b36-87a3-4e5a-b48a-b3b77e8de21e admin admin] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:14:40.588750 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-329f4b36-87a3-4e5a-b48a-b3b77e8de21e admin admin] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:14:40.609634 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-329f4b36-87a3-4e5a-b48a-b3b77e8de21e admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083917 Aug 24 06:14:40.610126 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 38/74] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 24 06:14:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:14:41.428627 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: DEBUG nova.api.openstack.wsgi [None req-7ba21d58-cd62-411f-9916-da076c6be6c4 admin admin] Calling method '>' {{(pid=106161) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:14:41.430104 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: INFO nova.api.openstack.requestlog [None req-7ba21d58-cd62-411f-9916-da076c6be6c4 admin admin] 10.222.0.62 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001834 Aug 24 06:14:41.430594 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: [pid: 106161|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1074 bytes} [Wed Aug 24 06:14:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:14:41.622182 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG nova.api.openstack.wsgi [None req-58618829-ff5f-48ae-82fc-e2ec64ab8ec5 admin admin] Calling method '>' {{(pid=106160) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:14:41.624774 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:14:41.624774 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: warnings.warn(msg) Aug 24 06:14:41.625860 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-58618829-ff5f-48ae-82fc-e2ec64ab8ec5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:14:41.626358 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-58618829-ff5f-48ae-82fc-e2ec64ab8ec5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:14:41.626780 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-58618829-ff5f-48ae-82fc-e2ec64ab8ec5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:14:41.627485 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-58618829-ff5f-48ae-82fc-e2ec64ab8ec5 admin admin] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:14:41.627924 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-58618829-ff5f-48ae-82fc-e2ec64ab8ec5 admin admin] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:14:41.628982 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: DEBUG oslo_concurrency.lockutils [None req-58618829-ff5f-48ae-82fc-e2ec64ab8ec5 admin admin] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106160) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:14:41.650353 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: INFO nova.api.openstack.requestlog [None req-58618829-ff5f-48ae-82fc-e2ec64ab8ec5 admin admin] 10.222.0.62 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078945 Aug 24 06:14:41.650839 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: [pid: 106160|app: 0|req: 39/76] 10.222.0.62 () {60 vars in 1193 bytes} [Wed Aug 24 06:14:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:15:39.999697 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: Wed Aug 24 06:15:39 2022 - graceful shutdown triggered... Aug 24 06:15:39.999000 dv-cinder-854269-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 06:15:40.001132 dv-cinder-854269-1-iscsi devstack@n-api.service[106160]: Gracefully killing worker 1 (pid: 106160)... Aug 24 06:15:40.001729 dv-cinder-854269-1-iscsi devstack@n-api.service[106161]: Gracefully killing worker 2 (pid: 106161)... Aug 24 06:15:40.999369 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: worker 1 buried after 1 seconds Aug 24 06:15:40.999369 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: worker 2 buried after 1 seconds Aug 24 06:15:40.999369 dv-cinder-854269-1-iscsi devstack@n-api.service[106159]: goodbye to uWSGI. Aug 24 06:15:41.000879 dv-cinder-854269-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 06:15:41.001435 dv-cinder-854269-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 06:15:41.004212 dv-cinder-854269-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 06:15:41.013448 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 06:15:41.016149 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 06:15:41 2022] *** Aug 24 06:15:41.016391 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 06:15:41.016613 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 06:15:41.016785 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: nodename: dv-cinder-854269-1-iscsi Aug 24 06:15:41.016955 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: machine: x86_64 Aug 24 06:15:41.017118 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: clock source: unix Aug 24 06:15:41.017288 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: pcre jit disabled Aug 24 06:15:41.017451 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: detected number of CPU cores: 4 Aug 24 06:15:41.017612 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: current working directory: / Aug 24 06:15:41.017780 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: detected binary path: /usr/bin/uwsgi-core Aug 24 06:15:41.017960 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: your processes number limit is 47680 Aug 24 06:15:41.018125 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: your memory page size is 4096 bytes Aug 24 06:15:41.018289 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: detected max file descriptor number: 2048 Aug 24 06:15:41.018453 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: lock engine: pthread robust mutexes Aug 24 06:15:41.018800 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: thunder lock: enabled Aug 24 06:15:41.019154 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 06:15:41.019527 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 06:15:41.060268 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: Python main interpreter initialized at 0x563858b559c0 Aug 24 06:15:41.061300 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: python threads support enabled Aug 24 06:15:41.061300 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: your server socket listen backlog is limited to 100 connections Aug 24 06:15:41.061300 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: your mercy for graceful operations on workers is 90 seconds Aug 24 06:15:41.061300 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 06:15:41.061300 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: *** Operational MODE: preforking *** Aug 24 06:15:41.061883 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: *** uWSGI is running in multiple interpreter mode *** Aug 24 06:15:41.061883 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: spawned uWSGI master process (pid: 121134) Aug 24 06:15:41.062185 dv-cinder-854269-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 06:15:41.063341 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: spawned uWSGI worker 1 (pid: 121150, cores: 1) Aug 24 06:15:41.063691 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: spawned uWSGI worker 2 (pid: 121151, cores: 1) Aug 24 06:15:41.063858 dv-cinder-854269-1-iscsi devstack@n-api.service[121134]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 06:15:41.727796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:15:41.728732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 06:15:42.900432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:15:42.900432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: from cryptography.utils import int_from_bytes Aug 24 06:15:42.901290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:15:42.901290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: from cryptography.utils import int_from_bytes Aug 24 06:15:42.955063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:15:42.955063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: from cryptography.utils import int_from_bytes Aug 24 06:15:42.955859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:15:42.955859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: from cryptography.utils import int_from_bytes Aug 24 06:15:45.267002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:15:45.267797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:15:45.267797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:15:45.268150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:15:45.268408 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:15:45.268845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.269169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.269491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.269811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.270139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.270447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.270767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.271085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.271411 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.271708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.272020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.272342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854269-1-iscsi {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.272691 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.272999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.273315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.273627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.273929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.274248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.274566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.275074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.275583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.275809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.276122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.276461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.276805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.277131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.277424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.277736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.278062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.278370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.278812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854269-1-iscsi {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.279099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.279402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.279716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.280135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.280455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.280761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.281082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.281401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.281716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.282020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.282336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.282651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.282966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.283265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.283571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.283881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.284191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.284616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.284808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.285060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.285586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.285915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.286237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.286562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.286814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.287066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.287933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.288244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.288580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.288895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.289202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.289513 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.289819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.290145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.290423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.290875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.291356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.291840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.292326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.292821 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.293321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.293897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.294156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.294471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.294817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.295137 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.295452 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.295772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.296095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.296405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.296745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.297055 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.297374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.297707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.298020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.298267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.298568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.298875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.299195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.299500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.299809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.300362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.300698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.301006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.301311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.301614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.301924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.302227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.302527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.302921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.303272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.303537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.303867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.304176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.304485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.304817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.305122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.305430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.305747 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.306055 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.306361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.306682 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.306989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.307294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.307610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.307916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.308228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.308572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.308873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.309179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.309495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.309802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.310104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.310407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.310711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.311015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.311314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.311616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.311919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.312218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.312666 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.312875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.313184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.313502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.313784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.314099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.314433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.314767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.315109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.315421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.315754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.317301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.317301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.317301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.317301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.317301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.318222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.318222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.318222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.319216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.319739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.320261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.320765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.321209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.321423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.324632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.324632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.324632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.324632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.324632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.324632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.324632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.324632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.325577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.325577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.325577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.325577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.325577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.326166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.326166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.326416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.326637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.326951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.327260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.327570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.327886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.328548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.328548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.328843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.329150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.329466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.329784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.329939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:15:45.330590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.330730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:15:45.330879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.331022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:15:45.331163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.331163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.331438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:15:45.331585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.331738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:15:45.331875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.332024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.332203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.332360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.332882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.333121 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.333372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.333634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.333892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.334220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.334488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.334720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.334967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.335219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.335458 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.335458 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.336572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.336815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.337059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.337059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.337619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.337982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.338311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.338311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.338774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854269-1-iscsi {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.339054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.339299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.339541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.339773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.340010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.340270 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.340559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.340802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.341053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.341282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.341515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.341777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.342062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.342321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.342569 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.342812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.343085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.343323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.343566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.343811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.344042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.344285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.344622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.344880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.345134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.345371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.345602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.345849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.346907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.346907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.347399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.347399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.347847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.348194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.348576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.348805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.349056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.349056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.349532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854269-1-iscsi {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.350248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.350475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.350682 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.350913 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.351138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.351394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.351636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.351863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.352101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.352345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.352652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.352901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.353142 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.353376 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.353622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.353871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.354116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.354373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.354608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.354608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.355067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.355313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.355567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.355834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.356081 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.357117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.357362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.357593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.357843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.358097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.358467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.358802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.359043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.359295 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.359546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.359809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.360055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.360289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.360564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.360564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.361040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.361272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.361504 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.361728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.361956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.362197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.362418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.362664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.362915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.363155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.363407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.363675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.364035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.364280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.364537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.364537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.365012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.365659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.365923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.366150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.366417 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.367283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.367530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.367772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.368181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.368520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.368977 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.369236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.369480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.369724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.369968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.370212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.370454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.370728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.370975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.371217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.371466 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.371694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.371929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.371929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.372378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.372378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.372912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.373170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.373396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.62 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.373657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.373905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.62 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.374142 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.374371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.374622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.374869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.375100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.375352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.375591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.375839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.376075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.376313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.376602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.377514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.377775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.378033 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.378288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.378537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.378780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.379235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.379477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.379705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.379935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.380200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.380418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.380696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.381433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.381654 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.381884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.382115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.382347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.382580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.382813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.383043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.383276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.383516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.383766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.384019 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.384255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.384554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.384807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.385041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.385288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.385521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.385754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.385984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.386212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.386452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.386692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.386959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.387817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.388083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.388317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.388593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.388840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.389104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.389527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.389771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.390009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.390260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.390493 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.390739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.390977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.391215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.391469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.391728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.391961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.392214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.392448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.392704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.392959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.393212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.393449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.393690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.393933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.394176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.394419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.394678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.394911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.395144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.395388 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.395628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.395850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.396096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.396343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.396734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.396998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.397257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.398096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.398338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.398596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.398842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.399091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.399547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.399789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.400047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.400282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.400568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.400826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.401062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.401320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.401553 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.401781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.402046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.402279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.402526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.402754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.402992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.403227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.403488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.403717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.403962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.404199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.404442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.405311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.405583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.405814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.406054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.406296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.406537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.406793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.407028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.407273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.407517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.408406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.408676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.408939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.409175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:15:45.409438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.409882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.410119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.410350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.410606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.410854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.411099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.411339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.411580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.411830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.412599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.412857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.413089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.413328 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.413559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.413905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.414152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.414385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.414605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.414812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.415017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.415244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.415472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.415715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.415954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.416193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.416446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.416719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.416970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.417208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.417447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.417690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.418550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.418792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.419022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.419256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.419488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.419740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.420166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.420399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.420683 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.420922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.421140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.421370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.421593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.421826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.422073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.422319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.422556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.422789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.423032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.423294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.423564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.423564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.424162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.424439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.424738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.425256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.425549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.425848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.426102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.426353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.426615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.426886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.427150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.427397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.427640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.429080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.429317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.429543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.429797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.430048 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.430479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.430717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.430939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.431171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.431419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.431641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.431873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.432094 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.432331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.432669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.432917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.433137 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.433355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.433582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.433800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.434033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.434264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.434498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.434717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.434948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.435166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.435396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.435614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.435841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.436210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.436475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.436776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.437062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.437324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.437632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.437910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.438177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.438453 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.439453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.439689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.439923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.440157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.440636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.440866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.441114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.441352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.441599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.441847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.442090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.442090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.442561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.442798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.443028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.443260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.443536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.443787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.444031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.444274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.444541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.444790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.445045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.445289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.445522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.445751 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.446172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.446419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.446652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.446895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.447136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.447374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.447525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.447673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.447834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.447975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.448114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.448263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.448403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.448698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.448913 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.449276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.449425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.449567 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.449704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.449846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.449999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.450139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.450289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.450427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.450623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.450763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.450918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.451071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.451209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.451348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.451498 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.451651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.451651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.451923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.452071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.452214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.452354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.452539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.452701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.452843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.452995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.453137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.453280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.453430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.453571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.453721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.453870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.454012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.454167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.454310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.454477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.454699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.454846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.454989 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.455143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.455297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.455450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.455595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.455740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.455897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.456060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.456236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.456398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.456565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.456720 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.456867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.457022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.457169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.457303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.457444 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.457580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.457734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.457879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.458014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.458149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.458282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.458415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.458564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.458709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.458856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.459033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.459387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.459529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.459529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.459789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.459932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.460073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.460203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.460333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.460485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.460643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.460798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.460953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.461103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.461355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.461496 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.461643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.461780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.461917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.462053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.462209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.462356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.462513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.462655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.462802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.462954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.463109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.463256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.463399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.463541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.463693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.463840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.464003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.464162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.464316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.464471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.464693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.464861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.465019 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.465177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.465334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.465478 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.465631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.465796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.465942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.466102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.466606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.466762 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.466911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.467073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.467073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.467344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.467499 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.467661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.467806 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.467964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.468110 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.468255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.468414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.468621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.468783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.469034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.469190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.469568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.469718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.469866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.470032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.470170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.470303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.470448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.470586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.470738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.470899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.471056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.471204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.471348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.471502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.471655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.471823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.471974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.472125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.472276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.472434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.472600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.472761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.472907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.473054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.473183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.473312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.473451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.473581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.473708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.473842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.473972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.474107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.474244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.474379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.474508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.475153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.475297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.475454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.475602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.475737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.475877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.476020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.476163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.476300 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.476457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.476621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.476760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.476916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.477078 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.477231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.477382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.477530 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.477678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.477826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.477963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.478119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.478268 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.478268 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.478526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.478676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.478834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.478991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.479131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.479278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.479415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.479785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.479934 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.480096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.480245 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.480385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.480730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.480877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.481037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.481189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.481338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.481487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.481626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.481775 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.481935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.482076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.482226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.482379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.482525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.482525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.482824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.482975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.483116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.483255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.483393 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.483540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.483697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.483838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.483974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.483974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.484236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.484388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.484557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.484716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.484856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.484996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.485134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.485292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.485431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.485570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.485707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.485844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.485982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.486131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.486271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.486411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.486550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.486550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.486819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.486971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.487122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.487261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.487410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.487550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.487699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.487838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.487987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.488141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.488292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.488432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.488432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.488924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.489076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.489226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.489360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.489508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.489666 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.490037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.490206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.490867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.491010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.491148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.491307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.491452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.491591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.491730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.491868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.492031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.492179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.492348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.492510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.492683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.492838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.492997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.493138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.493269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.493408 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.493559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.493699 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.493848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.493997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.494148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.494307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.494448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.494598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.494738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.494876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.495022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.495182 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.495330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.495468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.495608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.495756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.495904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.496062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.496200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.496338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.496486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.496712 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.496866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.497115 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.497275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.497416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.497553 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.497703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.497854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.498005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.498149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.498288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.498427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.498564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.498722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.498863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.498863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.499132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.499273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.499421 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.499580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.499721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.500092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.500250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.500250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.500250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.500250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.500250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.500250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.500250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.500250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.501320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.501320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.501320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.501320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.501320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.501320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.501320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.501320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.502344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.502344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.502344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.502344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.502344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.502344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.502344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.502344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.503320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.503320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.503320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.503320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.503320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.503320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.503320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.503320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.504340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.504340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.504340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.504340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.504340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.504340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.504340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.504340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.505286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.505286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.505286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.505286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.505286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.505286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.505286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.505286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.506296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.506296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.506296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.506296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.506296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.506296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.506296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.506296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.507325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.507325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.507325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.507325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.507325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.507325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.507325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.507325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.508296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.508296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.508296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.508296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.508296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.508296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.508296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.508296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.509319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.509319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.509319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.509319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.509319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.509319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.509319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.509319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.510536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.510536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.510536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.510536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.510536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.510536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.510536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.510536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.511585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.511585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.511585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.511585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.511585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.511585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.511585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.511585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.512666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.512666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.512666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.512666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.512666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.512666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.512666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.512666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.513741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.513741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.513741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.513741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.513741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.513741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.513741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.513741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.514832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.514832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.514832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.514832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.514832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.514832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.514832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.514832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.515965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.515965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.515965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.515965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.515965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.515965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.515965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.515965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.517166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.517166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.517166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.517166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.517166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.517166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.517166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.517166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.518183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.518183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.518183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.518183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.518183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.518183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.518183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.518183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.519271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.519271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.519271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.519271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.519271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.519271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.519271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.519271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.520316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.520316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.520316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.520316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.520316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.520316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.520316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.520316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.521291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.521291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.521291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.521291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.521291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.521291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.521291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.521291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.522278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.522278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.522278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.522278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.522278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.522278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.522278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.522278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.523380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.523380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.523380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.523380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.523380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.523380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.523380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.523380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.524326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.524326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.524326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.524326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.524326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.524326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.524326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.524326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.525443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.525443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.525443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.525443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.525443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.525443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.525443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.525443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.526365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.526365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.526365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.526365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.526365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.526365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.526365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.526365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.527724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.527724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.527724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.527724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.527724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.527724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.527724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.527724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.528716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.528716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.528716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.528716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.528716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.528716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.528716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.528716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.529658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.529658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.529658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.529658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.529658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.529658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.529658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.530514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.530655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.530655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.530655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.531030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.531165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.531165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.531430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.531563 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.531696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.531829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.531829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.532084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.532312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.532553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.532770 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.532989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.533212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.533428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.533633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.533843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.534050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.534252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.534471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.534471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.534867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.535086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.535306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.535533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.535752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.535952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.536187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.536453 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.536701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.536922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.537692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.537923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.538133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.538345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.538536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.538747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.538959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.539160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.539375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.539590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.539807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.540034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.540034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.540439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.540835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.541065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.541065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.541484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.541484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.541484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.541484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.541484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.541484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.541484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.541484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.543045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.543045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.543045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.543045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.543045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.543045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.543045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.544221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.544507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.548459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.548638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.548638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.548866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.548949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.549857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.550270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.550345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.550424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.550504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.550504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.550663 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.550741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.550814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.550886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.550886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551266 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551266 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.551948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552808 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.552973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.553950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554245 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.554913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555808 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.555972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.556979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.557125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.557125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.557645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.558357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.558543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.558718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.558886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.559150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.559310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.559474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.559798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.559969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.560133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.560392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.560613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.560787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.561041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.561213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.561377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.561631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.561796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.561968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.562214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.562388 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.562800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.562990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.563320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.563492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.563822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.563997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.564154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.564518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.564710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.564920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.565082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.565246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.565547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.565716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.565890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.566152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.566313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.566480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.566755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.566916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.567088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.567354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.567666 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.567827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.567983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.568268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.569025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.569186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.569497 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.569658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.569825 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.570058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.570223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.570380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.570609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.570776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.570975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.571203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.571374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.571587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.571840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.572012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.572315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.572525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.572830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.573011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.573377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.573541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.573859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.574070 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.574241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.574640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.574827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.574996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.575228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.575500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.575694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.575869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.576148 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.576449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.576656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.576822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.577144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.577360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.577520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.577690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.577865 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.578092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.578273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.578438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.578699 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.578878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.579035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.579306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.579480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.579647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.579857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.580030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.580209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.580379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.580572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.581004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.581171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.581338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.581538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.581710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.581916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.582076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.582244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.582522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.582693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.583049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.583232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.583640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.583895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.584153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.584423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.584657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.584906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.585075 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.585255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.585506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.585683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.585855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.586047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.586222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.586415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.586611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.586777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.587046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.587208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.587372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.587650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.587820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.588080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.588244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.588413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.588741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.588915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.589082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.589290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.589462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.589668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.589839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.589996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.590290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.590460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.590646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.590817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.590974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.591217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.591378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.591558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.591826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.592010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.592198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.592367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.592565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.592885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.593142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.593327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.593497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.593743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.594008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.594536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.595004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.595188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.595347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.595543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.595715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.595915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.596089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.596244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.596548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.596715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.596882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.597128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.597306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.597474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.597669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.597833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.598031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.598251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.598424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.598630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.598828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.598991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.599223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.599409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.599669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.599860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.600030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.600186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.600453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.600648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.600807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.601074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.601235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.601398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.601626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.601804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.602007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.602196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.602366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.602627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.602800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.602985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.603303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.603467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.603749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.603912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.604215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.604377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.604807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.605012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.605242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.605415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.605579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.605744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.605984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.606156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.606311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.606547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.606737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.606896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.607088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.607271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.607488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.607656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.607822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.608294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.608449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.608778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.608956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.609113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.609401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.609561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.609842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.610026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.610196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.610482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.610652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.610818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.611055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.611218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.611386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.611611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.611783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.611975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.612193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.612384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.612627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.612792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.612946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.613349 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.613522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.613827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.614006 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.614225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.614561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.615003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.615746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.616006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.616174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.616332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.616543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.616730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.616902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.617195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.617358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.617522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.617826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.617993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.618163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.618408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.618583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.618751 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:15:45.618995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.619529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.620101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.620671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.621205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.621769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.622363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.623049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.623615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.624229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.624901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.625350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.625853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.626342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:15:45.626728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:15:45.701117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO dbcounter [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Registered counter for database nova_api Aug 24 06:15:45.725874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_db.sqlalchemy.engines [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:15:45.733105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writer thread running {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:15:45.772358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO dbcounter [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Registered counter for database nova_api Aug 24 06:15:45.793343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.context [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e60b15ba-de69-41e8-86da-b79c2f77052b(cell1) {{(pid=121150) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:15:45.793772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_db.sqlalchemy.engines [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:15:45.797713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:15:45.798192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:15:45.799753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:15:45.800765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:15:45.801198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writer thread running {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:15:45.801304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:15:45.803282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:15:45.805407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO dbcounter [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Registered counter for database nova_cell0 Aug 24 06:15:45.809907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO dbcounter [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Registered counter for database nova_cell1 Aug 24 06:15:45.821481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_db.sqlalchemy.engines [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:15:45.822843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_db.sqlalchemy.engines [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:15:45.829060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writer thread running {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:15:45.861214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.context [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e60b15ba-de69-41e8-86da-b79c2f77052b(cell1) {{(pid=121151) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 06:15:45.865162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:15:45.866161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:15:45.867908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:15:45.871517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:15:45.871517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:15:45.871517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:15:45.873119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO dbcounter [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Registered counter for database nova_cell0 Aug 24 06:15:45.877327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO dbcounter [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Registered counter for database nova_cell1 Aug 24 06:15:45.886899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_db.sqlalchemy.engines [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:15:45.890289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_db.sqlalchemy.engines [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:15:45.897789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writer thread running {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:15:45.899716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writer thread running {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:15:45.976870 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writer thread running {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:15:45.987370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO dbcounter [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Registered counter for database nova_cell0 Aug 24 06:15:45.995600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_db.sqlalchemy.engines [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:15:46.000746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writer thread running {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:15:46.049483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO dbcounter [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Registered counter for database nova_cell0 Aug 24 06:15:46.057183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_db.sqlalchemy.engines [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:15:46.062296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writer thread running {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:15:46.322334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: WARNING keystonemiddleware.auth_token [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:15:46.329585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: WARNING keystonemiddleware.auth_token [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:15:46.379629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: WARNING keystonemiddleware.auth_token [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:15:46.387543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: WARNING keystonemiddleware.auth_token [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:15:46.676911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: WARNING keystonemiddleware.auth_token [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:15:46.683514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: WARNING keystonemiddleware.auth_token [None req-f538e596-7663-4213-8543-efbcc9578aa7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:15:46.689036 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563858b559c0 pid: 121150 (default app) Aug 24 06:15:46.726909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: WARNING keystonemiddleware.auth_token [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 06:15:46.732891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: WARNING keystonemiddleware.auth_token [None req-6b51881a-3302-4089-8ed0-c1069cb515cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 06:15:46.738143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563858b559c0 pid: 121151 (default app) Aug 24 06:16:23.804057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=3 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:16:23.805966 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=3 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:16:23.809310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=3 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:16:23.810243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=3 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:16:25.168887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-014cafaf-9396-4663-bde6-36fe48077bab tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Action: 'create', calling method: .version_select at 0x7fcdde2205e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-307618963", "metadata": {"Type": "work"}}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-014cafaf-9396-4663-bde6-36fe48077bab tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Request method failure captured: Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 121 Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcI3KRKsT4OI03QH40G7MyTTnI2GZv6hSgvx3XYoMYGdt-W49Mp5hBgAeqkVZwVel-3BzFMIcVh6frjrKTPc6kVXVozO-ETxBtlMaU-bXMxtoFJ4ATCAHUIdaqEjgWKqizY2Eai4Rl-ZQLpcyv73DKIzQHlgiqIU35hoIDt329Hpz_o Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:16:25.177003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_98863eced91a48beba0ea96d23fb851d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 43ca918762024b82b73a54393a384533 Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-307618963", "metadata": {"Type": "work"}}} Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: Aug 24 06:16:25.178415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-307618963', 'metadata': {'Type': 'work'}}}} Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise error Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:16:25.179284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 06:16:25.180638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 06:16:25.185170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 06:16:25.185170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.187391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-014cafaf-9396-4663-bde6-36fe48077bab tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:16:25.188795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-014cafaf-9396-4663-bde6-36fe48077bab tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.410360 Aug 24 06:16:25.195437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1/1] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Aug 24 06:16:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1419 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:16:25.633938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7623a998-874c-4149-b9ba-a2d62be0d962 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Action: 'create', calling method: .version_select at 0x7fcdde262af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2044885906", "metadata": {"Type": "work"}}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7623a998-874c-4149-b9ba-a2d62be0d962 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Request method failure captured: Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 120 Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcI3KRKsT4OI03QH40G7MyTTnI2GZv6hSgvx3XYoMYGdt-W49Mp5hBgAeqkVZwVel-3BzFMIcVh6frjrKTPc6kVXVozO-ETxBtlMaU-bXMxtoFJ4ATCAHUIdaqEjgWKqizY2Eai4Rl-ZQLpcyv73DKIzQHlgiqIU35hoIDt329Hpz_o Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:16:25.651758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_98863eced91a48beba0ea96d23fb851d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 43ca918762024b82b73a54393a384533 Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2044885906", "metadata": {"Type": "work"}}} Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: Aug 24 06:16:25.653495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2044885906', 'metadata': {'Type': 'work'}}}} Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise error Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi '0' Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:16:25.654427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 06:16:25.656013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 06:16:25.657351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 06:16:25.657351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.661955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7623a998-874c-4149-b9ba-a2d62be0d962 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:16:25.664218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7623a998-874c-4149-b9ba-a2d62be0d962 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.467376 Aug 24 06:16:25.671019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1/2] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Aug 24 06:16:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 474 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 06:16:25.682385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-df1e8f58-8856-43d5-b25f-dfa6a45b81f4 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Action: 'create', calling method: .version_select at 0x7fcdde220670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-661761446", "metadata": {"Type": "work"}}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-df1e8f58-8856-43d5-b25f-dfa6a45b81f4 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Request method failure captured: Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 118 Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcI3KRKsT4OI03QH40G7MyTTnI2GZv6hSgvx3XYoMYGdt-W49Mp5hBgAeqkVZwVel-3BzFMIcVh6frjrKTPc6kVXVozO-ETxBtlMaU-bXMxtoFJ4ATCAHUIdaqEjgWKqizY2Eai4Rl-ZQLpcyv73DKIzQHlgiqIU35hoIDt329Hpz_o Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:16:25.688810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_98863eced91a48beba0ea96d23fb851d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 43ca918762024b82b73a54393a384533 Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-661761446", "metadata": {"Type": "work"}}} Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: Aug 24 06:16:25.690185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-661761446', 'metadata': {'Type': 'work'}}}} Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise error Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi '' Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:16:25.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 06:16:25.692862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 06:16:25.693993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 06:16:25.693993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:25.693993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-df1e8f58-8856-43d5-b25f-dfa6a45b81f4 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:16:25.693993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-df1e8f58-8856-43d5-b25f-dfa6a45b81f4 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.014737 Aug 24 06:16:25.700978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=3 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:16:25.701233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 2/3] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Aug 24 06:16:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:16:25.702701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=3 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:16:25.703932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=3 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:16:25.704848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=3 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:16:25.712747 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-24b8ea36-8b0b-4302-bbd4-d6379c4ac596 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Calling method '.version_select at 0x7fcdde2969d0>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:27.114575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-24b8ea36-8b0b-4302-bbd4-d6379c4ac596 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] HTTP exception thrown: Volume tempest-invalid-1016659901 could not be found. Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-24b8ea36-8b0b-4302-bbd4-d6379c4ac596 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Request method failure captured: Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1016659901 HTTP/1.1 Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcI3KRKsT4OI03QH40G7MyTTnI2GZv6hSgvx3XYoMYGdt-W49Mp5hBgAeqkVZwVel-3BzFMIcVh6frjrKTPc6kVXVozO-ETxBtlMaU-bXMxtoFJ4ATCAHUIdaqEjgWKqizY2Eai4Rl-ZQLpcyv73DKIzQHlgiqIU35hoIDt329Hpz_o Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:16:27.118462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_98863eced91a48beba0ea96d23fb851d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 43ca918762024b82b73a54393a384533 Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Volume tempest-invalid-1016659901 could not be found. Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': 'tempest-invalid-1016659901'} Aug 24 06:16:27.119637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1016659901 could not be found. (HTTP 404) (Request-ID: req-1431267b-57cc-43dd-aaf5-75339501192c) Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:27.120299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:16:27.122802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1016659901 could not be found. Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:16:27.123737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1016659901 could not be found. Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1016659901 could not be found. Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-24b8ea36-8b0b-4302-bbd4-d6379c4ac596 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Returning 404 to user: Volume tempest-invalid-1016659901 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:16:27.124659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-24b8ea36-8b0b-4302-bbd4-d6379c4ac596 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1016659901" status: 404 len: 99 microversion: 2.1 time: 1.419969 Aug 24 06:16:27.138333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Aug 24 06:16:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1016659901 => generated 99 bytes in 1428 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 06:16:27.138404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9ba4fcd3-ccf1-4d26-bd1a-3f95917d7698 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004655 Aug 24 06:16:27.138404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 3/5] 10.222.0.62 () {58 vars in 1140 bytes} [Wed Aug 24 06:16:27 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 06:16:27.145799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b1d67abb-a29b-45df-b992-3b967043bd8b tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005528 Aug 24 06:16:27.146307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 3/6] 10.222.0.62 () {58 vars in 1137 bytes} [Wed Aug 24 06:16:27 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 06:16:27.157442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6a4091b0-c5e5-429b-87ec-b5baae2668ab tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Calling method '.version_select at 0x7fcdde15c4c0>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:27.927954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-6a4091b0-c5e5-429b-87ec-b5baae2668ab tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] HTTP exception thrown: Volume 981b6548-ace9-4a45-a41c-8bfa354cceb9 could not be found. Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6a4091b0-c5e5-429b-87ec-b5baae2668ab tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Request method failure captured: Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: DELETE /compute/v2.1/os-volumes/981b6548-ace9-4a45-a41c-8bfa354cceb9 HTTP/1.1 Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcI3KRKsT4OI03QH40G7MyTTnI2GZv6hSgvx3XYoMYGdt-W49Mp5hBgAeqkVZwVel-3BzFMIcVh6frjrKTPc6kVXVozO-ETxBtlMaU-bXMxtoFJ4ATCAHUIdaqEjgWKqizY2Eai4Rl-ZQLpcyv73DKIzQHlgiqIU35hoIDt329Hpz_o Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:16:27.931955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_98863eced91a48beba0ea96d23fb851d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 43ca918762024b82b73a54393a384533 Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Volume 981b6548-ace9-4a45-a41c-8bfa354cceb9 could not be found. Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '981b6548-ace9-4a45-a41c-8bfa354cceb9'} Aug 24 06:16:27.933032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 981b6548-ace9-4a45-a41c-8bfa354cceb9 could not be found. (HTTP 404) (Request-ID: req-a8584f2f-2da0-458e-b062-d337f4cb9025) Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:27.933628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:16:27.941333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 981b6548-ace9-4a45-a41c-8bfa354cceb9 could not be found. Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 06:16:27.942262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 981b6548-ace9-4a45-a41c-8bfa354cceb9 could not be found. Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 981b6548-ace9-4a45-a41c-8bfa354cceb9 could not be found. Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6a4091b0-c5e5-429b-87ec-b5baae2668ab tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Returning 404 to user: Volume 981b6548-ace9-4a45-a41c-8bfa354cceb9 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6a4091b0-c5e5-429b-87ec-b5baae2668ab tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/981b6548-ace9-4a45-a41c-8bfa354cceb9" status: 404 len: 109 microversion: 2.1 time: 0.782048 Aug 24 06:16:27.943202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 24 06:16:27 2022] DELETE /compute/v2.1/os-volumes/981b6548-ace9-4a45-a41c-8bfa354cceb9 => generated 109 bytes in 784 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:16:27.947784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d90d9f40-c3a1-434c-b487-76ff2e031cc3 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Calling method '.version_select at 0x7fcdde03c160>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:28.009121 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-d90d9f40-c3a1-434c-b487-76ff2e031cc3 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] HTTP exception thrown: Volume cd4e3abd-c608-4a41-ae95-d21dc0e59452 could not be found. Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d90d9f40-c3a1-434c-b487-76ff2e031cc3 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Request method failure captured: Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/os-volumes/cd4e3abd-c608-4a41-ae95-d21dc0e59452 HTTP/1.1 Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcI3KRKsT4OI03QH40G7MyTTnI2GZv6hSgvx3XYoMYGdt-W49Mp5hBgAeqkVZwVel-3BzFMIcVh6frjrKTPc6kVXVozO-ETxBtlMaU-bXMxtoFJ4ATCAHUIdaqEjgWKqizY2Eai4Rl-ZQLpcyv73DKIzQHlgiqIU35hoIDt329Hpz_o Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:16:28.016400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/98863eced91a48beba0ea96d23fb851d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_98863eced91a48beba0ea96d23fb851d", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: 98863eced91a48beba0ea96d23fb851d Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-VolumesNegativeTest-377188381 Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 43ca918762024b82b73a54393a384533 Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-VolumesNegativeTest-377188381-project Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Volume cd4e3abd-c608-4a41-ae95-d21dc0e59452 could not be found. Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': 'cd4e3abd-c608-4a41-ae95-d21dc0e59452'} Aug 24 06:16:28.017416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cd4e3abd-c608-4a41-ae95-d21dc0e59452 could not be found. (HTTP 404) (Request-ID: req-a931d2e4-e6cd-42ab-8639-005514ffe70b) Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:28.018020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:16:28.018879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cd4e3abd-c608-4a41-ae95-d21dc0e59452 could not be found. Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 06:16:28.020357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:16:28.023334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cd4e3abd-c608-4a41-ae95-d21dc0e59452 could not be found. Aug 24 06:16:28.023334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:28.023334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:16:28.023334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:28.023334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:16:28.023334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:16:28.023334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:16:28.023334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:16:28.023334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:16:28.023334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cd4e3abd-c608-4a41-ae95-d21dc0e59452 could not be found. Aug 24 06:16:28.023334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:16:28.030669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d90d9f40-c3a1-434c-b487-76ff2e031cc3 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] Returning 404 to user: Volume cd4e3abd-c608-4a41-ae95-d21dc0e59452 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:16:28.030669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d90d9f40-c3a1-434c-b487-76ff2e031cc3 tempest-VolumesNegativeTest-377188381 tempest-VolumesNegativeTest-377188381-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/cd4e3abd-c608-4a41-ae95-d21dc0e59452" status: 404 len: 109 microversion: 2.1 time: 0.089020 Aug 24 06:16:28.033477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 24 06:16:27 2022] GET /compute/v2.1/os-volumes/cd4e3abd-c608-4a41-ae95-d21dc0e59452 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:16:31.969665 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dc2791e9-9f34-4601-a65d-e8551f679b8c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Action: 'create', calling method: .version_select at 0x7fcdde08c040>, body: {"keypair": {"name": "tempest-keypair-636509281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUm1nme+q7wl0qb+N3tubNYYBv0zBRPR8Ljxr/0IXZnlfTFAhqMCOI9mLiBXC0WMf02twoYpdtsMKiU1oi6A2MFejwdrN2wkKrldZhWnHA4x3DcMPBiADwuXPwctjHDJA=="}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:32.107106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-dc2791e9-9f34-4601-a65d-e8551f679b8c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Getting quotas for project ff194aa4a2d744caaa09e0ceee54b1d2. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:16:32.124675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-dc2791e9-9f34-4601-a65d-e8551f679b8c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Getting quotas for user 25908fb02f7f46f5b9e483811302a67e and project ff194aa4a2d744caaa09e0ceee54b1d2. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:16:32.330538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dc2791e9-9f34-4601-a65d-e8551f679b8c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.666003 Aug 24 06:16:32.332252 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 5/9] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 24 06:16:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:16:39.659638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-49a09f1a-bb68-430a-a727-c4efc11e0c9c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Action: 'create', calling method: .version_select at 0x7fcdde08fa60>, body: {"keypair": {"name": "tempest-keypair-1576137281", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgsSfFeDob7ItJy8jbs1DJ0mSpJhiKJDP9sV60E3Q5IeLKLrsrTWKlEVYGTC2UMn3QYxhTJ8aXLhRxl5aBNGnNYnH788PIEjxNEng8OdVEEtRQTvA5a55g0hTvXMpKALQ=="}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:39.780554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-49a09f1a-bb68-430a-a727-c4efc11e0c9c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Getting quotas for project f4e8d9878aff47cea1bd895f618badb8. Resources: {'key_pairs'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:16:39.791553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-49a09f1a-bb68-430a-a727-c4efc11e0c9c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Getting quotas for user 5059723f417445fa934ecfe3e50d0197 and project f4e8d9878aff47cea1bd895f618badb8. Resources: {'key_pairs'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:16:40.010615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-49a09f1a-bb68-430a-a727-c4efc11e0c9c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.769776 Aug 24 06:16:40.014956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 5/10] 10.222.0.62 () {62 vars in 1200 bytes} [Wed Aug 24 06:16:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 772 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 06:16:42.161784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=4 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:16:42.225259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:16:42.370403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-511838248", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4af0a46d-e123-4947-9ac3-12223a01403a"}], "security_groups": [{"name": "tempest-securitygroup--709655860"}], "key_name": "tempest-keypair-636509281", "user_data": "}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:42.795122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a0c10369-339a-46e0-b258-475148f8722a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Action: 'create', calling method: .version_select at 0x7fcdde00f670>, body: {"keypair": {"name": "tempest-keypair-1017395839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBEY/YJR4wr6QQwUs2+pyVldCGnVmBMOlG9K5KbfBSsxA49wi9GqC149vW2v1Z4ttzk8oc4n0PBVQYVBXbPjxmqd7Q7vEtCVwDBtDxXaikNMk4Nl+l0bs6ZnalVIL4L/g=="}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:42.814428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] validate_networks() for [('4af0a46d-e123-4947-9ac3-12223a01403a', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:16:42.831293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-a0c10369-339a-46e0-b258-475148f8722a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:16:42.840053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-a0c10369-339a-46e0-b258-475148f8722a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for user 6abfd0a28f9e482badae7018f1b7f9a1 and project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:16:42.955373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a0c10369-339a-46e0-b258-475148f8722a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.105402 Aug 24 06:16:42.956832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 6/11] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 24 06:16:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:16:43.259641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1401955339", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "networks": [{"uuid": "0705d1c3-4241-486b-918c-75f23a33906a"}]}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:43.397384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.network.neutron [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] validate_networks() for [('0705d1c3-4241-486b-918c-75f23a33906a', None, None, None, None, None)] {{(pid=121150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:16:44.818988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:16:44.819727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:16:44.820229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:16:44.820681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:16:44.836933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:16:44.845224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:44.847827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:44.849655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:44.850625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:44.855912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:44.858044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:44.912977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Getting quotas for project ff194aa4a2d744caaa09e0ceee54b1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:16:44.921481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Getting quotas for user 25908fb02f7f46f5b9e483811302a67e and project ff194aa4a2d744caaa09e0ceee54b1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:16:44.944367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:16:44.949813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:16:45.169892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d4caeded-1933-4cad-8060-e69ef7d2819e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.809684 Aug 24 06:16:45.171059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 6/12] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:16:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 2812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:16:45.185973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2ee53632-5ad0-4596-befb-28a50e42a37f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:45.186592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2ee53632-5ad0-4596-befb-28a50e42a37f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:45.287377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Flavor limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:16:45.287964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Image limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:16:45.288749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Flavor pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:16:45.291532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Image pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:16:45.295086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:16:45.323772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:45.327358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:45.328705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:45.331958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:45.332821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:45.333275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:45.404636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Getting quotas for project ed8aa953e25943a197bec8ac5148a39c. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:16:45.411687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Getting quotas for user 6021a225b5fd4377a9f8120a84232709 and project ed8aa953e25943a197bec8ac5148a39c. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:16:45.436414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Going to run 1 instances... {{(pid=121150) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:16:45.444213 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:16:45.490579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2ee53632-5ad0-4596-befb-28a50e42a37f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:45.520095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2ee53632-5ad0-4596-befb-28a50e42a37f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1236 microversion: 2.1 time: 0.339903 Aug 24 06:16:45.520736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:45 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1236 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:45.798294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-400fafd3-8a39-4225-b02e-a2b1a37a6050 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.836234 Aug 24 06:16:45.806689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 7/14] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:16:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:16:45.814847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-365117df-a505-4950-b26b-35325c4ca8f4 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:45.816259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-365117df-a505-4950-b26b-35325c4ca8f4 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:46.004418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-365117df-a505-4950-b26b-35325c4ca8f4 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:46.014898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-365117df-a505-4950-b26b-35325c4ca8f4 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1215 microversion: 2.1 time: 0.206001 Aug 24 06:16:46.015726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 8/15] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:45 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:46.550716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1cf17f59-ca3d-46e9-ae7f-890aa95b16d0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:46.551427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1cf17f59-ca3d-46e9-ae7f-890aa95b16d0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:46.553380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1388565434", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84581a9b-8bba-47b1-a8fd-ca40693e6cc8"}], "security_groups": [{"name": "tempest-securitygroup--1503084213"}], "key_name": "tempest-keypair-1576137281", "user_data": "}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:46.820047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1cf17f59-ca3d-46e9-ae7f-890aa95b16d0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:46.833215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] validate_networks() for [('84581a9b-8bba-47b1-a8fd-ca40693e6cc8', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:16:46.881276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1cf17f59-ca3d-46e9-ae7f-890aa95b16d0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1236 microversion: 2.1 time: 0.324678 Aug 24 06:16:46.881276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 8/16] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:46 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1236 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:16:47.037226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7f9524c9-b9b7-45fb-901e-57537c7c8f09 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:47.037839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7f9524c9-b9b7-45fb-901e-57537c7c8f09 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:47.153918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7f9524c9-b9b7-45fb-901e-57537c7c8f09 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:47.168001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7f9524c9-b9b7-45fb-901e-57537c7c8f09 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1215 microversion: 2.1 time: 0.131226 Aug 24 06:16:47.169173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 9/17] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:47 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:47.748186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:16:47.748776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:16:47.749246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:16:47.749661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:16:47.751078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:16:47.772753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:47.773260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:47.773715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:47.774436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:47.790707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:47.791234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:47.851707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Getting quotas for project f4e8d9878aff47cea1bd895f618badb8. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:16:47.858163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Getting quotas for user 5059723f417445fa934ecfe3e50d0197 and project f4e8d9878aff47cea1bd895f618badb8. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:16:47.873306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:16:47.875755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:16:47.894330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ce34afbd-73e3-487f-b594-4fcfcd102a61 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:47.894928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ce34afbd-73e3-487f-b594-4fcfcd102a61 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:48.026367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ce34afbd-73e3-487f-b594-4fcfcd102a61 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:48.035371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ce34afbd-73e3-487f-b594-4fcfcd102a61 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1236 microversion: 2.1 time: 0.146183 Aug 24 06:16:48.037101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 10/18] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:47 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1236 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:16:48.083740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a0e2b1d8-9739-4d25-ba9b-0399db720e19 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.536053 Aug 24 06:16:48.084998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 9/19] 10.222.0.62 () {62 vars in 1188 bytes} [Wed Aug 24 06:16:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 06:16:48.098908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-98a849c6-3d59-4784-a2ac-05092faca6e2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:48.099534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-98a849c6-3d59-4784-a2ac-05092faca6e2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:48.195301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-66b87954-6968-4dec-9a28-dfc28a8fea98 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:48.195301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-66b87954-6968-4dec-9a28-dfc28a8fea98 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:48.199419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66b87954-6968-4dec-9a28-dfc28a8fea98 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:48.200178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66b87954-6968-4dec-9a28-dfc28a8fea98 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:48.200796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66b87954-6968-4dec-9a28-dfc28a8fea98 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:48.201673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66b87954-6968-4dec-9a28-dfc28a8fea98 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:48.202442 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66b87954-6968-4dec-9a28-dfc28a8fea98 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:48.203141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66b87954-6968-4dec-9a28-dfc28a8fea98 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:48.248197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-98a849c6-3d59-4784-a2ac-05092faca6e2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:48.260832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-98a849c6-3d59-4784-a2ac-05092faca6e2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:48.264403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-98a849c6-3d59-4784-a2ac-05092faca6e2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:48.282087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-98a849c6-3d59-4784-a2ac-05092faca6e2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1282 microversion: 2.20 time: 0.189412 Aug 24 06:16:48.285055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 11/20] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:16:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1282 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:16:48.578507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-66b87954-6968-4dec-9a28-dfc28a8fea98 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:48.606611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-66b87954-6968-4dec-9a28-dfc28a8fea98 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1219 microversion: 2.1 time: 0.418731 Aug 24 06:16:48.620278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 10/21] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:48 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1219 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:16:49.030216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-397230280", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51fe0999-9ccc-4b64-9b23-f80a9285df9a"}], "security_groups": [{"name": "tempest-securitygroup--1698582416"}], "key_name": "tempest-keypair-1017395839", "user_data": "}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:49.059338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1a39142e-efbd-4639-b359-2a530eb7d921 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:49.061669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1a39142e-efbd-4639-b359-2a530eb7d921 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:49.071766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a39142e-efbd-4639-b359-2a530eb7d921 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:49.072735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a39142e-efbd-4639-b359-2a530eb7d921 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:49.073374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a39142e-efbd-4639-b359-2a530eb7d921 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:49.091542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a39142e-efbd-4639-b359-2a530eb7d921 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:49.094995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a39142e-efbd-4639-b359-2a530eb7d921 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:49.096446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a39142e-efbd-4639-b359-2a530eb7d921 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:49.375755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.network.neutron [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] validate_networks() for [('51fe0999-9ccc-4b64-9b23-f80a9285df9a', None, None, None, None, None)] {{(pid=121150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:16:49.697989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1a39142e-efbd-4639-b359-2a530eb7d921 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:49.712168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1a39142e-efbd-4639-b359-2a530eb7d921 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1232 microversion: 2.1 time: 0.658496 Aug 24 06:16:49.726684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 11/22] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:49 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1232 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:16:49.731739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7fc12bbc-fc99-477c-ba5e-a31c844ee7a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:49.732714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7fc12bbc-fc99-477c-ba5e-a31c844ee7a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:49.804183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7fc12bbc-fc99-477c-ba5e-a31c844ee7a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:49.814231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7fc12bbc-fc99-477c-ba5e-a31c844ee7a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:49.817204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7fc12bbc-fc99-477c-ba5e-a31c844ee7a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:49.818793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7fc12bbc-fc99-477c-ba5e-a31c844ee7a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1282 microversion: 2.20 time: 0.090846 Aug 24 06:16:49.836545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 12/23] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:16:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:16:49.849076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a113d547-a0b8-4e27-a8e7-0a06a3e2d2a1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:49.850072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a113d547-a0b8-4e27-a8e7-0a06a3e2d2a1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:49.859572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a113d547-a0b8-4e27-a8e7-0a06a3e2d2a1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:49.861074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a113d547-a0b8-4e27-a8e7-0a06a3e2d2a1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:49.874556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a113d547-a0b8-4e27-a8e7-0a06a3e2d2a1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:49.876272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a113d547-a0b8-4e27-a8e7-0a06a3e2d2a1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:49.878447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a113d547-a0b8-4e27-a8e7-0a06a3e2d2a1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:49.881920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a113d547-a0b8-4e27-a8e7-0a06a3e2d2a1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:49.976659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a113d547-a0b8-4e27-a8e7-0a06a3e2d2a1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:49.986947 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a113d547-a0b8-4e27-a8e7-0a06a3e2d2a1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1267 microversion: 2.1 time: 0.148858 Aug 24 06:16:49.987808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 13/24] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:49 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:50.331158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Flavor limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:16:50.331620 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Image limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:16:50.332032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Flavor pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:16:50.332825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Image pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:16:50.333386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:16:50.350414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:50.353525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:50.353525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:50.357523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:50.359815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:50.360278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:50.393288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:16:50.397581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for user 6abfd0a28f9e482badae7018f1b7f9a1 and project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:16:50.419413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Going to run 1 instances... {{(pid=121150) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:16:50.421835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:16:50.584736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6ba63b60-5ff2-4fd1-9fd3-0c4a7f0fcc64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.560265 Aug 24 06:16:50.588300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 12/25] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:16:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:16:50.600723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cb0f4d14-e5c7-4966-b63c-e08a2b02c692 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:50.602368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cb0f4d14-e5c7-4966-b63c-e08a2b02c692 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:50.735969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4e1162be-9981-45ea-9295-689473d26ad5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:50.738215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4e1162be-9981-45ea-9295-689473d26ad5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:50.755435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e1162be-9981-45ea-9295-689473d26ad5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:50.761980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e1162be-9981-45ea-9295-689473d26ad5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:50.763086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e1162be-9981-45ea-9295-689473d26ad5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:50.768339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e1162be-9981-45ea-9295-689473d26ad5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:50.773255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e1162be-9981-45ea-9295-689473d26ad5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:50.776178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e1162be-9981-45ea-9295-689473d26ad5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:50.860474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cb0f4d14-e5c7-4966-b63c-e08a2b02c692 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:50.872697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cb0f4d14-e5c7-4966-b63c-e08a2b02c692 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1241 microversion: 2.1 time: 0.274743 Aug 24 06:16:50.876398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 14/26] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1241 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:16:50.895115 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:50.899957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:50.957074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:50.964939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:50.965560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:50.971171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:50.975534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:50.977663 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:51.103858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4e1162be-9981-45ea-9295-689473d26ad5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:51.146171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4e1162be-9981-45ea-9295-689473d26ad5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1306 microversion: 2.1 time: 0.415869 Aug 24 06:16:51.156844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 13/27] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:50 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1306 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:16:51.163308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-106ca919-e701-4674-8d64-f69cc9ce7a90 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:51.163308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-106ca919-e701-4674-8d64-f69cc9ce7a90 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:51.206641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-106ca919-e701-4674-8d64-f69cc9ce7a90 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:51.209190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-106ca919-e701-4674-8d64-f69cc9ce7a90 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:51.209839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-106ca919-e701-4674-8d64-f69cc9ce7a90 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:51.212299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-106ca919-e701-4674-8d64-f69cc9ce7a90 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:51.215940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-106ca919-e701-4674-8d64-f69cc9ce7a90 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:51.216298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-106ca919-e701-4674-8d64-f69cc9ce7a90 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:51.246912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:51.261064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:51.262649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:51.269739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-22501504-5795-4300-ae1f-b136d417772d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1278 microversion: 2.20 time: 0.391904 Aug 24 06:16:51.270347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 15/28] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:16:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1278 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:16:51.448862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-106ca919-e701-4674-8d64-f69cc9ce7a90 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:51.458180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-106ca919-e701-4674-8d64-f69cc9ce7a90 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1273 microversion: 2.1 time: 0.306981 Aug 24 06:16:51.459124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 14/29] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:51 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1273 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:51.910193 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7efe1539-093f-46d1-97c6-d9a17e06e0ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:51.912675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7efe1539-093f-46d1-97c6-d9a17e06e0ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:52.056627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7efe1539-093f-46d1-97c6-d9a17e06e0ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:52.070011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7efe1539-093f-46d1-97c6-d9a17e06e0ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1241 microversion: 2.1 time: 0.174683 Aug 24 06:16:52.081434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 16/30] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1241 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:52.173899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a384b5fc-11f4-40ad-b3a1-0655917d225d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:52.173899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a384b5fc-11f4-40ad-b3a1-0655917d225d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:52.192049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a384b5fc-11f4-40ad-b3a1-0655917d225d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:52.192579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a384b5fc-11f4-40ad-b3a1-0655917d225d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:52.198462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a384b5fc-11f4-40ad-b3a1-0655917d225d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:52.201301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a384b5fc-11f4-40ad-b3a1-0655917d225d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:52.202131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a384b5fc-11f4-40ad-b3a1-0655917d225d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:52.204058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a384b5fc-11f4-40ad-b3a1-0655917d225d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:52.299152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:52.299152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:52.315650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:52.316367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:52.320927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:52.320927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:52.320927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:52.320927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:52.673053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a384b5fc-11f4-40ad-b3a1-0655917d225d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:52.684372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a384b5fc-11f4-40ad-b3a1-0655917d225d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1294 microversion: 2.1 time: 0.516918 Aug 24 06:16:52.692881 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 15/31] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:52 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1294 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:52.698788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-93fbb5c6-6022-44bf-828e-aac748981cd3 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:52.699551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-93fbb5c6-6022-44bf-828e-aac748981cd3 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:52.729803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb5c6-6022-44bf-828e-aac748981cd3 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:52.742564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb5c6-6022-44bf-828e-aac748981cd3 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:52.743316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb5c6-6022-44bf-828e-aac748981cd3 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:52.744345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb5c6-6022-44bf-828e-aac748981cd3 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:52.745591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb5c6-6022-44bf-828e-aac748981cd3 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:52.751050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb5c6-6022-44bf-828e-aac748981cd3 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:52.834409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:52.846214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:52.852722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:52.853882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1c1790d8-48fc-456c-82b9-eeac6adec4dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1342 microversion: 2.20 time: 0.561089 Aug 24 06:16:52.869034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 17/32] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:16:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1342 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:16:52.877279 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-93fbb5c6-6022-44bf-828e-aac748981cd3 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:52.883467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-93fbb5c6-6022-44bf-828e-aac748981cd3 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1273 microversion: 2.1 time: 0.193583 Aug 24 06:16:52.884292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 16/33] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:52 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:53.092047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6d240e3b-9821-4c49-8616-f2b46b276870 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:53.092723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6d240e3b-9821-4c49-8616-f2b46b276870 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:53.112822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6d240e3b-9821-4c49-8616-f2b46b276870 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:53.113343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6d240e3b-9821-4c49-8616-f2b46b276870 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:53.113786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6d240e3b-9821-4c49-8616-f2b46b276870 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:53.117718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6d240e3b-9821-4c49-8616-f2b46b276870 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:53.118211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6d240e3b-9821-4c49-8616-f2b46b276870 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:53.124902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6d240e3b-9821-4c49-8616-f2b46b276870 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:53.568094 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6d240e3b-9821-4c49-8616-f2b46b276870 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:53.582194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6d240e3b-9821-4c49-8616-f2b46b276870 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1237 microversion: 2.1 time: 0.494588 Aug 24 06:16:53.591978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 18/34] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1237 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:53.715448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-39b15eee-003c-4030-86f3-e553e414b38d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:53.716056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-39b15eee-003c-4030-86f3-e553e414b38d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:53.735474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39b15eee-003c-4030-86f3-e553e414b38d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:53.736245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39b15eee-003c-4030-86f3-e553e414b38d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:53.739514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39b15eee-003c-4030-86f3-e553e414b38d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:53.744554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39b15eee-003c-4030-86f3-e553e414b38d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:53.744554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39b15eee-003c-4030-86f3-e553e414b38d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:53.744554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39b15eee-003c-4030-86f3-e553e414b38d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:53.885652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:53.886371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:53.904170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:53.905129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:53.907621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:53.913735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:53.914422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:53.915612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:54.158667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-39b15eee-003c-4030-86f3-e553e414b38d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:54.174112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-39b15eee-003c-4030-86f3-e553e414b38d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.462685 Aug 24 06:16:54.188633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 17/35] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:53 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:54.204484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c98c36e4-9a7e-4dac-bae2-37d2d05366cf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:54.205422 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c98c36e4-9a7e-4dac-bae2-37d2d05366cf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:54.216362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c98c36e4-9a7e-4dac-bae2-37d2d05366cf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:54.217244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c98c36e4-9a7e-4dac-bae2-37d2d05366cf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:54.217892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c98c36e4-9a7e-4dac-bae2-37d2d05366cf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:54.218815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c98c36e4-9a7e-4dac-bae2-37d2d05366cf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:54.219628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c98c36e4-9a7e-4dac-bae2-37d2d05366cf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:54.220258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c98c36e4-9a7e-4dac-bae2-37d2d05366cf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:54.538192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:54.579009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:54.822769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:54.822769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bdcd2d16-afb0-41e1-9c5d-20aac1122bcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1340 microversion: 2.20 time: 0.702277 Aug 24 06:16:54.822769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 19/36] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:16:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1340 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:16:54.822769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-581d520a-127f-4180-be1e-0afde17df99f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:54.825428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-581d520a-127f-4180-be1e-0afde17df99f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:54.825428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-581d520a-127f-4180-be1e-0afde17df99f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:54.825428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-581d520a-127f-4180-be1e-0afde17df99f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:54.825428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-581d520a-127f-4180-be1e-0afde17df99f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:54.826003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-581d520a-127f-4180-be1e-0afde17df99f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:54.826003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-581d520a-127f-4180-be1e-0afde17df99f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:54.826003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-581d520a-127f-4180-be1e-0afde17df99f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:54.827557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c98c36e4-9a7e-4dac-bae2-37d2d05366cf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:54.827557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c98c36e4-9a7e-4dac-bae2-37d2d05366cf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.512591 Aug 24 06:16:54.827557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 18/37] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:54 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:54.829637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-581d520a-127f-4180-be1e-0afde17df99f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:54.829637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-581d520a-127f-4180-be1e-0afde17df99f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1301 microversion: 2.1 time: 0.141943 Aug 24 06:16:54.829637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 20/38] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1301 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:16:55.196796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dcdcfad2-a984-4dcb-830b-2cb1553eda7e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:55.197724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dcdcfad2-a984-4dcb-830b-2cb1553eda7e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:55.220296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcdcfad2-a984-4dcb-830b-2cb1553eda7e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:55.220296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcdcfad2-a984-4dcb-830b-2cb1553eda7e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:55.220296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcdcfad2-a984-4dcb-830b-2cb1553eda7e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:55.220296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcdcfad2-a984-4dcb-830b-2cb1553eda7e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:55.220580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcdcfad2-a984-4dcb-830b-2cb1553eda7e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:55.220580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcdcfad2-a984-4dcb-830b-2cb1553eda7e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:55.788842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b5beb239-f65f-4432-85a3-7492eaeb6b33 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:55.789795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b5beb239-f65f-4432-85a3-7492eaeb6b33 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:55.809520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5beb239-f65f-4432-85a3-7492eaeb6b33 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:55.816897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5beb239-f65f-4432-85a3-7492eaeb6b33 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:55.819465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5beb239-f65f-4432-85a3-7492eaeb6b33 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:55.820537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5beb239-f65f-4432-85a3-7492eaeb6b33 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:55.821238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5beb239-f65f-4432-85a3-7492eaeb6b33 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:55.826277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5beb239-f65f-4432-85a3-7492eaeb6b33 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:55.937697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dcdcfad2-a984-4dcb-830b-2cb1553eda7e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:55.948943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dcdcfad2-a984-4dcb-830b-2cb1553eda7e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.756217 Aug 24 06:16:55.952874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 19/39] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:55 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:55.967619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:55.968242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:55.978765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:55.979271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:55.979718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:55.980431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:55.980934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:55.981363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:56.764299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:56.785256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:56.790562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:56.795948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-43cae324-3a46-43c6-82c2-5ba04c81c974 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.836145 Aug 24 06:16:56.795948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 20/40] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:16:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:16:56.804322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-19291b3b-b59f-492e-8541-100083c3ae1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:56.805071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-19291b3b-b59f-492e-8541-100083c3ae1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:56.821976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-19291b3b-b59f-492e-8541-100083c3ae1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:56.825275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-19291b3b-b59f-492e-8541-100083c3ae1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:56.826273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-19291b3b-b59f-492e-8541-100083c3ae1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:56.828621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-19291b3b-b59f-492e-8541-100083c3ae1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:56.832716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-19291b3b-b59f-492e-8541-100083c3ae1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:56.833395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-19291b3b-b59f-492e-8541-100083c3ae1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:57.069523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-19291b3b-b59f-492e-8541-100083c3ae1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:57.079272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-19291b3b-b59f-492e-8541-100083c3ae1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1299 microversion: 2.1 time: 0.282858 Aug 24 06:16:57.079815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 21/41] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1299 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:57.093850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2c55bfe3-0010-454d-a5ec-27715ca9f6da tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:57.094719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2c55bfe3-0010-454d-a5ec-27715ca9f6da tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:57.111691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c55bfe3-0010-454d-a5ec-27715ca9f6da tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:57.112454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c55bfe3-0010-454d-a5ec-27715ca9f6da tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:57.113140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c55bfe3-0010-454d-a5ec-27715ca9f6da tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:57.114071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c55bfe3-0010-454d-a5ec-27715ca9f6da tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:57.114897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c55bfe3-0010-454d-a5ec-27715ca9f6da tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:57.115718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c55bfe3-0010-454d-a5ec-27715ca9f6da tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:57.295164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b5beb239-f65f-4432-85a3-7492eaeb6b33 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:57.307602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b5beb239-f65f-4432-85a3-7492eaeb6b33 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 1.523849 Aug 24 06:16:57.309941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 21/42] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:55 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 1527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:57.594108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2c55bfe3-0010-454d-a5ec-27715ca9f6da tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:57.613463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2c55bfe3-0010-454d-a5ec-27715ca9f6da tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.523133 Aug 24 06:16:57.614445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 22/43] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:57 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:57.821559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:57.822275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:57.824649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=4 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:16:57.833868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:57.834461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:57.834899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:57.835666 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:57.836395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:57.837004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:58.106981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-041fda9c-974e-47ba-8bea-a267c043be0d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:58.108201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-041fda9c-974e-47ba-8bea-a267c043be0d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:58.132180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-041fda9c-974e-47ba-8bea-a267c043be0d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:58.132180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-041fda9c-974e-47ba-8bea-a267c043be0d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:58.132180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-041fda9c-974e-47ba-8bea-a267c043be0d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:58.132180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-041fda9c-974e-47ba-8bea-a267c043be0d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:58.133505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-041fda9c-974e-47ba-8bea-a267c043be0d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:58.133505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-041fda9c-974e-47ba-8bea-a267c043be0d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:58.435081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:58.462582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:58.466064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:58.484035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a81d107c-d2b7-4ad5-b7cb-14ff851ba9eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.652161 Aug 24 06:16:58.487416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 22/44] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:16:57 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:16:58.514170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-827e2732-7e94-48fc-927a-66d73dfd984f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:58.521482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-827e2732-7e94-48fc-927a-66d73dfd984f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:58.536723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-827e2732-7e94-48fc-927a-66d73dfd984f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:58.541001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-827e2732-7e94-48fc-927a-66d73dfd984f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:58.545216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-827e2732-7e94-48fc-927a-66d73dfd984f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:58.546181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-827e2732-7e94-48fc-927a-66d73dfd984f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:58.546895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-827e2732-7e94-48fc-927a-66d73dfd984f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:58.547561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-827e2732-7e94-48fc-927a-66d73dfd984f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:58.935969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-041fda9c-974e-47ba-8bea-a267c043be0d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:58.948670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-041fda9c-974e-47ba-8bea-a267c043be0d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.844085 Aug 24 06:16:58.965888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 23/45] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:59.246862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-827e2732-7e94-48fc-927a-66d73dfd984f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:16:59.274951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-827e2732-7e94-48fc-927a-66d73dfd984f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.785897 Aug 24 06:16:59.280524 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 23/46] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:58 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:16:59.295985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6aeb377a-0429-4b44-9e5d-245f87f2a126 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:59.296547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-4e0648e6-4728-407b-9812-8c6c78236293 req-102278bc-1d77-45c5-87e5-a0d9fedb7651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5950cfdd-41b3-4842-81ab-e6507515a4a2", "tag": "fcdb5142-a706-43a9-9c46-6ef15b217519"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:59.297133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6aeb377a-0429-4b44-9e5d-245f87f2a126 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:59.305717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aeb377a-0429-4b44-9e5d-245f87f2a126 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:59.308688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aeb377a-0429-4b44-9e5d-245f87f2a126 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:59.309321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aeb377a-0429-4b44-9e5d-245f87f2a126 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:59.313778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aeb377a-0429-4b44-9e5d-245f87f2a126 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:59.314348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aeb377a-0429-4b44-9e5d-245f87f2a126 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:59.315427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aeb377a-0429-4b44-9e5d-245f87f2a126 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:59.328598 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-4e0648e6-4728-407b-9812-8c6c78236293 req-102278bc-1d77-45c5-87e5-a0d9fedb7651 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:59.329122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-4e0648e6-4728-407b-9812-8c6c78236293 req-102278bc-1d77-45c5-87e5-a0d9fedb7651 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:59.329512 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-4e0648e6-4728-407b-9812-8c6c78236293 req-102278bc-1d77-45c5-87e5-a0d9fedb7651 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:59.371180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-4e0648e6-4728-407b-9812-8c6c78236293 req-102278bc-1d77-45c5-87e5-a0d9fedb7651 service nova] Creating event network-changed:fcdb5142-a706-43a9-9c46-6ef15b217519 for instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 on hv-cinder-85426 Aug 24 06:16:59.371711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-4e0648e6-4728-407b-9812-8c6c78236293 req-102278bc-1d77-45c5-87e5-a0d9fedb7651 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121150) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 06:16:59.372100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-4e0648e6-4728-407b-9812-8c6c78236293 req-102278bc-1d77-45c5-87e5-a0d9fedb7651 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121150) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 06:16:59.381503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ba46c20-f3d4-4bb5-86d3-271d3b049abb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:59.381996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ba46c20-f3d4-4bb5-86d3-271d3b049abb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:59.382484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ba46c20-f3d4-4bb5-86d3-271d3b049abb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:59.383214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ba46c20-f3d4-4bb5-86d3-271d3b049abb None None] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:59.383668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ba46c20-f3d4-4bb5-86d3-271d3b049abb None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:59.384089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ba46c20-f3d4-4bb5-86d3-271d3b049abb None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:59.416985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.compute.rpcapi [None req-5ba46c20-f3d4-4bb5-86d3-271d3b049abb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 06:16:59.418346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ba46c20-f3d4-4bb5-86d3-271d3b049abb None None] Releasing lock "compute-rpcapi-router" {{(pid=121150) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 06:16:59.450250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5ba46c20-f3d4-4bb5-86d3-271d3b049abb None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.482791 Aug 24 06:16:59.451197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 24/47] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:16:59.795931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-fea09994-a570-47c3-99b5-592d362e7530 req-ae477833-0c4c-41d1-bba7-054a7da4ab10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33183e35-cf61-4cfa-b5d4-9a9306648a1a", "tag": "43fc490c-6786-4540-8f63-24f2545139fa"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:16:59.822886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-fea09994-a570-47c3-99b5-592d362e7530 req-ae477833-0c4c-41d1-bba7-054a7da4ab10 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:59.833285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-fea09994-a570-47c3-99b5-592d362e7530 req-ae477833-0c4c-41d1-bba7-054a7da4ab10 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:59.834803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-fea09994-a570-47c3-99b5-592d362e7530 req-ae477833-0c4c-41d1-bba7-054a7da4ab10 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:59.865617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-fea09994-a570-47c3-99b5-592d362e7530 req-ae477833-0c4c-41d1-bba7-054a7da4ab10 service nova] Creating event network-changed:43fc490c-6786-4540-8f63-24f2545139fa for instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a on hv-cinder-85426 Aug 24 06:16:59.880023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-fea09994-a570-47c3-99b5-592d362e7530 req-ae477833-0c4c-41d1-bba7-054a7da4ab10 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.427109 Aug 24 06:16:59.881153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 25/48] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:16:59.886477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:16:59.902111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:16:59.916099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:59.923682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:59.925303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:16:59.926162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:16:59.926743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:16:59.927272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:00.044112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6aeb377a-0429-4b44-9e5d-245f87f2a126 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:00.053500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6aeb377a-0429-4b44-9e5d-245f87f2a126 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.771581 Aug 24 06:17:00.067923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 24/49] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:16:59 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:00.074135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-174aa31c-f96f-4316-95cc-30dea8d42c2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:00.074908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-174aa31c-f96f-4316-95cc-30dea8d42c2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:00.081530 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-174aa31c-f96f-4316-95cc-30dea8d42c2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:00.082109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-174aa31c-f96f-4316-95cc-30dea8d42c2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:00.082614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-174aa31c-f96f-4316-95cc-30dea8d42c2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:00.083450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-174aa31c-f96f-4316-95cc-30dea8d42c2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:00.083979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-174aa31c-f96f-4316-95cc-30dea8d42c2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:00.084475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-174aa31c-f96f-4316-95cc-30dea8d42c2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:00.249541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:00.258637 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:00.260274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:00.261558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b5ef63c0-3ae8-4e29-af2b-111e8fd9217c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.379128 Aug 24 06:17:00.263283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 26/50] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:16:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:00.300352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-174aa31c-f96f-4316-95cc-30dea8d42c2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:00.307526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b941bc00-5dd8-4ae1-a19a-e5c406948e58 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:00.308327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b941bc00-5dd8-4ae1-a19a-e5c406948e58 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:00.308884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-174aa31c-f96f-4316-95cc-30dea8d42c2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.238501 Aug 24 06:17:00.309683 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 25/51] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:00.315836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b941bc00-5dd8-4ae1-a19a-e5c406948e58 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:00.316696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b941bc00-5dd8-4ae1-a19a-e5c406948e58 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:00.317576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b941bc00-5dd8-4ae1-a19a-e5c406948e58 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:00.318614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b941bc00-5dd8-4ae1-a19a-e5c406948e58 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:00.319262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b941bc00-5dd8-4ae1-a19a-e5c406948e58 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:00.320092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b941bc00-5dd8-4ae1-a19a-e5c406948e58 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:00.413410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=24 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:00.520780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b941bc00-5dd8-4ae1-a19a-e5c406948e58 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:00.528391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b941bc00-5dd8-4ae1-a19a-e5c406948e58 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.225401 Aug 24 06:17:00.529003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 27/52] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:00 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:01.075416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7e177d09-494e-49bc-bddb-0b85161b4216 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:01.076018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7e177d09-494e-49bc-bddb-0b85161b4216 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:01.081954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e177d09-494e-49bc-bddb-0b85161b4216 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:01.082424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e177d09-494e-49bc-bddb-0b85161b4216 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:01.083099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e177d09-494e-49bc-bddb-0b85161b4216 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:01.083513 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e177d09-494e-49bc-bddb-0b85161b4216 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:01.083972 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e177d09-494e-49bc-bddb-0b85161b4216 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:01.084390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e177d09-494e-49bc-bddb-0b85161b4216 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:01.233307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7e177d09-494e-49bc-bddb-0b85161b4216 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:01.239155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7e177d09-494e-49bc-bddb-0b85161b4216 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.168038 Aug 24 06:17:01.240026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 26/53] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:01 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:01.285382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:01.285994 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:01.292389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:01.295602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:01.295602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:01.295602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:01.295602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:01.296041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:01.330531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ebe49980-9b6c-4309-9a38-cbbaa9cb1edf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:01.331250 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ebe49980-9b6c-4309-9a38-cbbaa9cb1edf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:01.338443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ebe49980-9b6c-4309-9a38-cbbaa9cb1edf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:01.338932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ebe49980-9b6c-4309-9a38-cbbaa9cb1edf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:01.339370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ebe49980-9b6c-4309-9a38-cbbaa9cb1edf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:01.340073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ebe49980-9b6c-4309-9a38-cbbaa9cb1edf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:01.340538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ebe49980-9b6c-4309-9a38-cbbaa9cb1edf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:01.341386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ebe49980-9b6c-4309-9a38-cbbaa9cb1edf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:01.465501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:01.476085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:01.477625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:01.478724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-aa73fa14-9bd6-4180-b28e-b78bd635893b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.197761 Aug 24 06:17:01.479280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 28/54] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:01.517029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-ce6cd328-bfcd-4feb-afaa-b0d849635890 req-7a95d044-c8e2-4318-82aa-bd9dde4de3bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ff1952-1000-4510-ac80-d18576f044cb", "tag": "c4db42a9-a4c7-44d5-9663-2a6ea0296573"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:01.542314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-ce6cd328-bfcd-4feb-afaa-b0d849635890 req-7a95d044-c8e2-4318-82aa-bd9dde4de3bf service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:01.542314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-ce6cd328-bfcd-4feb-afaa-b0d849635890 req-7a95d044-c8e2-4318-82aa-bd9dde4de3bf service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:01.542314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-ce6cd328-bfcd-4feb-afaa-b0d849635890 req-7a95d044-c8e2-4318-82aa-bd9dde4de3bf service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:01.542793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ebe49980-9b6c-4309-9a38-cbbaa9cb1edf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:01.542902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-ce6cd328-bfcd-4feb-afaa-b0d849635890 req-7a95d044-c8e2-4318-82aa-bd9dde4de3bf service nova] Creating event network-changed:c4db42a9-a4c7-44d5-9663-2a6ea0296573 for instance 90ff1952-1000-4510-ac80-d18576f044cb on hv-cinder-85426 Aug 24 06:17:01.542995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ebe49980-9b6c-4309-9a38-cbbaa9cb1edf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.216002 Aug 24 06:17:01.544087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 27/55] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:01.545940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-ce6cd328-bfcd-4feb-afaa-b0d849635890 req-7a95d044-c8e2-4318-82aa-bd9dde4de3bf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032424 Aug 24 06:17:01.546874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 29/56] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:17:01.550941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6967b231-aa0f-4dc5-a080-3a8cce710ad9 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:01.551770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6967b231-aa0f-4dc5-a080-3a8cce710ad9 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:01.555160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:01.561736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6967b231-aa0f-4dc5-a080-3a8cce710ad9 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:01.562297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6967b231-aa0f-4dc5-a080-3a8cce710ad9 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:01.562827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6967b231-aa0f-4dc5-a080-3a8cce710ad9 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:01.563584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6967b231-aa0f-4dc5-a080-3a8cce710ad9 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:01.564119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6967b231-aa0f-4dc5-a080-3a8cce710ad9 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:01.564737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6967b231-aa0f-4dc5-a080-3a8cce710ad9 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:01.755543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6967b231-aa0f-4dc5-a080-3a8cce710ad9 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:01.758052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:01.763423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6967b231-aa0f-4dc5-a080-3a8cce710ad9 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.217049 Aug 24 06:17:01.772967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 28/57] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:01 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:01.905245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-90a49bf7-b4e7-4404-bcae-2a649fc3c61e req-45853807-e8a5-4719-8c82-9cf0562738e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9", "tag": "6fa5961a-6a56-4ea0-88f8-85ee1d70c184"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:01.914871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-90a49bf7-b4e7-4404-bcae-2a649fc3c61e req-45853807-e8a5-4719-8c82-9cf0562738e5 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:01.915562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-90a49bf7-b4e7-4404-bcae-2a649fc3c61e req-45853807-e8a5-4719-8c82-9cf0562738e5 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:01.915990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-90a49bf7-b4e7-4404-bcae-2a649fc3c61e req-45853807-e8a5-4719-8c82-9cf0562738e5 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:01.926834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-90a49bf7-b4e7-4404-bcae-2a649fc3c61e req-45853807-e8a5-4719-8c82-9cf0562738e5 service nova] Creating event network-changed:6fa5961a-6a56-4ea0-88f8-85ee1d70c184 for instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 on hv-cinder-85426 Aug 24 06:17:01.933280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-90a49bf7-b4e7-4404-bcae-2a649fc3c61e req-45853807-e8a5-4719-8c82-9cf0562738e5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032042 Aug 24 06:17:01.934328 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 30/58] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:02.263708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cb3577bc-7f41-4f3a-ae8a-7f82572ea1eb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:02.268735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cb3577bc-7f41-4f3a-ae8a-7f82572ea1eb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:02.268735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=26 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:02.271565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb3577bc-7f41-4f3a-ae8a-7f82572ea1eb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:02.272211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb3577bc-7f41-4f3a-ae8a-7f82572ea1eb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:02.272667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb3577bc-7f41-4f3a-ae8a-7f82572ea1eb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:02.273355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb3577bc-7f41-4f3a-ae8a-7f82572ea1eb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:02.273800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb3577bc-7f41-4f3a-ae8a-7f82572ea1eb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:02.274209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb3577bc-7f41-4f3a-ae8a-7f82572ea1eb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:02.428117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cb3577bc-7f41-4f3a-ae8a-7f82572ea1eb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:02.435833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cb3577bc-7f41-4f3a-ae8a-7f82572ea1eb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.178393 Aug 24 06:17:02.436386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 29/59] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:02 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:02.501417 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:02.502134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:02.505257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:02.508761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:02.509361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:02.509793 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:02.510476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:02.510920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:02.511337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:02.515210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:02.584407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6ab40192-80ca-4475-ad58-bd3a398c74e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:02.585058 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6ab40192-80ca-4475-ad58-bd3a398c74e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:02.599313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ab40192-80ca-4475-ad58-bd3a398c74e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:02.599813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ab40192-80ca-4475-ad58-bd3a398c74e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:02.605819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ab40192-80ca-4475-ad58-bd3a398c74e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:02.605819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ab40192-80ca-4475-ad58-bd3a398c74e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:02.605819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ab40192-80ca-4475-ad58-bd3a398c74e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:02.605819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ab40192-80ca-4475-ad58-bd3a398c74e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:02.774621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:02.791497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:02.793577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:02.797765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4f0ec326-dba0-4879-b59c-96f04c21398f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.297655 Aug 24 06:17:02.797765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 31/60] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:02.817962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-528bd481-6eac-48dc-a136-a2413f4e7bb6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:02.819590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-528bd481-6eac-48dc-a136-a2413f4e7bb6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:02.833708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-528bd481-6eac-48dc-a136-a2413f4e7bb6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:02.835808 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-528bd481-6eac-48dc-a136-a2413f4e7bb6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:02.836352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-528bd481-6eac-48dc-a136-a2413f4e7bb6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:02.839552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-528bd481-6eac-48dc-a136-a2413f4e7bb6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:02.839709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6ab40192-80ca-4475-ad58-bd3a398c74e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:02.840220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-528bd481-6eac-48dc-a136-a2413f4e7bb6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:02.844359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-528bd481-6eac-48dc-a136-a2413f4e7bb6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:02.848996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6ab40192-80ca-4475-ad58-bd3a398c74e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.286233 Aug 24 06:17:02.849586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 30/61] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:02 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:03.064243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-528bd481-6eac-48dc-a136-a2413f4e7bb6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:03.074206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-528bd481-6eac-48dc-a136-a2413f4e7bb6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.276925 Aug 24 06:17:03.075207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 32/62] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:02 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:03.461097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-01616bd8-122d-4192-9a8d-5e2182c88760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:03.461097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-01616bd8-122d-4192-9a8d-5e2182c88760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:03.473343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01616bd8-122d-4192-9a8d-5e2182c88760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:03.474150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01616bd8-122d-4192-9a8d-5e2182c88760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:03.481196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01616bd8-122d-4192-9a8d-5e2182c88760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:03.482250 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01616bd8-122d-4192-9a8d-5e2182c88760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:03.482933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01616bd8-122d-4192-9a8d-5e2182c88760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:03.483650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01616bd8-122d-4192-9a8d-5e2182c88760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:03.822873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:03.824109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:03.837568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:03.838253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:03.839903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:03.840638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:03.841093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:03.844645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:04.214025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-01616bd8-122d-4192-9a8d-5e2182c88760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:04.247500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-01616bd8-122d-4192-9a8d-5e2182c88760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.787107 Aug 24 06:17:04.263470 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 31/63] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:03 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:04.271253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d5492e1e-d400-44a2-b80f-d73e91363200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:04.272185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d5492e1e-d400-44a2-b80f-d73e91363200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:04.292657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5492e1e-d400-44a2-b80f-d73e91363200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:04.294767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5492e1e-d400-44a2-b80f-d73e91363200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:04.296459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5492e1e-d400-44a2-b80f-d73e91363200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:04.299498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5492e1e-d400-44a2-b80f-d73e91363200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:04.301651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5492e1e-d400-44a2-b80f-d73e91363200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:04.303580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5492e1e-d400-44a2-b80f-d73e91363200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:04.419841 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:04.457142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:04.468447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:04.468447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-20ce6329-a510-4e54-8628-96ec8ccef13c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.648818 Aug 24 06:17:04.469151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 33/64] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:17:04.493525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8aa2fc11-0992-4b63-8c43-27138cefeb05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:04.499868 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8aa2fc11-0992-4b63-8c43-27138cefeb05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:04.508952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa2fc11-0992-4b63-8c43-27138cefeb05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:04.510062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa2fc11-0992-4b63-8c43-27138cefeb05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:04.511572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa2fc11-0992-4b63-8c43-27138cefeb05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:04.512578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa2fc11-0992-4b63-8c43-27138cefeb05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:04.513322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa2fc11-0992-4b63-8c43-27138cefeb05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:04.518951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa2fc11-0992-4b63-8c43-27138cefeb05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:04.809097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d5492e1e-d400-44a2-b80f-d73e91363200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:04.821178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d5492e1e-d400-44a2-b80f-d73e91363200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.566118 Aug 24 06:17:04.822371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 32/65] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:05.000884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8aa2fc11-0992-4b63-8c43-27138cefeb05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:05.022358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8aa2fc11-0992-4b63-8c43-27138cefeb05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.550593 Aug 24 06:17:05.026459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 34/66] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:04 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:05.277007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-35e271f2-9a8d-47b6-be1e-09feb70bb242 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:05.277976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-35e271f2-9a8d-47b6-be1e-09feb70bb242 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:05.293833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35e271f2-9a8d-47b6-be1e-09feb70bb242 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:05.293833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35e271f2-9a8d-47b6-be1e-09feb70bb242 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:05.295169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35e271f2-9a8d-47b6-be1e-09feb70bb242 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:05.298239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35e271f2-9a8d-47b6-be1e-09feb70bb242 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:05.304202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35e271f2-9a8d-47b6-be1e-09feb70bb242 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:05.305614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35e271f2-9a8d-47b6-be1e-09feb70bb242 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:05.492033 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:05.492697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:05.509997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:05.509997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:05.509997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:05.509997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:05.510517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:05.510517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:05.935148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:05.951326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:05.952976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:05.957569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e0b9331b-ba6e-4de4-a704-174591a410f5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.467643 Aug 24 06:17:05.957569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 35/67] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:05.978561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-785e81df-c51d-4547-9924-52ebbec02416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:05.979206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-785e81df-c51d-4547-9924-52ebbec02416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:06.025347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-785e81df-c51d-4547-9924-52ebbec02416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:06.026146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-785e81df-c51d-4547-9924-52ebbec02416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:06.029791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-785e81df-c51d-4547-9924-52ebbec02416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:06.032423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-785e81df-c51d-4547-9924-52ebbec02416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:06.037279 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-785e81df-c51d-4547-9924-52ebbec02416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:06.038236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-785e81df-c51d-4547-9924-52ebbec02416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:06.135559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-35e271f2-9a8d-47b6-be1e-09feb70bb242 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:06.157996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-35e271f2-9a8d-47b6-be1e-09feb70bb242 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.884156 Aug 24 06:17:06.164322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 33/68] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:05 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:06.190161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f961a9f9-a942-48da-9dde-24edda0b778a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:06.193033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f961a9f9-a942-48da-9dde-24edda0b778a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:06.216953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f961a9f9-a942-48da-9dde-24edda0b778a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:06.218436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f961a9f9-a942-48da-9dde-24edda0b778a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:06.220068 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f961a9f9-a942-48da-9dde-24edda0b778a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:06.221194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f961a9f9-a942-48da-9dde-24edda0b778a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:06.223846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f961a9f9-a942-48da-9dde-24edda0b778a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:06.224483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f961a9f9-a942-48da-9dde-24edda0b778a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:06.398693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-785e81df-c51d-4547-9924-52ebbec02416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:06.415908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-785e81df-c51d-4547-9924-52ebbec02416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.450131 Aug 24 06:17:06.416518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 36/69] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:06.562477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f961a9f9-a942-48da-9dde-24edda0b778a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:06.575526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f961a9f9-a942-48da-9dde-24edda0b778a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.409021 Aug 24 06:17:06.577400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 34/70] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:06 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:06.980091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:06.980091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:06.986698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:06.987533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:06.988649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:06.989505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:06.990107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:06.990675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:07.170858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:07.186470 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e21dc64e-edef-476d-8b6b-4856e1f775d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:07.187716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e21dc64e-edef-476d-8b6b-4856e1f775d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:07.198059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e21dc64e-edef-476d-8b6b-4856e1f775d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:07.198657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:07.200840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e21dc64e-edef-476d-8b6b-4856e1f775d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:07.203183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:07.204327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7ca5a32f-7930-4d61-9e4e-3dc7e7531571 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.228724 Aug 24 06:17:07.221669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e21dc64e-edef-476d-8b6b-4856e1f775d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:07.224161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e21dc64e-edef-476d-8b6b-4856e1f775d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:07.224723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e21dc64e-edef-476d-8b6b-4856e1f775d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:07.225133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e21dc64e-edef-476d-8b6b-4856e1f775d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:07.228796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 37/71] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:07.432674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e21dc64e-edef-476d-8b6b-4856e1f775d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:07.438074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-de8fc6da-234f-4900-8c71-59421ba09d5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:07.441689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-de8fc6da-234f-4900-8c71-59421ba09d5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:07.452582 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de8fc6da-234f-4900-8c71-59421ba09d5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:07.453235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de8fc6da-234f-4900-8c71-59421ba09d5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:07.453840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de8fc6da-234f-4900-8c71-59421ba09d5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:07.457744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e21dc64e-edef-476d-8b6b-4856e1f775d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.275245 Aug 24 06:17:07.473282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de8fc6da-234f-4900-8c71-59421ba09d5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:07.477439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 35/72] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:07 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:07.478436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de8fc6da-234f-4900-8c71-59421ba09d5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:07.479105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de8fc6da-234f-4900-8c71-59421ba09d5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:07.598480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e04812f9-944d-4c58-bc9e-91d3b49cc679 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:07.599162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e04812f9-944d-4c58-bc9e-91d3b49cc679 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:07.608169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e04812f9-944d-4c58-bc9e-91d3b49cc679 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:07.609128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e04812f9-944d-4c58-bc9e-91d3b49cc679 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:07.609904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e04812f9-944d-4c58-bc9e-91d3b49cc679 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:07.611198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e04812f9-944d-4c58-bc9e-91d3b49cc679 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:07.612028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e04812f9-944d-4c58-bc9e-91d3b49cc679 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:07.612725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e04812f9-944d-4c58-bc9e-91d3b49cc679 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:07.755650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-de8fc6da-234f-4900-8c71-59421ba09d5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:07.763918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-de8fc6da-234f-4900-8c71-59421ba09d5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.329497 Aug 24 06:17:07.771219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 38/73] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:07.851617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e04812f9-944d-4c58-bc9e-91d3b49cc679 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:07.859471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e04812f9-944d-4c58-bc9e-91d3b49cc679 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.265692 Aug 24 06:17:07.860056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 36/74] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:07 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:08.229037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:08.229649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:08.236583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:08.238538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:08.239379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:08.241002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:08.241638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:08.242155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:08.398900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:08.407851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:08.409474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:08.411197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bfec60bd-2c54-4069-9fbd-05412cd2a9b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.186224 Aug 24 06:17:08.411853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 39/75] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:08.484942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-94ddb793-1c6f-41cf-bbda-4602a6181940 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:08.485545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-94ddb793-1c6f-41cf-bbda-4602a6181940 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:08.491455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ddb793-1c6f-41cf-bbda-4602a6181940 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:08.491936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ddb793-1c6f-41cf-bbda-4602a6181940 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:08.492369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ddb793-1c6f-41cf-bbda-4602a6181940 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:08.493090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ddb793-1c6f-41cf-bbda-4602a6181940 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:08.493536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ddb793-1c6f-41cf-bbda-4602a6181940 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:08.493955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ddb793-1c6f-41cf-bbda-4602a6181940 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:08.630610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-94ddb793-1c6f-41cf-bbda-4602a6181940 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:08.639029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-94ddb793-1c6f-41cf-bbda-4602a6181940 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.158091 Aug 24 06:17:08.639616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 37/76] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:08 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:08.796288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ceb1fef2-13ee-4f5c-a2e7-f7c2f75369f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:08.797249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ceb1fef2-13ee-4f5c-a2e7-f7c2f75369f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:08.804868 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ceb1fef2-13ee-4f5c-a2e7-f7c2f75369f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:08.807531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ceb1fef2-13ee-4f5c-a2e7-f7c2f75369f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:08.807531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ceb1fef2-13ee-4f5c-a2e7-f7c2f75369f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:08.807531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ceb1fef2-13ee-4f5c-a2e7-f7c2f75369f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:08.807531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ceb1fef2-13ee-4f5c-a2e7-f7c2f75369f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:08.807845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ceb1fef2-13ee-4f5c-a2e7-f7c2f75369f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:08.885264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9ad9f902-390d-4d80-8924-d905d5284629 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:08.886231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9ad9f902-390d-4d80-8924-d905d5284629 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:08.893777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad9f902-390d-4d80-8924-d905d5284629 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:08.895222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad9f902-390d-4d80-8924-d905d5284629 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:08.896337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad9f902-390d-4d80-8924-d905d5284629 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:08.897228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad9f902-390d-4d80-8924-d905d5284629 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:08.897822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad9f902-390d-4d80-8924-d905d5284629 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:08.901786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad9f902-390d-4d80-8924-d905d5284629 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:08.968953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ceb1fef2-13ee-4f5c-a2e7-f7c2f75369f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:08.979888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ceb1fef2-13ee-4f5c-a2e7-f7c2f75369f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.187878 Aug 24 06:17:08.980462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 40/77] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:09.057375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9ad9f902-390d-4d80-8924-d905d5284629 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:09.064963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9ad9f902-390d-4d80-8924-d905d5284629 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.183897 Aug 24 06:17:09.070542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 38/78] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:08 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:09.456463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:09.457283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:09.459433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=6 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:09.465747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:09.466420 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:09.467125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:09.468114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:09.468832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:09.469250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:09.656346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:09.658992 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7a0ef421-519f-4a2e-967b-07b516e49398 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:09.660160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7a0ef421-519f-4a2e-967b-07b516e49398 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:09.666608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0ef421-519f-4a2e-967b-07b516e49398 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:09.667263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0ef421-519f-4a2e-967b-07b516e49398 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:09.667860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0ef421-519f-4a2e-967b-07b516e49398 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:09.668765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0ef421-519f-4a2e-967b-07b516e49398 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:09.669356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0ef421-519f-4a2e-967b-07b516e49398 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:09.669918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0ef421-519f-4a2e-967b-07b516e49398 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:09.670572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:09.677359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:09.681114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4a6ca747-52ea-40be-a5a8-c498ab80d791 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.232553 Aug 24 06:17:09.692534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 41/79] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:09.845441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7a0ef421-519f-4a2e-967b-07b516e49398 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:09.854282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7a0ef421-519f-4a2e-967b-07b516e49398 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.198988 Aug 24 06:17:09.855326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 39/80] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:09 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:10.002541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e8a45f7b-d508-4ed1-910c-526788724bd8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:10.004095 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e8a45f7b-d508-4ed1-910c-526788724bd8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:10.010757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8a45f7b-d508-4ed1-910c-526788724bd8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:10.011245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8a45f7b-d508-4ed1-910c-526788724bd8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:10.011676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8a45f7b-d508-4ed1-910c-526788724bd8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:10.012371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8a45f7b-d508-4ed1-910c-526788724bd8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:10.012857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8a45f7b-d508-4ed1-910c-526788724bd8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:10.013272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8a45f7b-d508-4ed1-910c-526788724bd8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:10.089367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e7668c10-2bfb-468c-a764-ce726c7c8ff6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:10.090126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e7668c10-2bfb-468c-a764-ce726c7c8ff6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:10.097020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7668c10-2bfb-468c-a764-ce726c7c8ff6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:10.097845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7668c10-2bfb-468c-a764-ce726c7c8ff6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:10.098521 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7668c10-2bfb-468c-a764-ce726c7c8ff6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:10.099320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7668c10-2bfb-468c-a764-ce726c7c8ff6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:10.099976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7668c10-2bfb-468c-a764-ce726c7c8ff6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:10.100480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7668c10-2bfb-468c-a764-ce726c7c8ff6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:10.208998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e8a45f7b-d508-4ed1-910c-526788724bd8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:10.229206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e8a45f7b-d508-4ed1-910c-526788724bd8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.229115 Aug 24 06:17:10.230487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 42/81] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:09 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:10.345437 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e7668c10-2bfb-468c-a764-ce726c7c8ff6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:10.353065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e7668c10-2bfb-468c-a764-ce726c7c8ff6 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.267582 Aug 24 06:17:10.353636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 40/82] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:10 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:10.709996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:10.711386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:10.718842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:10.719334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:10.720022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:10.724522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:10.724522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:10.724522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:10.862587 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:10.871504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:10.873323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:10.874657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6d04effb-faee-4dd8-9e96-569af018da1e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.171161 Aug 24 06:17:10.875238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b4656ae7-1b04-473a-a158-b2ce93779534 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:10.875845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b4656ae7-1b04-473a-a158-b2ce93779534 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:10.876854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 43/83] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:10 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:10.885018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4656ae7-1b04-473a-a158-b2ce93779534 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:10.885903 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4656ae7-1b04-473a-a158-b2ce93779534 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:10.886543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4656ae7-1b04-473a-a158-b2ce93779534 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:10.887409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4656ae7-1b04-473a-a158-b2ce93779534 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:10.888018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4656ae7-1b04-473a-a158-b2ce93779534 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:10.888626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4656ae7-1b04-473a-a158-b2ce93779534 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:11.107948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b4656ae7-1b04-473a-a158-b2ce93779534 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:11.117015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b4656ae7-1b04-473a-a158-b2ce93779534 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.245628 Aug 24 06:17:11.117599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 41/84] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:10 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:11.248828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b6006a32-78a3-4e04-aae2-2f380e18d4b9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:11.249435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b6006a32-78a3-4e04-aae2-2f380e18d4b9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:11.255867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6006a32-78a3-4e04-aae2-2f380e18d4b9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:11.256652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6006a32-78a3-4e04-aae2-2f380e18d4b9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:11.257161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6006a32-78a3-4e04-aae2-2f380e18d4b9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:11.258032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6006a32-78a3-4e04-aae2-2f380e18d4b9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:11.258483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6006a32-78a3-4e04-aae2-2f380e18d4b9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:11.258899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6006a32-78a3-4e04-aae2-2f380e18d4b9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:11.376051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7faecf18-6d3b-4756-abfa-1b793616d4ef tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:11.379909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7faecf18-6d3b-4756-abfa-1b793616d4ef tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:11.387454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7faecf18-6d3b-4756-abfa-1b793616d4ef tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:11.387951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7faecf18-6d3b-4756-abfa-1b793616d4ef tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:11.388416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7faecf18-6d3b-4756-abfa-1b793616d4ef tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:11.389154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7faecf18-6d3b-4756-abfa-1b793616d4ef tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:11.389640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7faecf18-6d3b-4756-abfa-1b793616d4ef tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:11.390030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7faecf18-6d3b-4756-abfa-1b793616d4ef tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:11.407067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b6006a32-78a3-4e04-aae2-2f380e18d4b9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:11.416594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b6006a32-78a3-4e04-aae2-2f380e18d4b9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.171350 Aug 24 06:17:11.421879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 44/85] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:11.665966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7faecf18-6d3b-4756-abfa-1b793616d4ef tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:11.679482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7faecf18-6d3b-4756-abfa-1b793616d4ef tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.307213 Aug 24 06:17:11.681150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 42/86] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:11 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:11.898101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:11.898702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:11.904666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:11.905194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:11.905679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:11.906358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:11.906802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:11.907214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:12.074781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:12.092173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:12.092173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:12.092173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9304c438-9a2b-47fa-8794-135031056036 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.196081 Aug 24 06:17:12.100892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 45/87] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:12.142299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9930d630-92fa-4550-b6f6-81e58c67e1fc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:12.150546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9930d630-92fa-4550-b6f6-81e58c67e1fc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:12.159249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9930d630-92fa-4550-b6f6-81e58c67e1fc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:12.159967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9930d630-92fa-4550-b6f6-81e58c67e1fc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:12.160834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9930d630-92fa-4550-b6f6-81e58c67e1fc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:12.162350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9930d630-92fa-4550-b6f6-81e58c67e1fc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:12.163033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9930d630-92fa-4550-b6f6-81e58c67e1fc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:12.163816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9930d630-92fa-4550-b6f6-81e58c67e1fc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:12.328867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9930d630-92fa-4550-b6f6-81e58c67e1fc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:12.337680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9930d630-92fa-4550-b6f6-81e58c67e1fc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.199306 Aug 24 06:17:12.352013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 43/88] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:12 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:12.440016 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-00fddcb9-93e7-4c7a-922a-2c9d3a1ce745 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:12.440972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-00fddcb9-93e7-4c7a-922a-2c9d3a1ce745 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:12.451224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fddcb9-93e7-4c7a-922a-2c9d3a1ce745 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:12.452224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fddcb9-93e7-4c7a-922a-2c9d3a1ce745 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:12.458954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fddcb9-93e7-4c7a-922a-2c9d3a1ce745 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:12.459971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fddcb9-93e7-4c7a-922a-2c9d3a1ce745 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:12.460657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fddcb9-93e7-4c7a-922a-2c9d3a1ce745 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:12.461137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fddcb9-93e7-4c7a-922a-2c9d3a1ce745 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:12.716983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d972dcad-53f0-41ad-adc7-6f1fa3682169 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:12.717622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d972dcad-53f0-41ad-adc7-6f1fa3682169 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:12.730637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d972dcad-53f0-41ad-adc7-6f1fa3682169 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:12.731212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d972dcad-53f0-41ad-adc7-6f1fa3682169 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:12.731661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d972dcad-53f0-41ad-adc7-6f1fa3682169 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:12.737922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d972dcad-53f0-41ad-adc7-6f1fa3682169 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:12.738556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d972dcad-53f0-41ad-adc7-6f1fa3682169 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:12.738948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d972dcad-53f0-41ad-adc7-6f1fa3682169 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:12.744997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-00fddcb9-93e7-4c7a-922a-2c9d3a1ce745 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:12.763186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-00fddcb9-93e7-4c7a-922a-2c9d3a1ce745 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.327359 Aug 24 06:17:12.769944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 46/89] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:13.031055 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d972dcad-53f0-41ad-adc7-6f1fa3682169 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:13.040198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d972dcad-53f0-41ad-adc7-6f1fa3682169 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.337723 Aug 24 06:17:13.042860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 44/90] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:12 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:13.115130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:13.116155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:13.128689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:13.129213 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:13.129656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:13.130369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:13.130825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:13.131252 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:13.358828 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a861eb81-44f1-496a-95b4-995278604890 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:13.359443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a861eb81-44f1-496a-95b4-995278604890 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:13.373171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a861eb81-44f1-496a-95b4-995278604890 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:13.374141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a861eb81-44f1-496a-95b4-995278604890 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:13.374829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a861eb81-44f1-496a-95b4-995278604890 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:13.375917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a861eb81-44f1-496a-95b4-995278604890 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:13.377081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a861eb81-44f1-496a-95b4-995278604890 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:13.378433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a861eb81-44f1-496a-95b4-995278604890 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:13.386603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:13.391252 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:13.402127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:13.403734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:13.405156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ef2d33dc-2465-45ae-942a-17cf56b7f4fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.295298 Aug 24 06:17:13.415312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 47/91] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:13 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:13.432966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:13.670366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a861eb81-44f1-496a-95b4-995278604890 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:13.683859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a861eb81-44f1-496a-95b4-995278604890 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.329033 Aug 24 06:17:13.684454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 45/92] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:13 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:13.790377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-81ccd093-360b-4662-b000-6f423227f544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:13.791539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-81ccd093-360b-4662-b000-6f423227f544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:13.800232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-81ccd093-360b-4662-b000-6f423227f544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:13.801028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-81ccd093-360b-4662-b000-6f423227f544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:13.802628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-81ccd093-360b-4662-b000-6f423227f544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:13.803722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-81ccd093-360b-4662-b000-6f423227f544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:13.804440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-81ccd093-360b-4662-b000-6f423227f544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:13.804985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-81ccd093-360b-4662-b000-6f423227f544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:14.067285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0eab638f-2f54-4401-a1f8-d3ebdfb3bc88 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:14.068169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0eab638f-2f54-4401-a1f8-d3ebdfb3bc88 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:14.075022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0eab638f-2f54-4401-a1f8-d3ebdfb3bc88 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:14.075692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0eab638f-2f54-4401-a1f8-d3ebdfb3bc88 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:14.076333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0eab638f-2f54-4401-a1f8-d3ebdfb3bc88 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:14.077729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0eab638f-2f54-4401-a1f8-d3ebdfb3bc88 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:14.078320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0eab638f-2f54-4401-a1f8-d3ebdfb3bc88 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:14.078885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0eab638f-2f54-4401-a1f8-d3ebdfb3bc88 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:14.099145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-81ccd093-360b-4662-b000-6f423227f544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:14.111139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-81ccd093-360b-4662-b000-6f423227f544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.325866 Aug 24 06:17:14.115070 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 48/93] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:14.241283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0eab638f-2f54-4401-a1f8-d3ebdfb3bc88 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:14.250079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0eab638f-2f54-4401-a1f8-d3ebdfb3bc88 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.187156 Aug 24 06:17:14.250752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 46/94] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:14 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:14.437826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:14.438650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:14.446521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:14.447005 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:14.447433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:14.448122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:14.448634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:14.449046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:14.716633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:14.726716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8bbde7f2-b904-4a46-b045-50b74129be60 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:14.727943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8bbde7f2-b904-4a46-b045-50b74129be60 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:14.736979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bbde7f2-b904-4a46-b045-50b74129be60 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:14.737649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bbde7f2-b904-4a46-b045-50b74129be60 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:14.738305 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bbde7f2-b904-4a46-b045-50b74129be60 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:14.739872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bbde7f2-b904-4a46-b045-50b74129be60 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:14.740530 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bbde7f2-b904-4a46-b045-50b74129be60 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:14.741125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bbde7f2-b904-4a46-b045-50b74129be60 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:14.741437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:14.743605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:14.745184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6fa4ae2f-c867-4956-9ca9-f8bc574a5979 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.311505 Aug 24 06:17:14.746148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 49/95] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:14.976577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8bbde7f2-b904-4a46-b045-50b74129be60 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:14.985842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8bbde7f2-b904-4a46-b045-50b74129be60 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.278102 Aug 24 06:17:14.987974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 47/96] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:14 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:15.138405 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-40805462-e43d-48e6-9b7b-06393c4a04ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:15.139270 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-40805462-e43d-48e6-9b7b-06393c4a04ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:15.154600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40805462-e43d-48e6-9b7b-06393c4a04ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:15.159437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40805462-e43d-48e6-9b7b-06393c4a04ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:15.161735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40805462-e43d-48e6-9b7b-06393c4a04ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:15.161735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40805462-e43d-48e6-9b7b-06393c4a04ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:15.161946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40805462-e43d-48e6-9b7b-06393c4a04ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:15.162231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40805462-e43d-48e6-9b7b-06393c4a04ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:15.273008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-847429d8-79bc-474f-831d-7b0276b2d3d1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:15.274390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-847429d8-79bc-474f-831d-7b0276b2d3d1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:15.289353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-847429d8-79bc-474f-831d-7b0276b2d3d1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:15.290067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-847429d8-79bc-474f-831d-7b0276b2d3d1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:15.290706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-847429d8-79bc-474f-831d-7b0276b2d3d1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:15.291706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-847429d8-79bc-474f-831d-7b0276b2d3d1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:15.298500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-847429d8-79bc-474f-831d-7b0276b2d3d1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:15.299405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-847429d8-79bc-474f-831d-7b0276b2d3d1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:15.513381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-847429d8-79bc-474f-831d-7b0276b2d3d1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:15.522229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-847429d8-79bc-474f-831d-7b0276b2d3d1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.253246 Aug 24 06:17:15.525547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 48/97] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:15 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:15.620472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-40805462-e43d-48e6-9b7b-06393c4a04ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:15.632252 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-40805462-e43d-48e6-9b7b-06393c4a04ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.500866 Aug 24 06:17:15.633476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 50/98] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:15 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:15.767476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:15.768118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:15.781483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:15.783003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:15.783459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:15.784735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:15.789468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:15.789952 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:16.010462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-42cdb665-2d3b-42a7-a377-15109c1318d9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:16.011229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-42cdb665-2d3b-42a7-a377-15109c1318d9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:16.020064 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42cdb665-2d3b-42a7-a377-15109c1318d9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:16.026504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42cdb665-2d3b-42a7-a377-15109c1318d9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:16.027420 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42cdb665-2d3b-42a7-a377-15109c1318d9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:16.029378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42cdb665-2d3b-42a7-a377-15109c1318d9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:16.030100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42cdb665-2d3b-42a7-a377-15109c1318d9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:16.030706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42cdb665-2d3b-42a7-a377-15109c1318d9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:16.094236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:16.109959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:16.112850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:16.115438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f8f30fb6-b7ee-4ccf-8634-d6c04d5d7c00 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.351753 Aug 24 06:17:16.116881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 49/99] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:16.195238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-393d413b-9699-4323-8a99-66327a6cad4a req-ce59fa4f-fdad-455e-a958-b1e086007939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5950cfdd-41b3-4842-81ab-e6507515a4a2", "name": "network-vif-plugged", "status": "completed", "tag": "fcdb5142-a706-43a9-9c46-6ef15b217519"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:16.212391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-393d413b-9699-4323-8a99-66327a6cad4a req-ce59fa4f-fdad-455e-a958-b1e086007939 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:16.213149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-393d413b-9699-4323-8a99-66327a6cad4a req-ce59fa4f-fdad-455e-a958-b1e086007939 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:16.213790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-393d413b-9699-4323-8a99-66327a6cad4a req-ce59fa4f-fdad-455e-a958-b1e086007939 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:16.238038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-393d413b-9699-4323-8a99-66327a6cad4a req-ce59fa4f-fdad-455e-a958-b1e086007939 service nova] Creating event network-vif-plugged:fcdb5142-a706-43a9-9c46-6ef15b217519 for instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 on hv-cinder-85426 Aug 24 06:17:16.238703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-393d413b-9699-4323-8a99-66327a6cad4a req-ce59fa4f-fdad-455e-a958-b1e086007939 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 06:17:16.239141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-393d413b-9699-4323-8a99-66327a6cad4a req-ce59fa4f-fdad-455e-a958-b1e086007939 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 06:17:16.240427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-069516e0-7090-4ade-b645-3de503dbc5d1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:16.241165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-069516e0-7090-4ade-b645-3de503dbc5d1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:16.241593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-069516e0-7090-4ade-b645-3de503dbc5d1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:16.242362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-069516e0-7090-4ade-b645-3de503dbc5d1 None None] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:16.243026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-069516e0-7090-4ade-b645-3de503dbc5d1 None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:16.243581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-069516e0-7090-4ade-b645-3de503dbc5d1 None None] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:16.253635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.compute.rpcapi [None req-069516e0-7090-4ade-b645-3de503dbc5d1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 06:17:16.254736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-069516e0-7090-4ade-b645-3de503dbc5d1 None None] Releasing lock "compute-rpcapi-router" {{(pid=121151) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 06:17:16.277591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-069516e0-7090-4ade-b645-3de503dbc5d1 None None] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158782 Aug 24 06:17:16.279107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 50/100] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:16.281708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-42cdb665-2d3b-42a7-a377-15109c1318d9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:16.307025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-42cdb665-2d3b-42a7-a377-15109c1318d9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.300005 Aug 24 06:17:16.328125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 51/101] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:16 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:16.546363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5f26cfe5-f71f-444b-aecf-22affb93861a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:16.547071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5f26cfe5-f71f-444b-aecf-22affb93861a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:16.603714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f26cfe5-f71f-444b-aecf-22affb93861a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:16.610554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f26cfe5-f71f-444b-aecf-22affb93861a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:16.623540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f26cfe5-f71f-444b-aecf-22affb93861a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:16.624351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f26cfe5-f71f-444b-aecf-22affb93861a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:16.624861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f26cfe5-f71f-444b-aecf-22affb93861a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:16.632209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f26cfe5-f71f-444b-aecf-22affb93861a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:16.653512 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7b6fbff1-e92d-47b0-a5f2-396839abee72 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:16.654265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7b6fbff1-e92d-47b0-a5f2-396839abee72 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:16.671806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b6fbff1-e92d-47b0-a5f2-396839abee72 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:16.671806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b6fbff1-e92d-47b0-a5f2-396839abee72 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:16.671986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b6fbff1-e92d-47b0-a5f2-396839abee72 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:16.678305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b6fbff1-e92d-47b0-a5f2-396839abee72 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:16.678812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b6fbff1-e92d-47b0-a5f2-396839abee72 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:16.679294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b6fbff1-e92d-47b0-a5f2-396839abee72 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:17.132601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7b6fbff1-e92d-47b0-a5f2-396839abee72 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:17.141449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5f26cfe5-f71f-444b-aecf-22affb93861a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:17.143968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7b6fbff1-e92d-47b0-a5f2-396839abee72 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.494623 Aug 24 06:17:17.144597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 52/102] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:17.166073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5f26cfe5-f71f-444b-aecf-22affb93861a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.621328 Aug 24 06:17:17.175726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 51/103] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:16 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:17.179077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:17.179703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:17.190427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:17.192327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:17.192327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:17.192327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:17.201901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:17.213398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:17.338192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4a3877a5-fca4-4fbe-b0f1-c7d1a30f6327 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:17.339459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4a3877a5-fca4-4fbe-b0f1-c7d1a30f6327 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:17.350974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a3877a5-fca4-4fbe-b0f1-c7d1a30f6327 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:17.355460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a3877a5-fca4-4fbe-b0f1-c7d1a30f6327 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:17.355460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a3877a5-fca4-4fbe-b0f1-c7d1a30f6327 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:17.356560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a3877a5-fca4-4fbe-b0f1-c7d1a30f6327 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:17.357232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a3877a5-fca4-4fbe-b0f1-c7d1a30f6327 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:17.359995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a3877a5-fca4-4fbe-b0f1-c7d1a30f6327 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:17.501688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:17.511402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:17.513233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:17.516248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-082c8112-0a0f-4bc9-87ac-04e331d83091 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.352953 Aug 24 06:17:17.517196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 53/104] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:17.630331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4a3877a5-fca4-4fbe-b0f1-c7d1a30f6327 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:17.648724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4a3877a5-fca4-4fbe-b0f1-c7d1a30f6327 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.314781 Aug 24 06:17:17.649920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 52/105] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:17 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:18.167305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-142bb57f-21cf-487a-a721-0226ebe62c19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:18.168099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-142bb57f-21cf-487a-a721-0226ebe62c19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:18.175579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-142bb57f-21cf-487a-a721-0226ebe62c19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:18.176439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-142bb57f-21cf-487a-a721-0226ebe62c19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:18.177176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-142bb57f-21cf-487a-a721-0226ebe62c19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:18.177982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-142bb57f-21cf-487a-a721-0226ebe62c19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:18.178630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-142bb57f-21cf-487a-a721-0226ebe62c19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:18.179117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-142bb57f-21cf-487a-a721-0226ebe62c19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:18.192906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-28818ab0-a655-4e50-a288-0d901c78aea8 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:18.194456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-28818ab0-a655-4e50-a288-0d901c78aea8 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:18.203255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28818ab0-a655-4e50-a288-0d901c78aea8 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:18.203738 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28818ab0-a655-4e50-a288-0d901c78aea8 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:18.204220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28818ab0-a655-4e50-a288-0d901c78aea8 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:18.205052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28818ab0-a655-4e50-a288-0d901c78aea8 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:18.205500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28818ab0-a655-4e50-a288-0d901c78aea8 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:18.206464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28818ab0-a655-4e50-a288-0d901c78aea8 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:18.361689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-142bb57f-21cf-487a-a721-0226ebe62c19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:18.367995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-28818ab0-a655-4e50-a288-0d901c78aea8 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:18.370795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-142bb57f-21cf-487a-a721-0226ebe62c19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.207318 Aug 24 06:17:18.373062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 54/106] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:18.378692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-28818ab0-a655-4e50-a288-0d901c78aea8 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.190292 Aug 24 06:17:18.382707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 53/107] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:18 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:18.390607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-90793e14-6329-404a-8ce2-4df69fb3c3c7 req-565a29b9-49a3-4d1f-9511-48280ea0e9ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33183e35-cf61-4cfa-b5d4-9a9306648a1a", "name": "network-vif-plugged", "status": "completed", "tag": "43fc490c-6786-4540-8f63-24f2545139fa"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:18.402137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-90793e14-6329-404a-8ce2-4df69fb3c3c7 req-565a29b9-49a3-4d1f-9511-48280ea0e9ba service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:18.402794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-90793e14-6329-404a-8ce2-4df69fb3c3c7 req-565a29b9-49a3-4d1f-9511-48280ea0e9ba service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:18.403282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-90793e14-6329-404a-8ce2-4df69fb3c3c7 req-565a29b9-49a3-4d1f-9511-48280ea0e9ba service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:18.414990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-90793e14-6329-404a-8ce2-4df69fb3c3c7 req-565a29b9-49a3-4d1f-9511-48280ea0e9ba service nova] Creating event network-vif-plugged:43fc490c-6786-4540-8f63-24f2545139fa for instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a on hv-cinder-85426 Aug 24 06:17:18.421234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-90793e14-6329-404a-8ce2-4df69fb3c3c7 req-565a29b9-49a3-4d1f-9511-48280ea0e9ba service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045700 Aug 24 06:17:18.421234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 55/108] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:18.541183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:18.542009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:18.549320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:18.550101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:18.550527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:18.551236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:18.551687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:18.552108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:18.672595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7981e6dd-bf58-4e01-89c8-e0b7feab5c6f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:18.673344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7981e6dd-bf58-4e01-89c8-e0b7feab5c6f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:18.684772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7981e6dd-bf58-4e01-89c8-e0b7feab5c6f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:18.685262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7981e6dd-bf58-4e01-89c8-e0b7feab5c6f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:18.685701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7981e6dd-bf58-4e01-89c8-e0b7feab5c6f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:18.686413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7981e6dd-bf58-4e01-89c8-e0b7feab5c6f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:18.691021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7981e6dd-bf58-4e01-89c8-e0b7feab5c6f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:18.691532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7981e6dd-bf58-4e01-89c8-e0b7feab5c6f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:18.735077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:18.746904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:18.750493 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:18.758651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d27ac477-da5e-4225-9f22-cc726f624db4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.222577 Aug 24 06:17:18.763463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 54/109] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:17:18.878465 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7981e6dd-bf58-4e01-89c8-e0b7feab5c6f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:18.886035 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7981e6dd-bf58-4e01-89c8-e0b7feab5c6f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.219591 Aug 24 06:17:18.886610 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 56/110] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:18 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:19.397129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-210e9e85-3520-42de-92f5-61dc2e6ad424 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:19.397733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-210e9e85-3520-42de-92f5-61dc2e6ad424 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:19.399489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ddab715b-b91d-4866-99e2-d52743f141d7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:19.400352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ddab715b-b91d-4866-99e2-d52743f141d7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:19.404315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210e9e85-3520-42de-92f5-61dc2e6ad424 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:19.404895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210e9e85-3520-42de-92f5-61dc2e6ad424 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:19.405387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210e9e85-3520-42de-92f5-61dc2e6ad424 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:19.406147 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210e9e85-3520-42de-92f5-61dc2e6ad424 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:19.406388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddab715b-b91d-4866-99e2-d52743f141d7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:19.406728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210e9e85-3520-42de-92f5-61dc2e6ad424 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:19.406893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddab715b-b91d-4866-99e2-d52743f141d7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:19.407253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210e9e85-3520-42de-92f5-61dc2e6ad424 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:19.407366 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddab715b-b91d-4866-99e2-d52743f141d7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:19.407990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddab715b-b91d-4866-99e2-d52743f141d7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:19.408442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddab715b-b91d-4866-99e2-d52743f141d7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:19.408903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddab715b-b91d-4866-99e2-d52743f141d7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:19.597754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-210e9e85-3520-42de-92f5-61dc2e6ad424 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:19.598716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ddab715b-b91d-4866-99e2-d52743f141d7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:19.608061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-210e9e85-3520-42de-92f5-61dc2e6ad424 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.215670 Aug 24 06:17:19.609462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 55/111] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:19.610679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ddab715b-b91d-4866-99e2-d52743f141d7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.214875 Aug 24 06:17:19.620941 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 57/112] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:19 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:19.791178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:19.791178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:19.796668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:19.797351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:19.798109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:19.804511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:19.805168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:19.805950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:19.910010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cb466dff-f795-4157-9995-bf58f0f2463f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:19.910900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cb466dff-f795-4157-9995-bf58f0f2463f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:19.918366 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb466dff-f795-4157-9995-bf58f0f2463f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:19.919253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb466dff-f795-4157-9995-bf58f0f2463f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:19.920386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb466dff-f795-4157-9995-bf58f0f2463f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:19.921374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb466dff-f795-4157-9995-bf58f0f2463f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:19.922026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb466dff-f795-4157-9995-bf58f0f2463f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:19.922670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb466dff-f795-4157-9995-bf58f0f2463f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:19.997237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:20.006360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:20.007875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:20.013122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-809130f0-f429-4423-81aa-1e9411a20dd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.234979 Aug 24 06:17:20.036285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 56/113] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:20.150597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cb466dff-f795-4157-9995-bf58f0f2463f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:20.165030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cb466dff-f795-4157-9995-bf58f0f2463f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.259970 Aug 24 06:17:20.165666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 58/114] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:19 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:20.634598 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3b006586-886f-4c61-a0f3-384842843c81 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:20.636098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9366093a-2323-4d1d-925f-89d7beba5362 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:20.637257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3b006586-886f-4c61-a0f3-384842843c81 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:20.638102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9366093a-2323-4d1d-925f-89d7beba5362 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:20.650686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b006586-886f-4c61-a0f3-384842843c81 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:20.652279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9366093a-2323-4d1d-925f-89d7beba5362 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:20.653012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b006586-886f-4c61-a0f3-384842843c81 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:20.653653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b006586-886f-4c61-a0f3-384842843c81 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:20.654356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9366093a-2323-4d1d-925f-89d7beba5362 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:20.655274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b006586-886f-4c61-a0f3-384842843c81 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:20.655928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9366093a-2323-4d1d-925f-89d7beba5362 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:20.657541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9366093a-2323-4d1d-925f-89d7beba5362 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:20.658116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b006586-886f-4c61-a0f3-384842843c81 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:20.659349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b006586-886f-4c61-a0f3-384842843c81 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:20.660098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9366093a-2323-4d1d-925f-89d7beba5362 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:20.660749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9366093a-2323-4d1d-925f-89d7beba5362 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:20.840694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3b006586-886f-4c61-a0f3-384842843c81 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:20.852541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3b006586-886f-4c61-a0f3-384842843c81 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.222907 Aug 24 06:17:20.854091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 59/115] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:20 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:20.891937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9366093a-2323-4d1d-925f-89d7beba5362 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:20.937061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9366093a-2323-4d1d-925f-89d7beba5362 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.311351 Aug 24 06:17:20.946885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 57/116] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:21.037810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:21.038551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:21.047886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:21.048431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:21.048909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:21.050296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:21.050753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:21.051174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:21.131458 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-0ef76ba5-1935-4c3c-9d48-d1821886056e req-0833d825-9f83-4d70-ba6e-c1db3f316be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ff1952-1000-4510-ac80-d18576f044cb", "name": "network-vif-plugged", "status": "completed", "tag": "c4db42a9-a4c7-44d5-9663-2a6ea0296573"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:21.172256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-0ef76ba5-1935-4c3c-9d48-d1821886056e req-0833d825-9f83-4d70-ba6e-c1db3f316be8 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:21.173138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-0ef76ba5-1935-4c3c-9d48-d1821886056e req-0833d825-9f83-4d70-ba6e-c1db3f316be8 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:21.174477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-0ef76ba5-1935-4c3c-9d48-d1821886056e req-0833d825-9f83-4d70-ba6e-c1db3f316be8 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:21.207042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-0ef76ba5-1935-4c3c-9d48-d1821886056e req-0833d825-9f83-4d70-ba6e-c1db3f316be8 service nova] Creating event network-vif-plugged:c4db42a9-a4c7-44d5-9663-2a6ea0296573 for instance 90ff1952-1000-4510-ac80-d18576f044cb on hv-cinder-85426 Aug 24 06:17:21.224919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-0ef76ba5-1935-4c3c-9d48-d1821886056e req-0833d825-9f83-4d70-ba6e-c1db3f316be8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100168 Aug 24 06:17:21.227567 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 58/117] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:21.245235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-71f35f33-85c0-4ed4-9714-140ab2454760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:21.249470 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-71f35f33-85c0-4ed4-9714-140ab2454760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:21.262628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71f35f33-85c0-4ed4-9714-140ab2454760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:21.263438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71f35f33-85c0-4ed4-9714-140ab2454760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:21.264004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71f35f33-85c0-4ed4-9714-140ab2454760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:21.265168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71f35f33-85c0-4ed4-9714-140ab2454760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:21.265903 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71f35f33-85c0-4ed4-9714-140ab2454760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:21.267614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71f35f33-85c0-4ed4-9714-140ab2454760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:21.311666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:21.344748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:21.348246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:21.353014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fd3bbed0-e0b0-4984-a4ba-e2249beb167a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.319220 Aug 24 06:17:21.354055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 60/118] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:21.568271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-71f35f33-85c0-4ed4-9714-140ab2454760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:21.576604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-71f35f33-85c0-4ed4-9714-140ab2454760 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.347309 Aug 24 06:17:21.578693 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 59/119] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:21 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:21.881091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b44a18c9-1fb1-4132-8c85-a2a14fdc44de tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:21.886820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b44a18c9-1fb1-4132-8c85-a2a14fdc44de tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:21.902575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b44a18c9-1fb1-4132-8c85-a2a14fdc44de tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:21.902575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b44a18c9-1fb1-4132-8c85-a2a14fdc44de tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:21.902916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b44a18c9-1fb1-4132-8c85-a2a14fdc44de tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:21.909435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b44a18c9-1fb1-4132-8c85-a2a14fdc44de tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:21.909915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b44a18c9-1fb1-4132-8c85-a2a14fdc44de tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:21.914293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b44a18c9-1fb1-4132-8c85-a2a14fdc44de tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:21.968031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b3b79530-d906-45bb-af8b-73b0d077dae1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:21.968632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b3b79530-d906-45bb-af8b-73b0d077dae1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:21.978548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3b79530-d906-45bb-af8b-73b0d077dae1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:21.979045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3b79530-d906-45bb-af8b-73b0d077dae1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:21.979477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3b79530-d906-45bb-af8b-73b0d077dae1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:21.980187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3b79530-d906-45bb-af8b-73b0d077dae1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:21.980657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3b79530-d906-45bb-af8b-73b0d077dae1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:21.981277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3b79530-d906-45bb-af8b-73b0d077dae1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:22.140058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b44a18c9-1fb1-4132-8c85-a2a14fdc44de tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:22.148971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b44a18c9-1fb1-4132-8c85-a2a14fdc44de tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.279087 Aug 24 06:17:22.149557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 61/120] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:21 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:22.364545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b3b79530-d906-45bb-af8b-73b0d077dae1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:22.372917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b3b79530-d906-45bb-af8b-73b0d077dae1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.409324 Aug 24 06:17:22.376973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 60/121] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:21 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:22.387070 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:22.387070 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:22.395627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:22.396349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:22.397865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:22.399101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:22.400899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:22.403186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:22.596289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:22.605978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9ad20758-5fd2-4794-835b-61da130c97e8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:22.606239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9ad20758-5fd2-4794-835b-61da130c97e8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:22.610805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:22.612345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:22.614760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad20758-5fd2-4794-835b-61da130c97e8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:22.615044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c85017da-0a0a-46e2-b7b8-9c743b47c80d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.241318 Aug 24 06:17:22.615236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad20758-5fd2-4794-835b-61da130c97e8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:22.615606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 62/122] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:22 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:17:22.616122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad20758-5fd2-4794-835b-61da130c97e8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:22.617019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad20758-5fd2-4794-835b-61da130c97e8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:22.618344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad20758-5fd2-4794-835b-61da130c97e8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:22.619054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ad20758-5fd2-4794-835b-61da130c97e8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:22.863185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9ad20758-5fd2-4794-835b-61da130c97e8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:22.871159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9ad20758-5fd2-4794-835b-61da130c97e8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.276949 Aug 24 06:17:22.884719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 61/123] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:22 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:23.171406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-055cffec-0f01-45d5-8a90-2e8982c9216f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:23.172110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-055cffec-0f01-45d5-8a90-2e8982c9216f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:23.186251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-055cffec-0f01-45d5-8a90-2e8982c9216f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:23.194436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-055cffec-0f01-45d5-8a90-2e8982c9216f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:23.194436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-055cffec-0f01-45d5-8a90-2e8982c9216f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:23.194436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-055cffec-0f01-45d5-8a90-2e8982c9216f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:23.194436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-055cffec-0f01-45d5-8a90-2e8982c9216f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:23.195111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-055cffec-0f01-45d5-8a90-2e8982c9216f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:23.257095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-51686e14-508c-4558-8009-6d6d53e30be5 req-36a64d85-76e0-4e03-b493-5212894c9b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9", "name": "network-vif-plugged", "status": "completed", "tag": "6fa5961a-6a56-4ea0-88f8-85ee1d70c184"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:23.275491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-51686e14-508c-4558-8009-6d6d53e30be5 req-36a64d85-76e0-4e03-b493-5212894c9b05 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:23.276330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-51686e14-508c-4558-8009-6d6d53e30be5 req-36a64d85-76e0-4e03-b493-5212894c9b05 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:23.277244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-51686e14-508c-4558-8009-6d6d53e30be5 req-36a64d85-76e0-4e03-b493-5212894c9b05 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:23.299133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-51686e14-508c-4558-8009-6d6d53e30be5 req-36a64d85-76e0-4e03-b493-5212894c9b05 service nova] Creating event network-vif-plugged:6fa5961a-6a56-4ea0-88f8-85ee1d70c184 for instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 on hv-cinder-85426 Aug 24 06:17:23.310612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-51686e14-508c-4558-8009-6d6d53e30be5 req-36a64d85-76e0-4e03-b493-5212894c9b05 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059262 Aug 24 06:17:23.311526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 62/124] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:23.395602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-510ae5b7-6946-4305-905a-bda89023e7cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:23.396413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-510ae5b7-6946-4305-905a-bda89023e7cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:23.401587 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-055cffec-0f01-45d5-8a90-2e8982c9216f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:23.407110 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510ae5b7-6946-4305-905a-bda89023e7cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:23.410999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510ae5b7-6946-4305-905a-bda89023e7cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:23.412044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510ae5b7-6946-4305-905a-bda89023e7cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:23.415268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510ae5b7-6946-4305-905a-bda89023e7cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:23.415868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510ae5b7-6946-4305-905a-bda89023e7cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:23.416784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-055cffec-0f01-45d5-8a90-2e8982c9216f tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.249475 Aug 24 06:17:23.417571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 63/125] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:23 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:23.425317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510ae5b7-6946-4305-905a-bda89023e7cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:23.639619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:23.640235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:23.647102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:23.647596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:23.648225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:23.649110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:23.649716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:23.650289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:23.664348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-510ae5b7-6946-4305-905a-bda89023e7cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:23.670274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:23.689060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-510ae5b7-6946-4305-905a-bda89023e7cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.298145 Aug 24 06:17:23.697357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 63/126] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:23 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:23.834388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:23.843334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:23.850618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:23.851935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a0160408-d54f-4952-ab7e-7a1948ff7551 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.216564 Aug 24 06:17:23.858138 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 64/127] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:17:23.893092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0b9e8473-b6ea-4521-be0e-ce2a8e97d3b5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:23.895777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0b9e8473-b6ea-4521-be0e-ce2a8e97d3b5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:23.911291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b9e8473-b6ea-4521-be0e-ce2a8e97d3b5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:23.916978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b9e8473-b6ea-4521-be0e-ce2a8e97d3b5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:23.916978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b9e8473-b6ea-4521-be0e-ce2a8e97d3b5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:23.916978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b9e8473-b6ea-4521-be0e-ce2a8e97d3b5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:23.916978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b9e8473-b6ea-4521-be0e-ce2a8e97d3b5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:23.917393 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b9e8473-b6ea-4521-be0e-ce2a8e97d3b5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:24.180559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0b9e8473-b6ea-4521-be0e-ce2a8e97d3b5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:24.188218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0b9e8473-b6ea-4521-be0e-ce2a8e97d3b5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1361 microversion: 2.1 time: 0.299452 Aug 24 06:17:24.191696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 64/128] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:23 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1361 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:24.445279 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a8747d15-8b28-4b09-bc9d-251838351346 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:24.446289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a8747d15-8b28-4b09-bc9d-251838351346 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:24.455487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8747d15-8b28-4b09-bc9d-251838351346 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:24.456416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8747d15-8b28-4b09-bc9d-251838351346 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:24.457160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8747d15-8b28-4b09-bc9d-251838351346 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:24.458339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8747d15-8b28-4b09-bc9d-251838351346 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:24.459058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8747d15-8b28-4b09-bc9d-251838351346 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:24.459750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8747d15-8b28-4b09-bc9d-251838351346 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:24.511187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:24.711664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-88aca062-c219-4d48-b9a9-1674ff7d8693 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:24.713128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-88aca062-c219-4d48-b9a9-1674ff7d8693 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:24.723172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88aca062-c219-4d48-b9a9-1674ff7d8693 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:24.725077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88aca062-c219-4d48-b9a9-1674ff7d8693 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:24.725733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88aca062-c219-4d48-b9a9-1674ff7d8693 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:24.726700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88aca062-c219-4d48-b9a9-1674ff7d8693 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:24.727380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88aca062-c219-4d48-b9a9-1674ff7d8693 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:24.728023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88aca062-c219-4d48-b9a9-1674ff7d8693 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:24.820669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a8747d15-8b28-4b09-bc9d-251838351346 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:24.848323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a8747d15-8b28-4b09-bc9d-251838351346 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1315 microversion: 2.1 time: 0.406974 Aug 24 06:17:24.851836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 65/129] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:24 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:24.898527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:24.898527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:24.916318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:24.916908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:24.917355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:24.922794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:24.923287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:24.925662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:25.216176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-88aca062-c219-4d48-b9a9-1674ff7d8693 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:25.227741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-88aca062-c219-4d48-b9a9-1674ff7d8693 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.519693 Aug 24 06:17:25.245628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 65/130] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:25.260450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ced8be79-cca4-4347-8f8b-6785d9dc3715 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:25.264944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ced8be79-cca4-4347-8f8b-6785d9dc3715 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:25.276931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ced8be79-cca4-4347-8f8b-6785d9dc3715 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:25.282547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ced8be79-cca4-4347-8f8b-6785d9dc3715 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:25.283605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ced8be79-cca4-4347-8f8b-6785d9dc3715 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:25.284847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ced8be79-cca4-4347-8f8b-6785d9dc3715 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:25.285730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ced8be79-cca4-4347-8f8b-6785d9dc3715 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:25.286320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ced8be79-cca4-4347-8f8b-6785d9dc3715 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:25.478341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:25.505691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:25.509484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:25.515391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8c0668e5-906b-428d-9352-3f2e7a799c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.642910 Aug 24 06:17:25.530642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 66/131] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:25.836625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ced8be79-cca4-4347-8f8b-6785d9dc3715 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:25.849547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ced8be79-cca4-4347-8f8b-6785d9dc3715 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1546 microversion: 2.1 time: 0.601211 Aug 24 06:17:25.850863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 66/132] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:25 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1546 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:25.877682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-233e0292-512f-4541-9b3d-15968a70e601 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:25.878164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-233e0292-512f-4541-9b3d-15968a70e601 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:25.898140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-97061738-5447-4ff7-be41-1ed2fdaccedf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:25.901244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-97061738-5447-4ff7-be41-1ed2fdaccedf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:25.906083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-233e0292-512f-4541-9b3d-15968a70e601 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:25.907162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-233e0292-512f-4541-9b3d-15968a70e601 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:25.910079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-233e0292-512f-4541-9b3d-15968a70e601 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:25.911630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-233e0292-512f-4541-9b3d-15968a70e601 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:25.913411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-233e0292-512f-4541-9b3d-15968a70e601 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:25.917238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-233e0292-512f-4541-9b3d-15968a70e601 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:25.944906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97061738-5447-4ff7-be41-1ed2fdaccedf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:25.947027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97061738-5447-4ff7-be41-1ed2fdaccedf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:25.947702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97061738-5447-4ff7-be41-1ed2fdaccedf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:25.948804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97061738-5447-4ff7-be41-1ed2fdaccedf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:25.949476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97061738-5447-4ff7-be41-1ed2fdaccedf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:25.950128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97061738-5447-4ff7-be41-1ed2fdaccedf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:26.201986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-233e0292-512f-4541-9b3d-15968a70e601 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.327811 Aug 24 06:17:26.203598 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 67/133] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 24 06:17:25 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/os-interface => generated 284 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:26.205235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-97061738-5447-4ff7-be41-1ed2fdaccedf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:26.230640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-97061738-5447-4ff7-be41-1ed2fdaccedf tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1502 microversion: 2.1 time: 0.339821 Aug 24 06:17:26.230640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 67/134] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:25 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1502 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:26.267025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-093257d0-09c0-4b5f-9950-9833a9930200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:26.271107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-093257d0-09c0-4b5f-9950-9833a9930200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:26.293190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-093257d0-09c0-4b5f-9950-9833a9930200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:26.294188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-093257d0-09c0-4b5f-9950-9833a9930200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:26.304061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-093257d0-09c0-4b5f-9950-9833a9930200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:26.305631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-093257d0-09c0-4b5f-9950-9833a9930200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:26.306824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-093257d0-09c0-4b5f-9950-9833a9930200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:26.307837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-093257d0-09c0-4b5f-9950-9833a9930200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:26.555360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:26.556036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:26.558118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:26.570498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:26.570881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:26.571326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:26.573661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:26.574132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:26.576761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:26.668061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-093257d0-09c0-4b5f-9950-9833a9930200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:26.676808 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-093257d0-09c0-4b5f-9950-9833a9930200 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.420480 Aug 24 06:17:26.692968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 68/135] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:26.842765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:26.856690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:26.862481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:26.864636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0ff00e80-4bd6-4a06-b1a4-a7fa40c0fe37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.313475 Aug 24 06:17:26.865652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 68/136] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:27.703180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7849070a-8504-4f04-ab3c-768c94691a1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:27.704360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7849070a-8504-4f04-ab3c-768c94691a1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:27.729913 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7849070a-8504-4f04-ab3c-768c94691a1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:27.730452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7849070a-8504-4f04-ab3c-768c94691a1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:27.730886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7849070a-8504-4f04-ab3c-768c94691a1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:27.732518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7849070a-8504-4f04-ab3c-768c94691a1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:27.732996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7849070a-8504-4f04-ab3c-768c94691a1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:27.733423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7849070a-8504-4f04-ab3c-768c94691a1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:27.890200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:27.891457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:27.909441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:27.910034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:27.910543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:27.911462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:27.912098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:27.912759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:28.172392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7849070a-8504-4f04-ab3c-768c94691a1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:28.188134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7849070a-8504-4f04-ab3c-768c94691a1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.487087 Aug 24 06:17:28.200721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 69/137] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:28.222371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:28.235685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:28.238798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:28.241575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2029e7c0-932b-4ae3-9f38-12adbc67dc30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.356207 Aug 24 06:17:28.243782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 69/138] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:17:28.487577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-c6ef244f-2e46-429c-a0cd-3010450c0a0c req-f7e288ad-bd9a-4e19-b10b-cd8a9133f07f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5950cfdd-41b3-4842-81ab-e6507515a4a2", "tag": "fcdb5142-a706-43a9-9c46-6ef15b217519"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:28.497494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-c6ef244f-2e46-429c-a0cd-3010450c0a0c req-f7e288ad-bd9a-4e19-b10b-cd8a9133f07f service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:28.498051 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-c6ef244f-2e46-429c-a0cd-3010450c0a0c req-f7e288ad-bd9a-4e19-b10b-cd8a9133f07f service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:28.498538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-c6ef244f-2e46-429c-a0cd-3010450c0a0c req-f7e288ad-bd9a-4e19-b10b-cd8a9133f07f service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:28.513979 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-c6ef244f-2e46-429c-a0cd-3010450c0a0c req-f7e288ad-bd9a-4e19-b10b-cd8a9133f07f service nova] Creating event network-changed:fcdb5142-a706-43a9-9c46-6ef15b217519 for instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 on hv-cinder-85426 Aug 24 06:17:28.519822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-c6ef244f-2e46-429c-a0cd-3010450c0a0c req-f7e288ad-bd9a-4e19-b10b-cd8a9133f07f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036730 Aug 24 06:17:28.523743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 70/139] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:29.211145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-02c0d666-67a3-44ac-9390-56f3850d40fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:29.212066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-02c0d666-67a3-44ac-9390-56f3850d40fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:29.223288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02c0d666-67a3-44ac-9390-56f3850d40fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:29.223883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02c0d666-67a3-44ac-9390-56f3850d40fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:29.225101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02c0d666-67a3-44ac-9390-56f3850d40fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:29.229739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02c0d666-67a3-44ac-9390-56f3850d40fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:29.229739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02c0d666-67a3-44ac-9390-56f3850d40fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:29.229739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02c0d666-67a3-44ac-9390-56f3850d40fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:29.274379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:29.275119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:29.290955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:29.290955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:29.297169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:29.301545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:29.302031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:29.307016 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:29.523304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:29.537120 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:29.544638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:29.546374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4d999c0d-b940-43f9-afb9-e3c01cf94b77 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1408 microversion: 2.20 time: 0.276803 Aug 24 06:17:29.547136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 71/140] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:29 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:29.611174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-02c0d666-67a3-44ac-9390-56f3850d40fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:29.631229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-02c0d666-67a3-44ac-9390-56f3850d40fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.423743 Aug 24 06:17:29.648554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 70/141] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:30.594077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:30.594077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:30.594077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:30.594077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:30.595210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:30.595210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:30.595210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:30.595210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:30.668350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d27107cc-1713-46c1-893b-de6404c1ccfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:30.672244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d27107cc-1713-46c1-893b-de6404c1ccfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:30.699178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27107cc-1713-46c1-893b-de6404c1ccfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:30.700082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27107cc-1713-46c1-893b-de6404c1ccfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:30.708847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27107cc-1713-46c1-893b-de6404c1ccfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:30.710385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27107cc-1713-46c1-893b-de6404c1ccfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:30.711824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27107cc-1713-46c1-893b-de6404c1ccfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:30.712699 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d27107cc-1713-46c1-893b-de6404c1ccfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:30.959570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:30.972589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:30.977011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:30.980916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0ed7ef22-8604-4068-be8f-e34cad8fd98b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1601 microversion: 2.20 time: 0.405499 Aug 24 06:17:30.984650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 72/142] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:17:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1601 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:17:31.010338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e0d4f8fc-35ff-4ccf-ac14-cbdb92a33097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:31.016689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e0d4f8fc-35ff-4ccf-ac14-cbdb92a33097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:31.018362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0d4f8fc-35ff-4ccf-ac14-cbdb92a33097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:31.019025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0d4f8fc-35ff-4ccf-ac14-cbdb92a33097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:31.019654 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0d4f8fc-35ff-4ccf-ac14-cbdb92a33097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:31.020537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0d4f8fc-35ff-4ccf-ac14-cbdb92a33097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:31.021225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0d4f8fc-35ff-4ccf-ac14-cbdb92a33097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:31.021854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0d4f8fc-35ff-4ccf-ac14-cbdb92a33097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:31.121816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e0d4f8fc-35ff-4ccf-ac14-cbdb92a33097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.120038 Aug 24 06:17:31.122638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 73/143] 10.222.0.62 () {60 vars in 1316 bytes} [Wed Aug 24 06:17:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:17:31.500654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d27107cc-1713-46c1-893b-de6404c1ccfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:31.513205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d27107cc-1713-46c1-893b-de6404c1ccfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1367 microversion: 2.1 time: 0.847551 Aug 24 06:17:31.514009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 71/144] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1367 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:32.111187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3fae9196-9419-4b55-a3f7-06e585c95bae tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3902968-7c1a-42aa-8017-55c4cb39fa06"}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:32.116877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3fae9196-9419-4b55-a3f7-06e585c95bae tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:32.133141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fae9196-9419-4b55-a3f7-06e585c95bae tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:32.133682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fae9196-9419-4b55-a3f7-06e585c95bae tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:32.134127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fae9196-9419-4b55-a3f7-06e585c95bae tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:32.134834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fae9196-9419-4b55-a3f7-06e585c95bae tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:32.135290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fae9196-9419-4b55-a3f7-06e585c95bae tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:32.135715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fae9196-9419-4b55-a3f7-06e585c95bae tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:32.532510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a0954475-9a65-46e2-90bf-66b23e0c477b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:32.539425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a0954475-9a65-46e2-90bf-66b23e0c477b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:32.557520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0954475-9a65-46e2-90bf-66b23e0c477b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:32.562330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0954475-9a65-46e2-90bf-66b23e0c477b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:32.562330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0954475-9a65-46e2-90bf-66b23e0c477b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:32.562330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0954475-9a65-46e2-90bf-66b23e0c477b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:32.562330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0954475-9a65-46e2-90bf-66b23e0c477b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:32.562793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0954475-9a65-46e2-90bf-66b23e0c477b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:33.463906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a0954475-9a65-46e2-90bf-66b23e0c477b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:33.484071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a0954475-9a65-46e2-90bf-66b23e0c477b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1556 microversion: 2.1 time: 0.953874 Aug 24 06:17:33.485682 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 72/145] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1556 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:33.532345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ca29f386-b8e9-4ded-ae0d-940d2aba9733 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:33.534281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ca29f386-b8e9-4ded-ae0d-940d2aba9733 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:33.537510 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3fae9196-9419-4b55-a3f7-06e585c95bae tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "POST /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.431173 Aug 24 06:17:33.543310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 74/146] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 24 06:17:32 2022] POST /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a/os-volume_attachments => generated 194 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:33.551450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=89 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:33.552964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca29f386-b8e9-4ded-ae0d-940d2aba9733 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:33.553965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca29f386-b8e9-4ded-ae0d-940d2aba9733 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:33.554901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca29f386-b8e9-4ded-ae0d-940d2aba9733 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:33.556228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca29f386-b8e9-4ded-ae0d-940d2aba9733 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:33.558014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca29f386-b8e9-4ded-ae0d-940d2aba9733 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:33.559134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca29f386-b8e9-4ded-ae0d-940d2aba9733 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:33.982512 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ca29f386-b8e9-4ded-ae0d-940d2aba9733 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.476933 Aug 24 06:17:33.984576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 73/147] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 24 06:17:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-interface => generated 284 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:17:34.531029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-b324abac-925f-4908-a9ae-f691a1f4c54e req-93f0b6c5-7f14-45bb-8deb-396c6bc9bc0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9", "tag": "6fa5961a-6a56-4ea0-88f8-85ee1d70c184"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:34.557453 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-b324abac-925f-4908-a9ae-f691a1f4c54e req-93f0b6c5-7f14-45bb-8deb-396c6bc9bc0e service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:34.561668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-b324abac-925f-4908-a9ae-f691a1f4c54e req-93f0b6c5-7f14-45bb-8deb-396c6bc9bc0e service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:34.563150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-b324abac-925f-4908-a9ae-f691a1f4c54e req-93f0b6c5-7f14-45bb-8deb-396c6bc9bc0e service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:34.610558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-b324abac-925f-4908-a9ae-f691a1f4c54e req-93f0b6c5-7f14-45bb-8deb-396c6bc9bc0e service nova] Creating event network-changed:6fa5961a-6a56-4ea0-88f8-85ee1d70c184 for instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 on hv-cinder-85426 Aug 24 06:17:34.629501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-b324abac-925f-4908-a9ae-f691a1f4c54e req-93f0b6c5-7f14-45bb-8deb-396c6bc9bc0e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102894 Aug 24 06:17:34.633230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 75/148] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:17:36.669930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-3a1d78ee-3e05-41b2-b989-304bdae16871 req-bdb11499-7f7d-4246-9864-515617bd6c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90ff1952-1000-4510-ac80-d18576f044cb", "tag": "c4db42a9-a4c7-44d5-9663-2a6ea0296573"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:36.721252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-3a1d78ee-3e05-41b2-b989-304bdae16871 req-bdb11499-7f7d-4246-9864-515617bd6c11 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:36.724564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-3a1d78ee-3e05-41b2-b989-304bdae16871 req-bdb11499-7f7d-4246-9864-515617bd6c11 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:36.729727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-3a1d78ee-3e05-41b2-b989-304bdae16871 req-bdb11499-7f7d-4246-9864-515617bd6c11 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:36.784041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-3a1d78ee-3e05-41b2-b989-304bdae16871 req-bdb11499-7f7d-4246-9864-515617bd6c11 service nova] Creating event network-changed:c4db42a9-a4c7-44d5-9663-2a6ea0296573 for instance 90ff1952-1000-4510-ac80-d18576f044cb on hv-cinder-85426 Aug 24 06:17:36.812604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-3a1d78ee-3e05-41b2-b989-304bdae16871 req-bdb11499-7f7d-4246-9864-515617bd6c11 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147188 Aug 24 06:17:36.819339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 74/149] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:45.191585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-57eb330e-778b-4b5f-803c-f51d332b6930 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Action: 'create', calling method: .version_select at 0x7fcddc62df70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1126420631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5NI9wPdw0AEqFDL4AJBKrNQHllg0loA2Q80GQSgIy3ZOHUHNcT0OUf2MJqNKGkivBqT98bFPeymFpI6LQUVoX4bsFrQF2cs1Tm9/g/exb8ue5tz7wdrO7GqLHt+8cSzg=="}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:45.197734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=88 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:45.198378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:45.210140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-57eb330e-778b-4b5f-803c-f51d332b6930 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Getting quotas for project e2adcef70b1f41d19ddee6811b47be41. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:17:45.214288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-57eb330e-778b-4b5f-803c-f51d332b6930 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Getting quotas for user d3a03b5f82724f37a2134554d42b2925 and project e2adcef70b1f41d19ddee6811b47be41. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:17:45.288657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-57eb330e-778b-4b5f-803c-f51d332b6930 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.101228 Aug 24 06:17:45.289267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 76/150] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 24 06:17:45 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:45.393566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-593674508", "imageRef": "76e3d0d5-6520-461a-8c35-cf5374c7bf48", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1126420631", "networks": [{"uuid": "a629ac69-dddd-44ae-895a-18bb4f87a9e7"}]}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:45.447102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] validate_networks() for [('a629ac69-dddd-44ae-895a-18bb4f87a9e7', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:17:45.835042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:17:45.835470 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:17:45.835946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:17:45.836356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:17:45.836834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:17:45.845945 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:45.846423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:45.846853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:45.847586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:45.848036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:45.848456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:45.865118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Getting quotas for project e2adcef70b1f41d19ddee6811b47be41. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:17:45.869138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Getting quotas for user d3a03b5f82724f37a2134554d42b2925 and project e2adcef70b1f41d19ddee6811b47be41. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:17:45.880943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:17:45.883265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='76e3d0d5-6520-461a-8c35-cf5374c7bf48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:17:45.992925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-686d393e-b9bc-4a51-8a09-93668421381f tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604176 Aug 24 06:17:45.993729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 75/151] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:17:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:17:46.005593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ab3bf135-4c5d-47c8-90a1-62a780802c2d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:46.006262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ab3bf135-4c5d-47c8-90a1-62a780802c2d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:46.067483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ab3bf135-4c5d-47c8-90a1-62a780802c2d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:46.075306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ab3bf135-4c5d-47c8-90a1-62a780802c2d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1258 microversion: 2.1 time: 0.074945 Aug 24 06:17:46.075719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 77/152] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:45 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:47.096079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6af3620d-613f-4487-b26b-d98e0c76ac50 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:47.098680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6af3620d-613f-4487-b26b-d98e0c76ac50 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:47.154433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6af3620d-613f-4487-b26b-d98e0c76ac50 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:47.162529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6af3620d-613f-4487-b26b-d98e0c76ac50 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1258 microversion: 2.1 time: 0.070833 Aug 24 06:17:47.164361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 76/153] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:47 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:47.444703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6308a3f6-5dab-4356-b3e2-b45c175dd0f1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:47.444703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6308a3f6-5dab-4356-b3e2-b45c175dd0f1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:47.449596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6308a3f6-5dab-4356-b3e2-b45c175dd0f1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:47.450081 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6308a3f6-5dab-4356-b3e2-b45c175dd0f1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:47.450510 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6308a3f6-5dab-4356-b3e2-b45c175dd0f1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:47.451254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6308a3f6-5dab-4356-b3e2-b45c175dd0f1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:47.452151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6308a3f6-5dab-4356-b3e2-b45c175dd0f1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:47.452925 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6308a3f6-5dab-4356-b3e2-b45c175dd0f1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:47.490427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6308a3f6-5dab-4356-b3e2-b45c175dd0f1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Going to try to terminate instance {{(pid=121150) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:17:47.846558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6308a3f6-5dab-4356-b3e2-b45c175dd0f1 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "DELETE /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 204 len: 0 microversion: 2.1 time: 0.412056 Aug 24 06:17:47.847106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 78/154] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:17:47 2022] DELETE /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:17:47.855015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-80be1959-20e8-4813-96f2-69965341dc24 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:47.855656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-80be1959-20e8-4813-96f2-69965341dc24 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:47.861919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80be1959-20e8-4813-96f2-69965341dc24 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:47.862384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80be1959-20e8-4813-96f2-69965341dc24 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:47.862810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80be1959-20e8-4813-96f2-69965341dc24 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:47.863483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80be1959-20e8-4813-96f2-69965341dc24 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:47.863928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80be1959-20e8-4813-96f2-69965341dc24 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:47.864348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80be1959-20e8-4813-96f2-69965341dc24 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:47.996770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-80be1959-20e8-4813-96f2-69965341dc24 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:48.005457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-80be1959-20e8-4813-96f2-69965341dc24 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1554 microversion: 2.1 time: 0.154252 Aug 24 06:17:48.006021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 77/155] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:47 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:48.185804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-946e50c8-9eee-4a71-a433-c83ff94f7fe8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:48.186568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-946e50c8-9eee-4a71-a433-c83ff94f7fe8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:48.193332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-946e50c8-9eee-4a71-a433-c83ff94f7fe8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:48.193815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-946e50c8-9eee-4a71-a433-c83ff94f7fe8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:48.194244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-946e50c8-9eee-4a71-a433-c83ff94f7fe8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:48.194934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-946e50c8-9eee-4a71-a433-c83ff94f7fe8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:48.195378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-946e50c8-9eee-4a71-a433-c83ff94f7fe8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:48.195795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-946e50c8-9eee-4a71-a433-c83ff94f7fe8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:48.258536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-946e50c8-9eee-4a71-a433-c83ff94f7fe8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:48.266129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-946e50c8-9eee-4a71-a433-c83ff94f7fe8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1310 microversion: 2.1 time: 0.084620 Aug 24 06:17:48.267278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 79/156] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:48 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:49.028846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-96882abd-09bc-4a81-9030-c07fbdae69c5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:49.029451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-96882abd-09bc-4a81-9030-c07fbdae69c5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:49.036091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96882abd-09bc-4a81-9030-c07fbdae69c5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:49.036592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96882abd-09bc-4a81-9030-c07fbdae69c5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:49.037028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96882abd-09bc-4a81-9030-c07fbdae69c5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:49.037704 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96882abd-09bc-4a81-9030-c07fbdae69c5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:49.038157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96882abd-09bc-4a81-9030-c07fbdae69c5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:49.043175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96882abd-09bc-4a81-9030-c07fbdae69c5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:49.170298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-96882abd-09bc-4a81-9030-c07fbdae69c5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:49.178751 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-96882abd-09bc-4a81-9030-c07fbdae69c5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1554 microversion: 2.1 time: 0.153708 Aug 24 06:17:49.179308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 78/157] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:49 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:49.288168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0a569fba-ae08-4179-89f9-3a2a32030a66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:49.288705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0a569fba-ae08-4179-89f9-3a2a32030a66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:49.295212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a569fba-ae08-4179-89f9-3a2a32030a66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:49.295678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a569fba-ae08-4179-89f9-3a2a32030a66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:49.296101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a569fba-ae08-4179-89f9-3a2a32030a66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:49.296814 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a569fba-ae08-4179-89f9-3a2a32030a66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:49.297260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a569fba-ae08-4179-89f9-3a2a32030a66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:49.297671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a569fba-ae08-4179-89f9-3a2a32030a66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:49.363985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0a569fba-ae08-4179-89f9-3a2a32030a66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:49.371832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0a569fba-ae08-4179-89f9-3a2a32030a66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1310 microversion: 2.1 time: 0.087674 Aug 24 06:17:49.372400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 80/158] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:49 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:17:50.199192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a3f65686-4179-4cd4-95a8-0891a4ddc7c7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:50.199802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a3f65686-4179-4cd4-95a8-0891a4ddc7c7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:50.205784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3f65686-4179-4cd4-95a8-0891a4ddc7c7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:50.206257 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3f65686-4179-4cd4-95a8-0891a4ddc7c7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:50.206685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3f65686-4179-4cd4-95a8-0891a4ddc7c7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:50.207359 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3f65686-4179-4cd4-95a8-0891a4ddc7c7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:50.207802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3f65686-4179-4cd4-95a8-0891a4ddc7c7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:50.208218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3f65686-4179-4cd4-95a8-0891a4ddc7c7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:50.338032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a3f65686-4179-4cd4-95a8-0891a4ddc7c7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:50.346280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a3f65686-4179-4cd4-95a8-0891a4ddc7c7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1554 microversion: 2.1 time: 0.151062 Aug 24 06:17:50.346836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 79/159] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:50 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:50.392576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b8e065e6-7352-4af2-aad2-560f3b3c3c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:50.393185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b8e065e6-7352-4af2-aad2-560f3b3c3c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:50.399661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8e065e6-7352-4af2-aad2-560f3b3c3c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:50.400134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8e065e6-7352-4af2-aad2-560f3b3c3c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:50.400601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8e065e6-7352-4af2-aad2-560f3b3c3c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:50.401281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8e065e6-7352-4af2-aad2-560f3b3c3c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:50.401723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8e065e6-7352-4af2-aad2-560f3b3c3c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:50.402137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8e065e6-7352-4af2-aad2-560f3b3c3c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:50.461178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b8e065e6-7352-4af2-aad2-560f3b3c3c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:50.468487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b8e065e6-7352-4af2-aad2-560f3b3c3c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1310 microversion: 2.1 time: 0.080369 Aug 24 06:17:50.469067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 81/160] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:50 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1310 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:51.367237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b12672d9-19e5-4a28-bbdf-2ef0fc576196 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:51.367794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b12672d9-19e5-4a28-bbdf-2ef0fc576196 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:51.373744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b12672d9-19e5-4a28-bbdf-2ef0fc576196 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:51.374223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b12672d9-19e5-4a28-bbdf-2ef0fc576196 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:51.374700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b12672d9-19e5-4a28-bbdf-2ef0fc576196 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:51.375391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b12672d9-19e5-4a28-bbdf-2ef0fc576196 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:51.375835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b12672d9-19e5-4a28-bbdf-2ef0fc576196 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:51.376251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b12672d9-19e5-4a28-bbdf-2ef0fc576196 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:51.489181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3ee0cfa7-94eb-4c08-812d-f0f267cce2d7 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:51.489916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3ee0cfa7-94eb-4c08-812d-f0f267cce2d7 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:51.497033 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ee0cfa7-94eb-4c08-812d-f0f267cce2d7 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:51.497597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ee0cfa7-94eb-4c08-812d-f0f267cce2d7 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:51.498088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ee0cfa7-94eb-4c08-812d-f0f267cce2d7 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:51.499003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ee0cfa7-94eb-4c08-812d-f0f267cce2d7 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:51.499545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ee0cfa7-94eb-4c08-812d-f0f267cce2d7 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:51.500020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ee0cfa7-94eb-4c08-812d-f0f267cce2d7 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:51.509609 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b12672d9-19e5-4a28-bbdf-2ef0fc576196 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:51.518668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b12672d9-19e5-4a28-bbdf-2ef0fc576196 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1554 microversion: 2.1 time: 0.155391 Aug 24 06:17:51.519628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 80/161] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:51 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:51.561636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3ee0cfa7-94eb-4c08-812d-f0f267cce2d7 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:51.569650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3ee0cfa7-94eb-4c08-812d-f0f267cce2d7 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1310 microversion: 2.1 time: 0.084506 Aug 24 06:17:51.570212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 82/162] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:51 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:52.540431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fd639359-176a-40c2-868b-59bfe2e4b5e5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:52.541144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fd639359-176a-40c2-868b-59bfe2e4b5e5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:52.547203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd639359-176a-40c2-868b-59bfe2e4b5e5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:52.547687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd639359-176a-40c2-868b-59bfe2e4b5e5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:52.548710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd639359-176a-40c2-868b-59bfe2e4b5e5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:52.549999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd639359-176a-40c2-868b-59bfe2e4b5e5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:52.550817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd639359-176a-40c2-868b-59bfe2e4b5e5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:52.551185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd639359-176a-40c2-868b-59bfe2e4b5e5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:52.591496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cdd2de12-4d97-4429-87d1-3f1c4ff57b66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:52.592221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cdd2de12-4d97-4429-87d1-3f1c4ff57b66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:52.603466 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cdd2de12-4d97-4429-87d1-3f1c4ff57b66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:52.604800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cdd2de12-4d97-4429-87d1-3f1c4ff57b66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:52.605508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cdd2de12-4d97-4429-87d1-3f1c4ff57b66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:52.607531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cdd2de12-4d97-4429-87d1-3f1c4ff57b66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:52.608916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cdd2de12-4d97-4429-87d1-3f1c4ff57b66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:52.609914 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cdd2de12-4d97-4429-87d1-3f1c4ff57b66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:52.638821 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fd639359-176a-40c2-868b-59bfe2e4b5e5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:52.665389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fd639359-176a-40c2-868b-59bfe2e4b5e5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1512 microversion: 2.1 time: 0.129048 Aug 24 06:17:52.677148 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 81/163] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:52 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1512 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:52.798644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-37af2fc6-a12f-482c-8d8d-f050abf4404c req-3dc5399d-2e95-4871-ae73-9e0683cfa403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33183e35-cf61-4cfa-b5d4-9a9306648a1a", "name": "network-vif-deleted", "tag": "43fc490c-6786-4540-8f63-24f2545139fa"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:52.819264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-37af2fc6-a12f-482c-8d8d-f050abf4404c req-3dc5399d-2e95-4871-ae73-9e0683cfa403 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:52.822154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-37af2fc6-a12f-482c-8d8d-f050abf4404c req-3dc5399d-2e95-4871-ae73-9e0683cfa403 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:52.822846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-37af2fc6-a12f-482c-8d8d-f050abf4404c req-3dc5399d-2e95-4871-ae73-9e0683cfa403 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:52.866791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-37af2fc6-a12f-482c-8d8d-f050abf4404c req-3dc5399d-2e95-4871-ae73-9e0683cfa403 service nova] Creating event network-vif-deleted:43fc490c-6786-4540-8f63-24f2545139fa for instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a on hv-cinder-85426 Aug 24 06:17:52.878596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-37af2fc6-a12f-482c-8d8d-f050abf4404c req-3dc5399d-2e95-4871-ae73-9e0683cfa403 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087137 Aug 24 06:17:52.880739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 82/164] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:52.908581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cdd2de12-4d97-4429-87d1-3f1c4ff57b66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:52.914404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cdd2de12-4d97-4429-87d1-3f1c4ff57b66 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.326998 Aug 24 06:17:52.915001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 83/165] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:52 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:53.701431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:53.702262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:53.709824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:53.710371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:53.710813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:53.711902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:53.711999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:53.712370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:53.787015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:53.788472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:53.789623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:53.790625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.objects.instance [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lazy-loading 'fault' on Instance uuid 33183e35-cf61-4cfa-b5d4-9a9306648a1a {{(pid=121151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:17:53.798271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-bb4f8cd1-ff0b-4b0f-a41d-bf5ba72d9c4d req-8c633b43-ddd5-47e5-848e-7ac28160291d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967afe19-8139-4888-ae38-b682c1188c8f", "tag": "284c413d-f37f-41e3-a049-9aeaaa40a0c8"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:53.804690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:53.819000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-bb4f8cd1-ff0b-4b0f-a41d-bf5ba72d9c4d req-8c633b43-ddd5-47e5-848e-7ac28160291d service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:53.819614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-bb4f8cd1-ff0b-4b0f-a41d-bf5ba72d9c4d req-8c633b43-ddd5-47e5-848e-7ac28160291d service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:53.820430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-bb4f8cd1-ff0b-4b0f-a41d-bf5ba72d9c4d req-8c633b43-ddd5-47e5-848e-7ac28160291d service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:53.832863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-bb4f8cd1-ff0b-4b0f-a41d-bf5ba72d9c4d req-8c633b43-ddd5-47e5-848e-7ac28160291d service nova] Creating event network-changed:284c413d-f37f-41e3-a049-9aeaaa40a0c8 for instance 967afe19-8139-4888-ae38-b682c1188c8f on hv-cinder-85426 Aug 24 06:17:53.839605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-bb4f8cd1-ff0b-4b0f-a41d-bf5ba72d9c4d req-8c633b43-ddd5-47e5-848e-7ac28160291d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044718 Aug 24 06:17:53.841155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 84/166] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:17:53.887967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:53.897268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cd7942b3-6136-4b81-b6da-b86835a949a7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1351 microversion: 2.1 time: 0.204749 Aug 24 06:17:53.900775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 83/167] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:53 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1351 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:53.940834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9bce4d0a-368b-4086-9669-fc258c0ad1aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:53.942305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9bce4d0a-368b-4086-9669-fc258c0ad1aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:53.958691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bce4d0a-368b-4086-9669-fc258c0ad1aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:53.961637 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bce4d0a-368b-4086-9669-fc258c0ad1aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:53.963022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bce4d0a-368b-4086-9669-fc258c0ad1aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:53.965917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bce4d0a-368b-4086-9669-fc258c0ad1aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:53.966400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bce4d0a-368b-4086-9669-fc258c0ad1aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:53.968850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bce4d0a-368b-4086-9669-fc258c0ad1aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:54.224418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9bce4d0a-368b-4086-9669-fc258c0ad1aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:54.234917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9bce4d0a-368b-4086-9669-fc258c0ad1aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.300348 Aug 24 06:17:54.245463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 85/168] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:53 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:54.919484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:54.920223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:54.928088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:54.928597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:54.929084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:54.929796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:54.930241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:54.930655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:54.962259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:54.962756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:54.963220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:54.963660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.objects.instance [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lazy-loading 'fault' on Instance uuid 33183e35-cf61-4cfa-b5d4-9a9306648a1a {{(pid=121151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:17:55.018562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:55.027706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-31d389ef-e312-471b-9e8a-190eef84cd2a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1351 microversion: 2.1 time: 0.112321 Aug 24 06:17:55.028280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 84/169] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:54 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:55.259073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-059ab3a6-a527-481e-be2f-69a154a210af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:55.259816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-059ab3a6-a527-481e-be2f-69a154a210af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:55.270207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-059ab3a6-a527-481e-be2f-69a154a210af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:55.270687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-059ab3a6-a527-481e-be2f-69a154a210af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:55.271110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-059ab3a6-a527-481e-be2f-69a154a210af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:55.271803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-059ab3a6-a527-481e-be2f-69a154a210af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:55.274113 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-059ab3a6-a527-481e-be2f-69a154a210af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:55.274113 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-059ab3a6-a527-481e-be2f-69a154a210af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:55.443887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-059ab3a6-a527-481e-be2f-69a154a210af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:55.456006 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-059ab3a6-a527-481e-be2f-69a154a210af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.197617 Aug 24 06:17:55.457358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 86/170] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:55 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:56.051343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:56.051972 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:56.053980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:56.059332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:56.060032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:56.060757 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:56.061619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:56.062312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:56.062884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:56.123607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:56.124197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:56.124681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:56.126228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.objects.instance [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lazy-loading 'fault' on Instance uuid 33183e35-cf61-4cfa-b5d4-9a9306648a1a {{(pid=121151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:17:56.185611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:56.205079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-00849883-8eea-4f3e-b1e2-8a0c6c9db22c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1351 microversion: 2.1 time: 0.158756 Aug 24 06:17:56.205952 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 85/171] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:56 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:56.478183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d36df625-e72c-42a8-8bb2-1738f8ddaa59 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:56.478809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d36df625-e72c-42a8-8bb2-1738f8ddaa59 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:56.487457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=6 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:56.489443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36df625-e72c-42a8-8bb2-1738f8ddaa59 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:56.490154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36df625-e72c-42a8-8bb2-1738f8ddaa59 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:56.490585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36df625-e72c-42a8-8bb2-1738f8ddaa59 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:56.491294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36df625-e72c-42a8-8bb2-1738f8ddaa59 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:56.491755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36df625-e72c-42a8-8bb2-1738f8ddaa59 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:56.492700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36df625-e72c-42a8-8bb2-1738f8ddaa59 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:56.659162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d36df625-e72c-42a8-8bb2-1738f8ddaa59 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:56.667741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d36df625-e72c-42a8-8bb2-1738f8ddaa59 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.193362 Aug 24 06:17:56.668576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 87/172] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:56 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:57.225144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:57.225755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:57.227656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=8 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:17:57.232619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:57.233369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:57.233965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:57.234953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:57.236066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:57.236510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:57.287563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:57.288048 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:57.288480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:57.289047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.objects.instance [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lazy-loading 'fault' on Instance uuid 33183e35-cf61-4cfa-b5d4-9a9306648a1a {{(pid=121151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:17:57.357168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:57.368212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-25b89d73-9d00-4a52-bffc-5847f36a8d05 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1351 microversion: 2.1 time: 0.146835 Aug 24 06:17:57.369097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 86/173] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:57 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:57.691579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f13584d1-26d2-478f-adfa-b827a5f1863b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:57.692189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f13584d1-26d2-478f-adfa-b827a5f1863b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:57.715660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f13584d1-26d2-478f-adfa-b827a5f1863b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:57.715983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f13584d1-26d2-478f-adfa-b827a5f1863b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:57.716579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f13584d1-26d2-478f-adfa-b827a5f1863b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:57.717483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f13584d1-26d2-478f-adfa-b827a5f1863b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:57.718112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f13584d1-26d2-478f-adfa-b827a5f1863b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:57.718710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f13584d1-26d2-478f-adfa-b827a5f1863b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:57.904771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f13584d1-26d2-478f-adfa-b827a5f1863b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:57.914906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f13584d1-26d2-478f-adfa-b827a5f1863b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.227663 Aug 24 06:17:57.915490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 88/174] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:57 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:58.384036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1634767140", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452"}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:17:58.390551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:58.391821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:58.410678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:58.412062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:58.413019 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:58.414300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:58.417323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:58.419593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:58.501779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] validate_networks() for None {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:17:58.513387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:58.514223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:58.514864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:58.515539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lazy-loading 'fault' on Instance uuid 33183e35-cf61-4cfa-b5d4-9a9306648a1a {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:17:58.570739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:58.594014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0aa447f3-fe6f-48bb-bfef-f79c0c6a72ea tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1351 microversion: 2.1 time: 0.201589 Aug 24 06:17:58.594014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 89/175] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:58 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1351 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:58.929858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:17:58.934610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:17:58.935977 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e2641d5e-d5d0-4f19-899b-48404fe4912b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:58.937111 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:17:58.937721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:17:58.938597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e2641d5e-d5d0-4f19-899b-48404fe4912b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:58.940742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:17:58.951963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2641d5e-d5d0-4f19-899b-48404fe4912b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:58.952323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2641d5e-d5d0-4f19-899b-48404fe4912b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:58.957021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2641d5e-d5d0-4f19-899b-48404fe4912b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:58.957951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2641d5e-d5d0-4f19-899b-48404fe4912b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:58.959359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2641d5e-d5d0-4f19-899b-48404fe4912b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:58.959994 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2641d5e-d5d0-4f19-899b-48404fe4912b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:58.962438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:58.966611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:58.967358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:58.968004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:58.968580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:58.968884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:59.029332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Getting quotas for project e2345e03d1a94b1ea2388246aeefedbb. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:17:59.053878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Getting quotas for user c9007aaaf32d4c22b3dc56c3cd1e08ed and project e2345e03d1a94b1ea2388246aeefedbb. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:17:59.080416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:17:59.083239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:17:59.148349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e2641d5e-d5d0-4f19-899b-48404fe4912b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:59.157567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e2641d5e-d5d0-4f19-899b-48404fe4912b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.225492 Aug 24 06:17:59.170952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 90/176] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:58 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:59.272881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ab9b9c8a-393d-4997-938c-a7f4d1b15d50 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.894659 Aug 24 06:17:59.273823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 87/177] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:17:59.286732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a3122c68-68f2-40cc-95e5-33991521249f tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:59.287475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a3122c68-68f2-40cc-95e5-33991521249f tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:59.422177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a3122c68-68f2-40cc-95e5-33991521249f tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:59.429406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a3122c68-68f2-40cc-95e5-33991521249f tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1215 microversion: 2.1 time: 0.147924 Aug 24 06:17:59.429976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 91/178] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:59 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1215 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:17:59.613350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:17:59.614589 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:17:59.621066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:59.629310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:59.629310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:59.629310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:59.629310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:59.629968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:59.671909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:17:59.672905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:17:59.673671 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:17:59.673952 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.objects.instance [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lazy-loading 'fault' on Instance uuid 33183e35-cf61-4cfa-b5d4-9a9306648a1a {{(pid=121151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:17:59.732951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:17:59.757857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a8beab12-7ba3-4d76-ae40-ca4f90afd76d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1351 microversion: 2.1 time: 0.148761 Aug 24 06:17:59.759309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 88/179] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:17:59 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:00.179409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a02cf1ff-2d58-4c50-a9d5-54065b2ff13b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:00.181360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a02cf1ff-2d58-4c50-a9d5-54065b2ff13b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:00.188073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a02cf1ff-2d58-4c50-a9d5-54065b2ff13b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:00.188895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a02cf1ff-2d58-4c50-a9d5-54065b2ff13b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:00.189539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a02cf1ff-2d58-4c50-a9d5-54065b2ff13b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:00.190416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a02cf1ff-2d58-4c50-a9d5-54065b2ff13b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:00.191060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a02cf1ff-2d58-4c50-a9d5-54065b2ff13b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:00.191690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a02cf1ff-2d58-4c50-a9d5-54065b2ff13b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:00.359542 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a02cf1ff-2d58-4c50-a9d5-54065b2ff13b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:00.370345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a02cf1ff-2d58-4c50-a9d5-54065b2ff13b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.194424 Aug 24 06:18:00.371632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 92/180] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:00 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:00.454606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2e4fdf67-69e3-4a22-bf5d-468f5a0f230f tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:00.455603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2e4fdf67-69e3-4a22-bf5d-468f5a0f230f tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:00.527618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2e4fdf67-69e3-4a22-bf5d-468f5a0f230f tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:00.538014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2e4fdf67-69e3-4a22-bf5d-468f5a0f230f tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1215 microversion: 2.1 time: 0.087828 Aug 24 06:18:00.552290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 89/181] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:00 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:00.792027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:00.793596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:00.801611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:00.802449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:00.803406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:00.804749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:00.805511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:00.806721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:00.877310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:00.877310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:00.877310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:00.877864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lazy-loading 'fault' on Instance uuid 33183e35-cf61-4cfa-b5d4-9a9306648a1a {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:18:00.946062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:00.955428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:00.963780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-98e54bfd-7990-4ba5-b156-813a50c9185d tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1351 microversion: 2.1 time: 0.175495 Aug 24 06:18:00.964653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 93/182] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:00 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1351 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:01.397338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-126ea348-b193-46fb-b211-5d93d87c9413 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:01.398229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-126ea348-b193-46fb-b211-5d93d87c9413 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:01.404422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-126ea348-b193-46fb-b211-5d93d87c9413 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:01.404934 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-126ea348-b193-46fb-b211-5d93d87c9413 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:01.405365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-126ea348-b193-46fb-b211-5d93d87c9413 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:01.406059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-126ea348-b193-46fb-b211-5d93d87c9413 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:01.406507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-126ea348-b193-46fb-b211-5d93d87c9413 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:01.407593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-126ea348-b193-46fb-b211-5d93d87c9413 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:01.560964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-10517bb7-59fd-4d94-b20b-ab171bd8c554 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:01.561580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-10517bb7-59fd-4d94-b20b-ab171bd8c554 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:01.572253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10517bb7-59fd-4d94-b20b-ab171bd8c554 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:01.577279 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10517bb7-59fd-4d94-b20b-ab171bd8c554 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:01.577944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10517bb7-59fd-4d94-b20b-ab171bd8c554 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:01.578872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10517bb7-59fd-4d94-b20b-ab171bd8c554 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:01.579519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10517bb7-59fd-4d94-b20b-ab171bd8c554 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:01.580131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10517bb7-59fd-4d94-b20b-ab171bd8c554 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:01.584563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-126ea348-b193-46fb-b211-5d93d87c9413 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:01.594827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-126ea348-b193-46fb-b211-5d93d87c9413 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.201346 Aug 24 06:18:01.595976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 90/183] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:01 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:01.679017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-10517bb7-59fd-4d94-b20b-ab171bd8c554 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:01.690683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-10517bb7-59fd-4d94-b20b-ab171bd8c554 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1219 microversion: 2.1 time: 0.135260 Aug 24 06:18:01.691863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 94/184] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:01 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1219 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:01.994053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:01.995048 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:02.004813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:02.004813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:02.005591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:02.006533 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:02.007256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:02.007873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:02.070996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:02.073249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:02.073249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:02.076229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.objects.instance [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lazy-loading 'fault' on Instance uuid 33183e35-cf61-4cfa-b5d4-9a9306648a1a {{(pid=121151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:18:02.139845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:02.166364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-131d76f2-8140-4227-973e-d6191d090a5c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1351 microversion: 2.1 time: 0.178317 Aug 24 06:18:02.180135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 91/185] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:01 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1351 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:02.616829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-89f444b8-df8b-4fef-b23c-b4bb806eb237 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:02.617620 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-89f444b8-df8b-4fef-b23c-b4bb806eb237 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:02.624524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89f444b8-df8b-4fef-b23c-b4bb806eb237 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:02.625111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89f444b8-df8b-4fef-b23c-b4bb806eb237 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:02.625702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89f444b8-df8b-4fef-b23c-b4bb806eb237 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:02.626561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89f444b8-df8b-4fef-b23c-b4bb806eb237 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:02.627054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89f444b8-df8b-4fef-b23c-b4bb806eb237 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:02.627474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89f444b8-df8b-4fef-b23c-b4bb806eb237 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:02.712959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ab10eeae-f323-4c8c-b411-43be20052043 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:02.713773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ab10eeae-f323-4c8c-b411-43be20052043 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:02.721071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab10eeae-f323-4c8c-b411-43be20052043 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:02.721557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab10eeae-f323-4c8c-b411-43be20052043 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:02.722437 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab10eeae-f323-4c8c-b411-43be20052043 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:02.723446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab10eeae-f323-4c8c-b411-43be20052043 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:02.723904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab10eeae-f323-4c8c-b411-43be20052043 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:02.724418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab10eeae-f323-4c8c-b411-43be20052043 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:02.791553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ab10eeae-f323-4c8c-b411-43be20052043 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:02.800181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ab10eeae-f323-4c8c-b411-43be20052043 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1219 microversion: 2.1 time: 0.092501 Aug 24 06:18:02.801967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 92/186] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:02 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:02.831372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-89f444b8-df8b-4fef-b23c-b4bb806eb237 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:02.839827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-89f444b8-df8b-4fef-b23c-b4bb806eb237 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.227686 Aug 24 06:18:02.840396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 95/187] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:02 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:03.187267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:03.187888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:03.194122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:03.194600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:03.195024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:03.195870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:03.196314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:03.196868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:03.242698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:03.243282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:03.243934 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:03.244557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.objects.instance [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lazy-loading 'fault' on Instance uuid 33183e35-cf61-4cfa-b5d4-9a9306648a1a {{(pid=121151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:18:03.301723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6021a225b5fd4377a9f8120a84232709', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8aa953e25943a197bec8ac5148a39c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:03.310265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-32c98941-8fec-414e-b914-dcd62e95940c tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 200 len: 1351 microversion: 2.1 time: 0.127091 Aug 24 06:18:03.310919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 93/188] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:03 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:03.820004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a78e980a-c963-4f22-b508-487d2619b020 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:03.820670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a78e980a-c963-4f22-b508-487d2619b020 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:03.827231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a78e980a-c963-4f22-b508-487d2619b020 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:03.828001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a78e980a-c963-4f22-b508-487d2619b020 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:03.829026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a78e980a-c963-4f22-b508-487d2619b020 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:03.829730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a78e980a-c963-4f22-b508-487d2619b020 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:03.830179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a78e980a-c963-4f22-b508-487d2619b020 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:03.830597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a78e980a-c963-4f22-b508-487d2619b020 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:03.860967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-93474bbe-e50f-4db0-b64c-6dd0772fab64 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:03.861927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-93474bbe-e50f-4db0-b64c-6dd0772fab64 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:03.863984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:03.868775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93474bbe-e50f-4db0-b64c-6dd0772fab64 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:03.869254 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93474bbe-e50f-4db0-b64c-6dd0772fab64 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:03.869678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93474bbe-e50f-4db0-b64c-6dd0772fab64 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:03.870396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93474bbe-e50f-4db0-b64c-6dd0772fab64 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:03.870838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93474bbe-e50f-4db0-b64c-6dd0772fab64 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:03.871246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93474bbe-e50f-4db0-b64c-6dd0772fab64 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:03.891691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a78e980a-c963-4f22-b508-487d2619b020 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:03.906047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a78e980a-c963-4f22-b508-487d2619b020 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1267 microversion: 2.1 time: 0.089935 Aug 24 06:18:03.906995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 96/189] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:03 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:04.006083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-93474bbe-e50f-4db0-b64c-6dd0772fab64 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:04.015550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-93474bbe-e50f-4db0-b64c-6dd0772fab64 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.158428 Aug 24 06:18:04.017376 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 94/190] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:03 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:04.332123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:04.333106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:04.339394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:04.339962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:04.340708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:04.341325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:04.350530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:04.350530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:04.356320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] HTTP exception thrown: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Request method failure captured: Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a HTTP/1.1 Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJK_OoymD0VQXA9gpyHmBpP-7aoeQNxaIN8QjkSeyXr7VplS5c4JvS_6mScuMCR7F3UIGfG5r8gAIOm9b4S6nhAYC78T4TSkmYJQ8GiDqYK_cZPWqSzAgArpQtD-ayzr5LEFi4xCPNJmLsYoTKNf4szKqIvEMKHQb9egofzT_SQmBo Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: ed8aa953e25943a197bec8ac5148a39c Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:18:04.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ed8aa953e25943a197bec8ac5148a39c", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: ed8aa953e25943a197bec8ac5148a39c Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-DeleteServersTestJSON-573770134-project Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 6021a225b5fd4377a9f8120a84232709 Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-DeleteServersTestJSON-573770134-project Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:04.362807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '33183e35-cf61-4cfa-b5d4-9a9306648a1a'} Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:18:04.363674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:04.365106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:04.366428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Returning 404 to user: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:18:04.366428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-77aebcae-e929-476c-a46f-cafa144b590a tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 404 len: 111 microversion: 2.1 time: 0.035163 Aug 24 06:18:04.366428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 97/191] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:04 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:18:04.510915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:04.513174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:04.519821 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:04.520307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:04.520790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:04.521481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:04.521972 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:04.522396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:04.534985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] HTTP exception thrown: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Request method failure captured: Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a/os-volume_attachments HTTP/1.1 Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcJK_OoymD0VQXA9gpyHmBpP-7aoeQNxaIN8QjkSeyXr7VplS5c4JvS_6mScuMCR7F3UIGfG5r8gAIOm9b4S6nhAYC78T4TSkmYJQ8GiDqYK_cZPWqSzAgArpQtD-ayzr5LEFi4xCPNJmLsYoTKNf4szKqIvEMKHQb9egofzT_SQmBo Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: ed8aa953e25943a197bec8ac5148a39c Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:18:04.539021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ed8aa953e25943a197bec8ac5148a39c", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: ed8aa953e25943a197bec8ac5148a39c Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-DeleteServersTestJSON-573770134-project Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 6021a225b5fd4377a9f8120a84232709 Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-DeleteServersTestJSON-573770134-project Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:04.540459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'server_id': '33183e35-cf61-4cfa-b5d4-9a9306648a1a'} Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:18:04.548046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:04.549545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:18:04.551177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Returning 404 to user: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:18:04.551177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-07987606-c50e-4fce-bfc3-e4300f1b9bf5 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034151 Aug 24 06:18:04.551177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 95/192] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:18:04 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:18:04.928323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-84d7b45f-6b4d-4640-9e6c-0dfdb60abc33 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:04.929612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-84d7b45f-6b4d-4640-9e6c-0dfdb60abc33 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:04.936815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84d7b45f-6b4d-4640-9e6c-0dfdb60abc33 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:04.937332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84d7b45f-6b4d-4640-9e6c-0dfdb60abc33 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:04.937939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84d7b45f-6b4d-4640-9e6c-0dfdb60abc33 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:04.938753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84d7b45f-6b4d-4640-9e6c-0dfdb60abc33 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:04.939267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84d7b45f-6b4d-4640-9e6c-0dfdb60abc33 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:04.939753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84d7b45f-6b4d-4640-9e6c-0dfdb60abc33 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:05.002068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-84d7b45f-6b4d-4640-9e6c-0dfdb60abc33 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:05.009708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-84d7b45f-6b4d-4640-9e6c-0dfdb60abc33 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1275 microversion: 2.1 time: 0.086431 Aug 24 06:18:05.010263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 98/193] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:04 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1275 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:05.038255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-94c867a1-562c-4089-97ea-dfd33a46c7ae tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:05.038879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-94c867a1-562c-4089-97ea-dfd33a46c7ae tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:05.045104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94c867a1-562c-4089-97ea-dfd33a46c7ae tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:05.045584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94c867a1-562c-4089-97ea-dfd33a46c7ae tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:05.046017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94c867a1-562c-4089-97ea-dfd33a46c7ae tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:05.046714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94c867a1-562c-4089-97ea-dfd33a46c7ae tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:05.047161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94c867a1-562c-4089-97ea-dfd33a46c7ae tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:05.047580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94c867a1-562c-4089-97ea-dfd33a46c7ae tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:05.175584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-94c867a1-562c-4089-97ea-dfd33a46c7ae tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:05.183516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-94c867a1-562c-4089-97ea-dfd33a46c7ae tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.149195 Aug 24 06:18:05.184100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 96/194] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:05 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:05.895773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:05.896270 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:05.902803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:05.903290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:05.903721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:05.904415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:05.904908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:05.905327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:05.919387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] HTTP exception thrown: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Request method failure captured: Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: DELETE /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a HTTP/1.1 Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJK_OoymD0VQXA9gpyHmBpP-7aoeQNxaIN8QjkSeyXr7VplS5c4JvS_6mScuMCR7F3UIGfG5r8gAIOm9b4S6nhAYC78T4TSkmYJQ8GiDqYK_cZPWqSzAgArpQtD-ayzr5LEFi4xCPNJmLsYoTKNf4szKqIvEMKHQb9egofzT_SQmBo Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: ed8aa953e25943a197bec8ac5148a39c Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:18:05.920967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ed8aa953e25943a197bec8ac5148a39c", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: ed8aa953e25943a197bec8ac5148a39c Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-DeleteServersTestJSON-573770134-project Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 6021a225b5fd4377a9f8120a84232709 Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-DeleteServersTestJSON-573770134-project Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:05.922273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '33183e35-cf61-4cfa-b5d4-9a9306648a1a'} Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:18:05.922996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:05.924083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:05.930696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Returning 404 to user: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:18:05.930696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9779ae5f-3c87-4206-afea-0433c314aaa7 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "DELETE /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 404 len: 111 microversion: 2.1 time: 0.030476 Aug 24 06:18:05.930696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 99/195] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:18:05 2022] DELETE /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:18:05.936596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:05.937203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] [instance: 33183e35-cf61-4cfa-b5d4-9a9306648a1a] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:05.943754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:05.944239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:05.944713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:05.945567 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:05.946172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:05.946734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:05.966688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] HTTP exception thrown: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Request method failure captured: Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a HTTP/1.1 Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcJK_OoymD0VQXA9gpyHmBpP-7aoeQNxaIN8QjkSeyXr7VplS5c4JvS_6mScuMCR7F3UIGfG5r8gAIOm9b4S6nhAYC78T4TSkmYJQ8GiDqYK_cZPWqSzAgArpQtD-ayzr5LEFi4xCPNJmLsYoTKNf4szKqIvEMKHQb9egofzT_SQmBo Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: ed8aa953e25943a197bec8ac5148a39c Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:18:05.971244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ed8aa953e25943a197bec8ac5148a39c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ed8aa953e25943a197bec8ac5148a39c", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: ed8aa953e25943a197bec8ac5148a39c Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-DeleteServersTestJSON-573770134 Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-DeleteServersTestJSON-573770134-project Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 6021a225b5fd4377a9f8120a84232709 Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-DeleteServersTestJSON-573770134-project Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:05.973822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '33183e35-cf61-4cfa-b5d4-9a9306648a1a'} Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:18:05.974638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. Aug 24 06:18:05.975853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:18:05.977847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] Returning 404 to user: Instance 33183e35-cf61-4cfa-b5d4-9a9306648a1a could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:18:05.978882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7a0102fc-35b2-49b5-a962-128bf0803d10 tempest-DeleteServersTestJSON-573770134 tempest-DeleteServersTestJSON-573770134-project] 10.222.0.62 "GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a" status: 404 len: 111 microversion: 2.1 time: 0.046150 Aug 24 06:18:05.983749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 97/196] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:05 2022] GET /compute/v2.1/servers/33183e35-cf61-4cfa-b5d4-9a9306648a1a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:18:06.031517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dd0ea090-110a-495e-b105-cfec729f4bab tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:06.032131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dd0ea090-110a-495e-b105-cfec729f4bab tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:06.039363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd0ea090-110a-495e-b105-cfec729f4bab tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:06.040528 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd0ea090-110a-495e-b105-cfec729f4bab tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:06.041142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd0ea090-110a-495e-b105-cfec729f4bab tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:06.042255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd0ea090-110a-495e-b105-cfec729f4bab tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:06.042918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd0ea090-110a-495e-b105-cfec729f4bab tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:06.043557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd0ea090-110a-495e-b105-cfec729f4bab tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:06.204547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-48c54720-dfbf-480d-99c3-aa1158134f5d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:06.205137 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-48c54720-dfbf-480d-99c3-aa1158134f5d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:06.213858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48c54720-dfbf-480d-99c3-aa1158134f5d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:06.215841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48c54720-dfbf-480d-99c3-aa1158134f5d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:06.220281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48c54720-dfbf-480d-99c3-aa1158134f5d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:06.221225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48c54720-dfbf-480d-99c3-aa1158134f5d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:06.224741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48c54720-dfbf-480d-99c3-aa1158134f5d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:06.224741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48c54720-dfbf-480d-99c3-aa1158134f5d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:06.287539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dd0ea090-110a-495e-b105-cfec729f4bab tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:06.300568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dd0ea090-110a-495e-b105-cfec729f4bab tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1315 microversion: 2.1 time: 0.272281 Aug 24 06:18:06.301079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 100/197] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:06 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:06.487146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-48c54720-dfbf-480d-99c3-aa1158134f5d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:06.495987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-48c54720-dfbf-480d-99c3-aa1158134f5d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.295727 Aug 24 06:18:06.510307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 98/198] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:06 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:07.097787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-ffac1fdb-30dd-4de0-ac34-3e78a1a251f9 req-3430e19e-8a03-49d3-bcfc-57eb99b7b20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a29adfd-cbea-4185-9068-1d9cc3e78fcb", "tag": "846bde06-928f-4a38-bd61-c20bf27bd042"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:07.114604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-ffac1fdb-30dd-4de0-ac34-3e78a1a251f9 req-3430e19e-8a03-49d3-bcfc-57eb99b7b20c service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:07.120055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-ffac1fdb-30dd-4de0-ac34-3e78a1a251f9 req-3430e19e-8a03-49d3-bcfc-57eb99b7b20c service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:07.120055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-ffac1fdb-30dd-4de0-ac34-3e78a1a251f9 req-3430e19e-8a03-49d3-bcfc-57eb99b7b20c service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:07.132120 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-ffac1fdb-30dd-4de0-ac34-3e78a1a251f9 req-3430e19e-8a03-49d3-bcfc-57eb99b7b20c service nova] Creating event network-changed:846bde06-928f-4a38-bd61-c20bf27bd042 for instance 4a29adfd-cbea-4185-9068-1d9cc3e78fcb on hv-cinder-85426 Aug 24 06:18:07.137851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-ffac1fdb-30dd-4de0-ac34-3e78a1a251f9 req-3430e19e-8a03-49d3-bcfc-57eb99b7b20c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044556 Aug 24 06:18:07.138808 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 101/199] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:07.331768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b0f2e5dc-a239-4a42-9388-1a27231916fb tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:07.332385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b0f2e5dc-a239-4a42-9388-1a27231916fb tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:07.339073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f2e5dc-a239-4a42-9388-1a27231916fb tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:07.339790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f2e5dc-a239-4a42-9388-1a27231916fb tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:07.340296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f2e5dc-a239-4a42-9388-1a27231916fb tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:07.341046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f2e5dc-a239-4a42-9388-1a27231916fb tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:07.341475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f2e5dc-a239-4a42-9388-1a27231916fb tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:07.342053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f2e5dc-a239-4a42-9388-1a27231916fb tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:07.519547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c7db56e1-cade-481a-8454-7a0d2f5f513e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:07.524511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c7db56e1-cade-481a-8454-7a0d2f5f513e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:07.539670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7db56e1-cade-481a-8454-7a0d2f5f513e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:07.540471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7db56e1-cade-481a-8454-7a0d2f5f513e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:07.541707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7db56e1-cade-481a-8454-7a0d2f5f513e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:07.542687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7db56e1-cade-481a-8454-7a0d2f5f513e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:07.543385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7db56e1-cade-481a-8454-7a0d2f5f513e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:07.543969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7db56e1-cade-481a-8454-7a0d2f5f513e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:07.714344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b0f2e5dc-a239-4a42-9388-1a27231916fb tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:07.729465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b0f2e5dc-a239-4a42-9388-1a27231916fb tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1315 microversion: 2.1 time: 0.395661 Aug 24 06:18:07.740664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 99/200] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:07 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:07.884722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c7db56e1-cade-481a-8454-7a0d2f5f513e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:07.892671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c7db56e1-cade-481a-8454-7a0d2f5f513e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.378494 Aug 24 06:18:07.893526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 102/201] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:07 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:08.750835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f907facf-90d9-447e-9579-b24e67dbc77b tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:08.752247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f907facf-90d9-447e-9579-b24e67dbc77b tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:08.759657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f907facf-90d9-447e-9579-b24e67dbc77b tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:08.760689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f907facf-90d9-447e-9579-b24e67dbc77b tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:08.766556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f907facf-90d9-447e-9579-b24e67dbc77b tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:08.767709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f907facf-90d9-447e-9579-b24e67dbc77b tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:08.768193 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f907facf-90d9-447e-9579-b24e67dbc77b tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:08.768853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f907facf-90d9-447e-9579-b24e67dbc77b tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:08.915749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-118922df-57f5-47d7-a7cd-ac6698cd6bb3 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:08.917275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-118922df-57f5-47d7-a7cd-ac6698cd6bb3 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:08.933886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-118922df-57f5-47d7-a7cd-ac6698cd6bb3 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:08.936256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-118922df-57f5-47d7-a7cd-ac6698cd6bb3 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:08.938761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-118922df-57f5-47d7-a7cd-ac6698cd6bb3 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:08.939769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-118922df-57f5-47d7-a7cd-ac6698cd6bb3 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:08.942069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-118922df-57f5-47d7-a7cd-ac6698cd6bb3 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:08.943328 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-118922df-57f5-47d7-a7cd-ac6698cd6bb3 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:08.977540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:09.052579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f907facf-90d9-447e-9579-b24e67dbc77b tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:09.064019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f907facf-90d9-447e-9579-b24e67dbc77b tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1315 microversion: 2.1 time: 0.316048 Aug 24 06:18:09.079669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 100/202] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:08 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:09.132102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-118922df-57f5-47d7-a7cd-ac6698cd6bb3 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:09.140031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-118922df-57f5-47d7-a7cd-ac6698cd6bb3 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.228695 Aug 24 06:18:09.141659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 103/203] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:08 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:10.092328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-95657528-05dd-46ec-8d64-c1a3551eb4cd tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:10.093185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-95657528-05dd-46ec-8d64-c1a3551eb4cd tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:10.104766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95657528-05dd-46ec-8d64-c1a3551eb4cd tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:10.105508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95657528-05dd-46ec-8d64-c1a3551eb4cd tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:10.105933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95657528-05dd-46ec-8d64-c1a3551eb4cd tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:10.106823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95657528-05dd-46ec-8d64-c1a3551eb4cd tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:10.107272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95657528-05dd-46ec-8d64-c1a3551eb4cd tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:10.107686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95657528-05dd-46ec-8d64-c1a3551eb4cd tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:10.112236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:10.164992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2caefb0c-4d8f-4197-a62b-951c80bb5545 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:10.166133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2caefb0c-4d8f-4197-a62b-951c80bb5545 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:10.169501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:10.176078 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2caefb0c-4d8f-4197-a62b-951c80bb5545 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:10.176704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2caefb0c-4d8f-4197-a62b-951c80bb5545 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:10.177549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2caefb0c-4d8f-4197-a62b-951c80bb5545 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:10.177836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2caefb0c-4d8f-4197-a62b-951c80bb5545 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:10.178286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2caefb0c-4d8f-4197-a62b-951c80bb5545 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:10.178706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2caefb0c-4d8f-4197-a62b-951c80bb5545 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:10.303360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-95657528-05dd-46ec-8d64-c1a3551eb4cd tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:10.312580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-95657528-05dd-46ec-8d64-c1a3551eb4cd tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1315 microversion: 2.1 time: 0.227423 Aug 24 06:18:10.313680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 101/204] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:10 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:10.337215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2caefb0c-4d8f-4197-a62b-951c80bb5545 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:10.347158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2caefb0c-4d8f-4197-a62b-951c80bb5545 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.186885 Aug 24 06:18:10.347745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 104/205] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:10 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:10.532968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-80108761-5734-40d2-bd4c-e4feeda4254e req-c47df4d6-88ff-4c3c-b067-5a66d2205c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967afe19-8139-4888-ae38-b682c1188c8f", "name": "network-vif-plugged", "status": "completed", "tag": "284c413d-f37f-41e3-a049-9aeaaa40a0c8"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:10.538648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=8 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:10.550131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-80108761-5734-40d2-bd4c-e4feeda4254e req-c47df4d6-88ff-4c3c-b067-5a66d2205c2a service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:10.553331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-80108761-5734-40d2-bd4c-e4feeda4254e req-c47df4d6-88ff-4c3c-b067-5a66d2205c2a service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:10.553331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-80108761-5734-40d2-bd4c-e4feeda4254e req-c47df4d6-88ff-4c3c-b067-5a66d2205c2a service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:10.569366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-80108761-5734-40d2-bd4c-e4feeda4254e req-c47df4d6-88ff-4c3c-b067-5a66d2205c2a service nova] Creating event network-vif-plugged:284c413d-f37f-41e3-a049-9aeaaa40a0c8 for instance 967afe19-8139-4888-ae38-b682c1188c8f on hv-cinder-85426 Aug 24 06:18:10.574432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-80108761-5734-40d2-bd4c-e4feeda4254e req-c47df4d6-88ff-4c3c-b067-5a66d2205c2a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045685 Aug 24 06:18:10.576722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 102/206] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:11.334430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-44acea9a-fc89-4866-aa26-1adc01c2c3a1 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:11.334808 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-44acea9a-fc89-4866-aa26-1adc01c2c3a1 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:11.341039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44acea9a-fc89-4866-aa26-1adc01c2c3a1 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:11.341513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44acea9a-fc89-4866-aa26-1adc01c2c3a1 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:11.341936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44acea9a-fc89-4866-aa26-1adc01c2c3a1 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:11.342613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44acea9a-fc89-4866-aa26-1adc01c2c3a1 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:11.343055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44acea9a-fc89-4866-aa26-1adc01c2c3a1 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:11.343461 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44acea9a-fc89-4866-aa26-1adc01c2c3a1 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:11.369139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a5d85f68-0807-43cd-a690-350acfe8ad2a tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:11.369826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a5d85f68-0807-43cd-a690-350acfe8ad2a tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:11.376928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5d85f68-0807-43cd-a690-350acfe8ad2a tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:11.377407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5d85f68-0807-43cd-a690-350acfe8ad2a tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:11.377835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5d85f68-0807-43cd-a690-350acfe8ad2a tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:11.378525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5d85f68-0807-43cd-a690-350acfe8ad2a tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:11.378995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5d85f68-0807-43cd-a690-350acfe8ad2a tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:11.379452 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5d85f68-0807-43cd-a690-350acfe8ad2a tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:11.536520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a5d85f68-0807-43cd-a690-350acfe8ad2a tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:11.550946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a5d85f68-0807-43cd-a690-350acfe8ad2a tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.186822 Aug 24 06:18:11.551532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 103/207] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:11 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:11.561661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-44acea9a-fc89-4866-aa26-1adc01c2c3a1 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:11.570575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-44acea9a-fc89-4866-aa26-1adc01c2c3a1 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1315 microversion: 2.1 time: 0.240673 Aug 24 06:18:11.571146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 105/208] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:11 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:12.580399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fba3cfc5-7c0d-46c6-b810-6da7d65a454b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:12.580399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fba3cfc5-7c0d-46c6-b810-6da7d65a454b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:12.587608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fba3cfc5-7c0d-46c6-b810-6da7d65a454b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:12.588270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fba3cfc5-7c0d-46c6-b810-6da7d65a454b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:12.588895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fba3cfc5-7c0d-46c6-b810-6da7d65a454b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:12.589595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fba3cfc5-7c0d-46c6-b810-6da7d65a454b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:12.590047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fba3cfc5-7c0d-46c6-b810-6da7d65a454b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:12.590620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fba3cfc5-7c0d-46c6-b810-6da7d65a454b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:12.591373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7e4cf622-7d06-434f-8eb8-4bf8f4755710 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:12.592286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7e4cf622-7d06-434f-8eb8-4bf8f4755710 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:12.603395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e4cf622-7d06-434f-8eb8-4bf8f4755710 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:12.603847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e4cf622-7d06-434f-8eb8-4bf8f4755710 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:12.604277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e4cf622-7d06-434f-8eb8-4bf8f4755710 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:12.605007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e4cf622-7d06-434f-8eb8-4bf8f4755710 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:12.605452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e4cf622-7d06-434f-8eb8-4bf8f4755710 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:12.605861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e4cf622-7d06-434f-8eb8-4bf8f4755710 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:12.757422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fba3cfc5-7c0d-46c6-b810-6da7d65a454b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:12.767792 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fba3cfc5-7c0d-46c6-b810-6da7d65a454b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1358 microversion: 2.1 time: 0.199499 Aug 24 06:18:12.768744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 104/209] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:12 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:12.783732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7e4cf622-7d06-434f-8eb8-4bf8f4755710 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:12.791849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7e4cf622-7d06-434f-8eb8-4bf8f4755710 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1315 microversion: 2.1 time: 0.204504 Aug 24 06:18:12.792419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 106/210] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:12 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:13.789432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0556ca3e-fcc3-43c5-8bae-5569fbace829 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:13.789970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0556ca3e-fcc3-43c5-8bae-5569fbace829 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:13.795866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0556ca3e-fcc3-43c5-8bae-5569fbace829 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:13.796346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0556ca3e-fcc3-43c5-8bae-5569fbace829 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:13.805937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0556ca3e-fcc3-43c5-8bae-5569fbace829 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:13.805937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0556ca3e-fcc3-43c5-8bae-5569fbace829 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:13.805937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0556ca3e-fcc3-43c5-8bae-5569fbace829 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:13.805937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0556ca3e-fcc3-43c5-8bae-5569fbace829 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:13.816574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f045d985-c509-4656-9374-9dd04a1e7f7a tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:13.817224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f045d985-c509-4656-9374-9dd04a1e7f7a tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:13.830000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f045d985-c509-4656-9374-9dd04a1e7f7a tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:13.830487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f045d985-c509-4656-9374-9dd04a1e7f7a tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:13.830912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f045d985-c509-4656-9374-9dd04a1e7f7a tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:13.831790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f045d985-c509-4656-9374-9dd04a1e7f7a tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:13.832907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f045d985-c509-4656-9374-9dd04a1e7f7a tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:13.833327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f045d985-c509-4656-9374-9dd04a1e7f7a tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:13.972010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f045d985-c509-4656-9374-9dd04a1e7f7a tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:13.979988 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f045d985-c509-4656-9374-9dd04a1e7f7a tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1315 microversion: 2.1 time: 0.167060 Aug 24 06:18:13.992808 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 107/211] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:13 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:14.007371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0556ca3e-fcc3-43c5-8bae-5569fbace829 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:14.016170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0556ca3e-fcc3-43c5-8bae-5569fbace829 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1548 microversion: 2.1 time: 0.230048 Aug 24 06:18:14.017421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 105/212] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:13 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1548 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:14.038949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-638f4198-5d40-4f7b-b7e8-a18ee1d3e2a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:14.041043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-638f4198-5d40-4f7b-b7e8-a18ee1d3e2a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:14.046591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-638f4198-5d40-4f7b-b7e8-a18ee1d3e2a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:14.047769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-638f4198-5d40-4f7b-b7e8-a18ee1d3e2a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:14.048202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-638f4198-5d40-4f7b-b7e8-a18ee1d3e2a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:14.048962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-638f4198-5d40-4f7b-b7e8-a18ee1d3e2a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:14.049406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-638f4198-5d40-4f7b-b7e8-a18ee1d3e2a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:14.050072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-638f4198-5d40-4f7b-b7e8-a18ee1d3e2a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:14.197463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-638f4198-5d40-4f7b-b7e8-a18ee1d3e2a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:14.208537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-638f4198-5d40-4f7b-b7e8-a18ee1d3e2a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1548 microversion: 2.1 time: 0.173636 Aug 24 06:18:14.209155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 108/213] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:14 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:14.229010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7f837245-1e63-4ace-a228-7b1367a91caf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:14.233775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7f837245-1e63-4ace-a228-7b1367a91caf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:14.235979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7f837245-1e63-4ace-a228-7b1367a91caf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Searching by: {'deleted': False, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41'} {{(pid=121151) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 06:18:14.243732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f837245-1e63-4ace-a228-7b1367a91caf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:14.244414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f837245-1e63-4ace-a228-7b1367a91caf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:14.244877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f837245-1e63-4ace-a228-7b1367a91caf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:14.246003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f837245-1e63-4ace-a228-7b1367a91caf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:14.246607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f837245-1e63-4ace-a228-7b1367a91caf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:14.247315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f837245-1e63-4ace-a228-7b1367a91caf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:14.348774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.multi_cell_list [None req-7f837245-1e63-4ace-a228-7b1367a91caf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121151) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 06:18:14.454805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7f837245-1e63-4ace-a228-7b1367a91caf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.229528 Aug 24 06:18:14.455394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 106/214] 10.222.0.62 () {58 vars in 1125 bytes} [Wed Aug 24 06:18:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:14.469909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4f32a63a-3b17-4779-aebd-98ebb89e3745 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:14.469909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4f32a63a-3b17-4779-aebd-98ebb89e3745 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:14.476272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f32a63a-3b17-4779-aebd-98ebb89e3745 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:14.476996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f32a63a-3b17-4779-aebd-98ebb89e3745 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:14.479542 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f32a63a-3b17-4779-aebd-98ebb89e3745 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:14.480560 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f32a63a-3b17-4779-aebd-98ebb89e3745 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:14.481028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f32a63a-3b17-4779-aebd-98ebb89e3745 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:14.481447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f32a63a-3b17-4779-aebd-98ebb89e3745 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:14.519237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-8dc0c681-ba76-4a91-8353-7a3b2d7e8f93 req-9bf3de60-d2d6-42e4-8121-82fc1bf9ee73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a29adfd-cbea-4185-9068-1d9cc3e78fcb", "name": "network-vif-plugged", "status": "completed", "tag": "846bde06-928f-4a38-bd61-c20bf27bd042"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:14.534654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-8dc0c681-ba76-4a91-8353-7a3b2d7e8f93 req-9bf3de60-d2d6-42e4-8121-82fc1bf9ee73 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:14.535131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-8dc0c681-ba76-4a91-8353-7a3b2d7e8f93 req-9bf3de60-d2d6-42e4-8121-82fc1bf9ee73 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:14.535550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-8dc0c681-ba76-4a91-8353-7a3b2d7e8f93 req-9bf3de60-d2d6-42e4-8121-82fc1bf9ee73 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:14.551724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-8dc0c681-ba76-4a91-8353-7a3b2d7e8f93 req-9bf3de60-d2d6-42e4-8121-82fc1bf9ee73 service nova] Creating event network-vif-plugged:846bde06-928f-4a38-bd61-c20bf27bd042 for instance 4a29adfd-cbea-4185-9068-1d9cc3e78fcb on hv-cinder-85426 Aug 24 06:18:14.557126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-8dc0c681-ba76-4a91-8353-7a3b2d7e8f93 req-9bf3de60-d2d6-42e4-8121-82fc1bf9ee73 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041979 Aug 24 06:18:14.560626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 107/215] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:18:14.639319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4f32a63a-3b17-4779-aebd-98ebb89e3745 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:14.654700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4f32a63a-3b17-4779-aebd-98ebb89e3745 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1548 microversion: 2.1 time: 0.190915 Aug 24 06:18:14.659382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 109/216] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:14 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1548 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:15.002676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a6e73d73-01ca-449a-a3b2-f38705807ab7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:15.003606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a6e73d73-01ca-449a-a3b2-f38705807ab7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:15.010579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6e73d73-01ca-449a-a3b2-f38705807ab7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:15.011062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6e73d73-01ca-449a-a3b2-f38705807ab7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:15.011493 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6e73d73-01ca-449a-a3b2-f38705807ab7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:15.012188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6e73d73-01ca-449a-a3b2-f38705807ab7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:15.012667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6e73d73-01ca-449a-a3b2-f38705807ab7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:15.013089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6e73d73-01ca-449a-a3b2-f38705807ab7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:15.177596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a6e73d73-01ca-449a-a3b2-f38705807ab7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:15.191909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a6e73d73-01ca-449a-a3b2-f38705807ab7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1315 microversion: 2.1 time: 0.194302 Aug 24 06:18:15.192899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 108/217] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:14 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:16.212740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-26b1dc27-ebfb-4fca-bc6a-c620fde90c94 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:16.213367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-26b1dc27-ebfb-4fca-bc6a-c620fde90c94 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:16.215833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:16.221502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26b1dc27-ebfb-4fca-bc6a-c620fde90c94 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:16.221980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26b1dc27-ebfb-4fca-bc6a-c620fde90c94 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:16.226189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26b1dc27-ebfb-4fca-bc6a-c620fde90c94 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:16.226189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26b1dc27-ebfb-4fca-bc6a-c620fde90c94 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:16.226189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26b1dc27-ebfb-4fca-bc6a-c620fde90c94 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:16.226189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26b1dc27-ebfb-4fca-bc6a-c620fde90c94 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:16.728990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-26b1dc27-ebfb-4fca-bc6a-c620fde90c94 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:16.737682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-26b1dc27-ebfb-4fca-bc6a-c620fde90c94 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1315 microversion: 2.1 time: 0.528577 Aug 24 06:18:16.739598 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 110/218] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:16 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1315 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:16.762445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-47e8828a-4d89-4c7f-b45f-12a62d03e5d6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37d02100-2d5b-47c5-bcf9-8a8858aac1be"}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:16.767136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-47e8828a-4d89-4c7f-b45f-12a62d03e5d6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:16.789266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e8828a-4d89-4c7f-b45f-12a62d03e5d6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:16.789743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e8828a-4d89-4c7f-b45f-12a62d03e5d6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:16.793064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e8828a-4d89-4c7f-b45f-12a62d03e5d6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:16.795387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e8828a-4d89-4c7f-b45f-12a62d03e5d6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:16.795856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e8828a-4d89-4c7f-b45f-12a62d03e5d6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:16.796277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e8828a-4d89-4c7f-b45f-12a62d03e5d6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:17.739185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-47e8828a-4d89-4c7f-b45f-12a62d03e5d6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "POST /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.987155 Aug 24 06:18:17.739185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 109/219] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 24 06:18:16 2022] POST /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments => generated 194 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:17.765789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c36fa7b2-b3b5-4df4-aedb-85f3aa9a67d7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:17.767034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c36fa7b2-b3b5-4df4-aedb-85f3aa9a67d7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:17.776391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c36fa7b2-b3b5-4df4-aedb-85f3aa9a67d7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:17.776928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c36fa7b2-b3b5-4df4-aedb-85f3aa9a67d7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:17.777361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c36fa7b2-b3b5-4df4-aedb-85f3aa9a67d7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:17.778102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c36fa7b2-b3b5-4df4-aedb-85f3aa9a67d7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:17.778548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c36fa7b2-b3b5-4df4-aedb-85f3aa9a67d7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:17.778963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c36fa7b2-b3b5-4df4-aedb-85f3aa9a67d7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:18.011918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c36fa7b2-b3b5-4df4-aedb-85f3aa9a67d7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:18.021658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c36fa7b2-b3b5-4df4-aedb-85f3aa9a67d7 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1465 microversion: 2.1 time: 0.261412 Aug 24 06:18:18.036718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 111/220] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:17 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1465 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:18.070799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6360fb22-3a57-459e-9d9f-8434882abf78 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:18.071709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6360fb22-3a57-459e-9d9f-8434882abf78 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:18.079238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6360fb22-3a57-459e-9d9f-8434882abf78 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:18.079819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6360fb22-3a57-459e-9d9f-8434882abf78 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:18.080547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6360fb22-3a57-459e-9d9f-8434882abf78 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:18.081489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6360fb22-3a57-459e-9d9f-8434882abf78 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:18.081950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6360fb22-3a57-459e-9d9f-8434882abf78 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:18.082560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6360fb22-3a57-459e-9d9f-8434882abf78 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:18.111921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6360fb22-3a57-459e-9d9f-8434882abf78 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:18:18.474746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6360fb22-3a57-459e-9d9f-8434882abf78 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "DELETE /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 204 len: 0 microversion: 2.1 time: 0.408163 Aug 24 06:18:18.475574 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 110/221] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:18:18 2022] DELETE /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:18:18.493642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5c71a5a3-533e-4821-a86e-5d3ff4b15afc tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:18.494466 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5c71a5a3-533e-4821-a86e-5d3ff4b15afc tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:18.502056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c71a5a3-533e-4821-a86e-5d3ff4b15afc tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:18.502769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c71a5a3-533e-4821-a86e-5d3ff4b15afc tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:18.503225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c71a5a3-533e-4821-a86e-5d3ff4b15afc tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:18.503932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c71a5a3-533e-4821-a86e-5d3ff4b15afc tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:18.504401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c71a5a3-533e-4821-a86e-5d3ff4b15afc tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:18.504860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c71a5a3-533e-4821-a86e-5d3ff4b15afc tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:18.526931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:18.769591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5c71a5a3-533e-4821-a86e-5d3ff4b15afc tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:18.782950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5c71a5a3-533e-4821-a86e-5d3ff4b15afc tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1471 microversion: 2.1 time: 0.294237 Aug 24 06:18:18.800985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 112/222] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:18 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:19.077940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-10540870-682c-4593-b384-614f00abae78 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:19.078855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-10540870-682c-4593-b384-614f00abae78 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:19.085279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10540870-682c-4593-b384-614f00abae78 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:19.085962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10540870-682c-4593-b384-614f00abae78 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:19.086392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10540870-682c-4593-b384-614f00abae78 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:19.087090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10540870-682c-4593-b384-614f00abae78 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:19.087572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10540870-682c-4593-b384-614f00abae78 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:19.088145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10540870-682c-4593-b384-614f00abae78 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:19.115804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-10540870-682c-4593-b384-614f00abae78 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/ips" status: 200 len: 153 microversion: 2.20 time: 0.042253 Aug 24 06:18:19.116534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 111/223] 10.222.0.62 () {60 vars in 1289 bytes} [Wed Aug 24 06:18:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:18:19.806622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6e7981b1-6fae-4472-9cbc-b7a3fffb1548 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:19.807643 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6e7981b1-6fae-4472-9cbc-b7a3fffb1548 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:19.817222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e7981b1-6fae-4472-9cbc-b7a3fffb1548 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:19.817795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e7981b1-6fae-4472-9cbc-b7a3fffb1548 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:19.818454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e7981b1-6fae-4472-9cbc-b7a3fffb1548 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:19.819228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e7981b1-6fae-4472-9cbc-b7a3fffb1548 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:19.819857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e7981b1-6fae-4472-9cbc-b7a3fffb1548 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:19.820322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e7981b1-6fae-4472-9cbc-b7a3fffb1548 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:19.828119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1289407327", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:19.914001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.network.neutron [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] validate_networks() for [('ee7126af-d800-4d07-9c4c-d1b903e93663', None, None, None, None, None)] {{(pid=121150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:18:19.992000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6e7981b1-6fae-4472-9cbc-b7a3fffb1548 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:20.016275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6e7981b1-6fae-4472-9cbc-b7a3fffb1548 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1471 microversion: 2.1 time: 0.214629 Aug 24 06:18:20.017253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 112/224] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:19 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:20.465826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Flavor limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:18:20.466271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Image limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:18:20.466723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Flavor pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:18:20.467133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Image pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:18:20.467723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:18:20.478946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:20.479316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:20.479747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:20.480472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:20.480945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:20.481358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:20.509424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Getting quotas for project c467d980c962456c9fa0e28364efd2a3. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:18:20.517541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Getting quotas for user 069dc6f771a74dd4ab22d9d5e68e3cc9 and project c467d980c962456c9fa0e28364efd2a3. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:18:20.532428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Going to run 1 instances... {{(pid=121150) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:18:20.536748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:18:20.682573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-16217da5-862d-4912-b985-49a6c7cb5656 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.005705 Aug 24 06:18:20.690805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 113/225] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:18:19 2022] POST /compute/v2.1/servers => generated 383 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:18:20.717507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3dd72980-6b85-4ef2-905e-b76a4daae34a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:20.724368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3dd72980-6b85-4ef2-905e-b76a4daae34a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:21.037936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a371b891-059f-4c02-973c-76d63e8727ed tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:21.038552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a371b891-059f-4c02-973c-76d63e8727ed tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:21.046184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a371b891-059f-4c02-973c-76d63e8727ed tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:21.046719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a371b891-059f-4c02-973c-76d63e8727ed tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:21.047155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a371b891-059f-4c02-973c-76d63e8727ed tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:21.047860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a371b891-059f-4c02-973c-76d63e8727ed tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:21.048403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a371b891-059f-4c02-973c-76d63e8727ed tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:21.048788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a371b891-059f-4c02-973c-76d63e8727ed tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:21.191848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3dd72980-6b85-4ef2-905e-b76a4daae34a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:21.204242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3dd72980-6b85-4ef2-905e-b76a4daae34a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1222 microversion: 2.1 time: 0.509283 Aug 24 06:18:21.215361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a371b891-059f-4c02-973c-76d63e8727ed tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:21.215526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 113/226] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:20 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1222 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:21.230530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a371b891-059f-4c02-973c-76d63e8727ed tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1471 microversion: 2.1 time: 0.196150 Aug 24 06:18:21.232097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 114/227] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:21 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1471 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:21.292244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1911562444", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:21.354816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] validate_networks() for [('ee7126af-d800-4d07-9c4c-d1b903e93663', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:18:21.688183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-0b3f3c32-c5f1-41f9-8ae5-451f2cc63703 req-2087828c-b9d2-4e7e-8a6e-8ff2d806d4c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a29adfd-cbea-4185-9068-1d9cc3e78fcb", "name": "network-vif-deleted", "tag": "846bde06-928f-4a38-bd61-c20bf27bd042"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:21.706574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-0b3f3c32-c5f1-41f9-8ae5-451f2cc63703 req-2087828c-b9d2-4e7e-8a6e-8ff2d806d4c4 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:21.707293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-0b3f3c32-c5f1-41f9-8ae5-451f2cc63703 req-2087828c-b9d2-4e7e-8a6e-8ff2d806d4c4 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:21.708468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-0b3f3c32-c5f1-41f9-8ae5-451f2cc63703 req-2087828c-b9d2-4e7e-8a6e-8ff2d806d4c4 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:21.735324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-0b3f3c32-c5f1-41f9-8ae5-451f2cc63703 req-2087828c-b9d2-4e7e-8a6e-8ff2d806d4c4 service nova] Creating event network-vif-deleted:846bde06-928f-4a38-bd61-c20bf27bd042 for instance 4a29adfd-cbea-4185-9068-1d9cc3e78fcb on hv-cinder-85426 Aug 24 06:18:21.745401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-0b3f3c32-c5f1-41f9-8ae5-451f2cc63703 req-2087828c-b9d2-4e7e-8a6e-8ff2d806d4c4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068259 Aug 24 06:18:21.748347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 115/228] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:18:21.927122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:18:21.928614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:18:21.933856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:18:21.933856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:18:21.933856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:18:21.945416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:21.946005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:21.946604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:21.947442 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:21.948020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:21.948735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:21.978640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Getting quotas for project c467d980c962456c9fa0e28364efd2a3. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:18:21.983473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Getting quotas for user 069dc6f771a74dd4ab22d9d5e68e3cc9 and project c467d980c962456c9fa0e28364efd2a3. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:18:21.997445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:18:22.001699 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:18:22.165994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b7758df3-e5a9-4d26-a641-290ce9ba9a4b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.877743 Aug 24 06:18:22.168324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 114/229] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:18:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:18:22.188711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0189419a-f02a-41f3-b363-87dc7b07159d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:22.196051 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0189419a-f02a-41f3-b363-87dc7b07159d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:22.216976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-114be613-31f8-42c4-80d0-b2b27463836b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:22.220997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-114be613-31f8-42c4-80d0-b2b27463836b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:22.229479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0189419a-f02a-41f3-b363-87dc7b07159d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:22.231617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0189419a-f02a-41f3-b363-87dc7b07159d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:22.232738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0189419a-f02a-41f3-b363-87dc7b07159d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:22.234224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0189419a-f02a-41f3-b363-87dc7b07159d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:22.235590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0189419a-f02a-41f3-b363-87dc7b07159d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:22.236534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0189419a-f02a-41f3-b363-87dc7b07159d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:22.318561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0189419a-f02a-41f3-b363-87dc7b07159d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/ips" status: 200 len: 149 microversion: 2.1 time: 0.145536 Aug 24 06:18:22.319940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 116/230] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 24 06:18:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/ips => generated 149 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:22.326139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-114be613-31f8-42c4-80d0-b2b27463836b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:22.334892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:22.335501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:22.338802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-114be613-31f8-42c4-80d0-b2b27463836b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1222 microversion: 2.1 time: 0.150711 Aug 24 06:18:22.339455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 115/231] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:22 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1222 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:22.351916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:22.351916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:22.351916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:22.351916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:22.352456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:22.352456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:22.358144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d57cc4b0-c697-4656-9dfa-7eb3f9f1d388 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:22.358975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d57cc4b0-c697-4656-9dfa-7eb3f9f1d388 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:22.366510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d57cc4b0-c697-4656-9dfa-7eb3f9f1d388 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:22.367315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d57cc4b0-c697-4656-9dfa-7eb3f9f1d388 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:22.367802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d57cc4b0-c697-4656-9dfa-7eb3f9f1d388 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:22.368763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d57cc4b0-c697-4656-9dfa-7eb3f9f1d388 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:22.369401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d57cc4b0-c697-4656-9dfa-7eb3f9f1d388 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:22.370002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d57cc4b0-c697-4656-9dfa-7eb3f9f1d388 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:22.397033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.objects.instance [None req-d57cc4b0-c697-4656-9dfa-7eb3f9f1d388 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lazy-loading 'flavor' on Instance uuid 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 {{(pid=121151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:18:22.400778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:22.401434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:22.402207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:22.402892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lazy-loading 'fault' on Instance uuid 4a29adfd-cbea-4185-9068-1d9cc3e78fcb {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:18:22.524940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9007aaaf32d4c22b3dc56c3cd1e08ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2345e03d1a94b1ea2388246aeefedbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:22.544719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-adee282c-0c0a-4ab4-979b-8488420fabf4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 200 len: 1305 microversion: 2.1 time: 0.212008 Aug 24 06:18:22.544719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 117/232] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:22 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 1305 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:22.627038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9de44598-dc49-43dd-ac29-1ef22bb5062c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:22.627822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9de44598-dc49-43dd-ac29-1ef22bb5062c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:22.635927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9de44598-dc49-43dd-ac29-1ef22bb5062c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:22.636415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9de44598-dc49-43dd-ac29-1ef22bb5062c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:22.636909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9de44598-dc49-43dd-ac29-1ef22bb5062c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:22.637673 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9de44598-dc49-43dd-ac29-1ef22bb5062c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:22.638165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9de44598-dc49-43dd-ac29-1ef22bb5062c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:22.638635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9de44598-dc49-43dd-ac29-1ef22bb5062c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:22.681040 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9de44598-dc49-43dd-ac29-1ef22bb5062c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/ips" status: 200 len: 145 microversion: 2.1 time: 0.064042 Aug 24 06:18:22.682309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 118/233] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 24 06:18:22 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/ips => generated 145 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:18:23.006309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:23.361463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d0bee30f-1703-4c07-94e7-09a3401ded62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:23.362215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d0bee30f-1703-4c07-94e7-09a3401ded62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:23.417962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d57cc4b0-c697-4656-9dfa-7eb3f9f1d388 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "POST /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/action" status: 202 len: 0 microversion: 2.20 time: 1.063457 Aug 24 06:18:23.423741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 116/234] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Aug 24 06:18:22 2022] POST /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/action => generated 0 bytes in 1065 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:18:23.425753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d0bee30f-1703-4c07-94e7-09a3401ded62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:23.433324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d0bee30f-1703-4c07-94e7-09a3401ded62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1222 microversion: 2.1 time: 0.075657 Aug 24 06:18:23.434398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 119/235] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:23 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:23.441120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:23.441906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:23.449346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:23.449905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:23.450403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:23.451280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:23.451893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:23.452314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:23.588276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:23.589326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] [instance: 4a29adfd-cbea-4185-9068-1d9cc3e78fcb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:23.606255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:23.607136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:23.607797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:23.610029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:23.611026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:23.612321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:23.639341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:23.649563 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] HTTP exception thrown: Instance 4a29adfd-cbea-4185-9068-1d9cc3e78fcb could not be found. Aug 24 06:18:23.650790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Request method failure captured: Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb HTTP/1.1 Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcKT3G4wDxeiiauZeu9gN1ogxRiKSSOThh-AsxuzTTLUD4wM46VFxU5xmVSycJfhHS8eW7vxjrEszaDLef3atdYB8BphP6Idcsa1lj7-vvCIth9eE8of89IwJyKwspL2NPzsYtLiQih15ddqg25HvlAE4-WVDx8pjpnmGRbBNp-aXoQ Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: e2345e03d1a94b1ea2388246aeefedbb Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-VolumesNegativeTest-1698102612 Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:18:23.653958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e2345e03d1a94b1ea2388246aeefedbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e2345e03d1a94b1ea2388246aeefedbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e2345e03d1a94b1ea2388246aeefedbb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e2345e03d1a94b1ea2388246aeefedbb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-VolumesNegativeTest-1698102612 Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: e2345e03d1a94b1ea2388246aeefedbb Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-VolumesNegativeTest-1698102612 Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-VolumesNegativeTest-1698102612-project Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: c9007aaaf32d4c22b3dc56c3cd1e08ed Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-VolumesNegativeTest-1698102612-project Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 4a29adfd-cbea-4185-9068-1d9cc3e78fcb could not be found. Aug 24 06:18:23.656819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '4a29adfd-cbea-4185-9068-1d9cc3e78fcb'} Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a29adfd-cbea-4185-9068-1d9cc3e78fcb could not be found. Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:18:23.658361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a29adfd-cbea-4185-9068-1d9cc3e78fcb could not be found. Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a29adfd-cbea-4185-9068-1d9cc3e78fcb could not be found. Aug 24 06:18:23.663516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:18:23.667373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] Returning 404 to user: Instance 4a29adfd-cbea-4185-9068-1d9cc3e78fcb could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:18:23.667373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f50b2ed3-3426-4ff9-98d1-b0c77b858fc4 tempest-VolumesNegativeTest-1698102612 tempest-VolumesNegativeTest-1698102612-project] 10.222.0.62 "GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb" status: 404 len: 111 microversion: 2.1 time: 0.084032 Aug 24 06:18:23.667851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:23.668777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 120/236] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:23 2022] GET /compute/v2.1/servers/4a29adfd-cbea-4185-9068-1d9cc3e78fcb => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:18:23.668975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-63c5e4e3-e150-45f1-ad8c-e80ad2ff5d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1726 microversion: 2.20 time: 0.228983 Aug 24 06:18:23.669833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 117/237] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1726 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:24.468877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4d03fd9c-e08f-408a-975f-a18df8b795fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:24.470671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4d03fd9c-e08f-408a-975f-a18df8b795fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:24.480031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d03fd9c-e08f-408a-975f-a18df8b795fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:24.480581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d03fd9c-e08f-408a-975f-a18df8b795fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:24.481170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d03fd9c-e08f-408a-975f-a18df8b795fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:24.481902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d03fd9c-e08f-408a-975f-a18df8b795fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:24.482352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d03fd9c-e08f-408a-975f-a18df8b795fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:24.482768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d03fd9c-e08f-408a-975f-a18df8b795fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:24.699022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:24.707352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:24.720846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:24.726813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:24.727361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:24.728206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:24.728731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:24.730632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:24.791011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4d03fd9c-e08f-408a-975f-a18df8b795fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:24.812271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4d03fd9c-e08f-408a-975f-a18df8b795fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1218 microversion: 2.1 time: 0.347865 Aug 24 06:18:24.814355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 121/238] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:24 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1218 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:24.885593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a93fac27-6043-4dd0-be0b-1a810749ce41 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a52e4de-4601-40cd-a5de-8b6be047a0d5"}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:24.888279 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a93fac27-6043-4dd0-be0b-1a810749ce41 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:24.903479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a93fac27-6043-4dd0-be0b-1a810749ce41 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:24.917698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a93fac27-6043-4dd0-be0b-1a810749ce41 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:24.918238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a93fac27-6043-4dd0-be0b-1a810749ce41 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:24.922180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a93fac27-6043-4dd0-be0b-1a810749ce41 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:24.925425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a93fac27-6043-4dd0-be0b-1a810749ce41 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:24.926063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a93fac27-6043-4dd0-be0b-1a810749ce41 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:25.380608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:25.391020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:25.392846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:25.394310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3f7b1633-beb0-49b8-8ba6-8e908092cd44 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1726 microversion: 2.20 time: 0.699487 Aug 24 06:18:25.394881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 118/239] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1726 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:18:25.838582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a89965e4-dc4b-4558-a799-5ffe1eece20b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:25.839214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a89965e4-dc4b-4558-a799-5ffe1eece20b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:25.846296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89965e4-dc4b-4558-a799-5ffe1eece20b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:25.846771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89965e4-dc4b-4558-a799-5ffe1eece20b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:25.847206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89965e4-dc4b-4558-a799-5ffe1eece20b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:25.847893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89965e4-dc4b-4558-a799-5ffe1eece20b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:25.848346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89965e4-dc4b-4558-a799-5ffe1eece20b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:25.848886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89965e4-dc4b-4558-a799-5ffe1eece20b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:25.926738 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a89965e4-dc4b-4558-a799-5ffe1eece20b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:25.939002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a89965e4-dc4b-4558-a799-5ffe1eece20b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1274 microversion: 2.1 time: 0.104371 Aug 24 06:18:25.940545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 119/240] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:25 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:25.999837 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c95d8a6c-3674-4bca-ae85-f998cedfe8ba tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13e77017-3da9-462f-805a-6313da538ca5"}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:26.002213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c95d8a6c-3674-4bca-ae85-f998cedfe8ba tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:26.008906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c95d8a6c-3674-4bca-ae85-f998cedfe8ba tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:26.009485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c95d8a6c-3674-4bca-ae85-f998cedfe8ba tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:26.009815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c95d8a6c-3674-4bca-ae85-f998cedfe8ba tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:26.010510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c95d8a6c-3674-4bca-ae85-f998cedfe8ba tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:26.010961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c95d8a6c-3674-4bca-ae85-f998cedfe8ba tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:26.011412 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c95d8a6c-3674-4bca-ae85-f998cedfe8ba tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:30.489420 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:31.964316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=4 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:32.331129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=10 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:33.429594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=8 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:33.980619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c95d8a6c-3674-4bca-ae85-f998cedfe8ba tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "POST /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.984817 Aug 24 06:18:33.981792 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 120/241] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 24 06:18:25 2022] POST /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/os-volume_attachments => generated 194 bytes in 7987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:18:33.988223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:33.989167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:33.997867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:33.998558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:33.999155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:34.000345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:34.001005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:34.001572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:34.021546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a93fac27-6043-4dd0-be0b-1a810749ce41 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "POST /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.150797 Aug 24 06:18:34.023314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 122/242] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 24 06:18:24 2022] POST /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 194 bytes in 9153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:18:34.034688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f3551f33-3258-4047-b0d7-858b5ce9bb4a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:34.049543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f3551f33-3258-4047-b0d7-858b5ce9bb4a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:34.073910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3551f33-3258-4047-b0d7-858b5ce9bb4a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:34.075472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3551f33-3258-4047-b0d7-858b5ce9bb4a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:34.076488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3551f33-3258-4047-b0d7-858b5ce9bb4a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:34.078498 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3551f33-3258-4047-b0d7-858b5ce9bb4a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:34.081418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3551f33-3258-4047-b0d7-858b5ce9bb4a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:34.087702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3551f33-3258-4047-b0d7-858b5ce9bb4a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:34.490535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:34.506294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:34.507007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:34.508379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3b7f462d-ac2a-460b-a5ce-1a42e7c809f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1726 microversion: 2.20 time: 0.525330 Aug 24 06:18:34.509131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 121/243] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1726 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:34.514371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f3551f33-3258-4047-b0d7-858b5ce9bb4a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:34.519655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-b2e3fa20-ae6b-439b-83e5-33727595dd87 req-918ebd19-03d8-418c-bb62-3b07bdf766a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce39956a-712f-48bb-83fd-c0f2efe66f83", "tag": "7e43a66d-183d-446c-b558-8011888536fc"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:34.530800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f3551f33-3258-4047-b0d7-858b5ce9bb4a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1292 microversion: 2.1 time: 0.505372 Aug 24 06:18:34.544680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 123/244] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:34 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1292 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:34.545075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:34.558392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-b2e3fa20-ae6b-439b-83e5-33727595dd87 req-918ebd19-03d8-418c-bb62-3b07bdf766a4 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:34.558842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-b2e3fa20-ae6b-439b-83e5-33727595dd87 req-918ebd19-03d8-418c-bb62-3b07bdf766a4 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:34.559438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-b2e3fa20-ae6b-439b-83e5-33727595dd87 req-918ebd19-03d8-418c-bb62-3b07bdf766a4 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:34.572995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-b2e3fa20-ae6b-439b-83e5-33727595dd87 req-918ebd19-03d8-418c-bb62-3b07bdf766a4 service nova] Creating event network-changed:7e43a66d-183d-446c-b558-8011888536fc for instance ce39956a-712f-48bb-83fd-c0f2efe66f83 on hv-cinder-85426 Aug 24 06:18:34.579763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-b2e3fa20-ae6b-439b-83e5-33727595dd87 req-918ebd19-03d8-418c-bb62-3b07bdf766a4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068012 Aug 24 06:18:34.583355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 122/245] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:35.528283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e2a1f865-0bd3-499b-8e8b-c828257db7a6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:35.528821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e2a1f865-0bd3-499b-8e8b-c828257db7a6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:35.537622 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2a1f865-0bd3-499b-8e8b-c828257db7a6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:35.538108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2a1f865-0bd3-499b-8e8b-c828257db7a6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:35.538535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2a1f865-0bd3-499b-8e8b-c828257db7a6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:35.539223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2a1f865-0bd3-499b-8e8b-c828257db7a6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:35.539790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2a1f865-0bd3-499b-8e8b-c828257db7a6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:35.540077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2a1f865-0bd3-499b-8e8b-c828257db7a6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:35.540191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:35.541410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:35.549142 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:35.551531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:35.551980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:35.552809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:35.553416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:35.553680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:35.749475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e2a1f865-0bd3-499b-8e8b-c828257db7a6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:35.753664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:35.761386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e2a1f865-0bd3-499b-8e8b-c828257db7a6 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1594 microversion: 2.1 time: 0.236994 Aug 24 06:18:35.762137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 124/246] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:35 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1594 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:35.765475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:35.766991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:35.769065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-95212c21-d557-445d-b077-65bb1b346594 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1726 microversion: 2.20 time: 0.233608 Aug 24 06:18:35.769364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-603e4c58-8eb9-45dd-91fd-d3f0f339e0f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:35.770161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-603e4c58-8eb9-45dd-91fd-d3f0f339e0f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:35.771511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 123/247] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1726 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:18:35.777672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-603e4c58-8eb9-45dd-91fd-d3f0f339e0f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:35.778190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-603e4c58-8eb9-45dd-91fd-d3f0f339e0f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:35.778677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-603e4c58-8eb9-45dd-91fd-d3f0f339e0f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:35.780692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-603e4c58-8eb9-45dd-91fd-d3f0f339e0f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:35.780692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-603e4c58-8eb9-45dd-91fd-d3f0f339e0f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:35.780692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-603e4c58-8eb9-45dd-91fd-d3f0f339e0f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:35.920314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-603e4c58-8eb9-45dd-91fd-d3f0f339e0f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:35.928308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-603e4c58-8eb9-45dd-91fd-d3f0f339e0f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1322 microversion: 2.1 time: 0.164664 Aug 24 06:18:35.928903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 125/248] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:35 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:36.644112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1453940893", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "networks": [{"uuid": "6a07a291-cd78-41f4-aedf-e2cf1b834915"}]}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:36.722433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] validate_networks() for [('6a07a291-cd78-41f4-aedf-e2cf1b834915', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:18:36.808839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:36.809463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:36.816576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:36.817063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:36.817554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:36.818172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:36.818619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:36.819032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:37.075132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:37.099239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:37.099239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:37.099239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4fa2063a-03cb-4d48-8d1a-0a18fc5564d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1726 microversion: 2.20 time: 0.290343 Aug 24 06:18:37.099540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 126/249] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1726 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:18:37.101414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c77c930b-e49d-419f-9839-242e272834d6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:37.101797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c77c930b-e49d-419f-9839-242e272834d6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:37.108835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c77c930b-e49d-419f-9839-242e272834d6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:37.109315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c77c930b-e49d-419f-9839-242e272834d6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:37.109741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c77c930b-e49d-419f-9839-242e272834d6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:37.110643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c77c930b-e49d-419f-9839-242e272834d6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:37.110870 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c77c930b-e49d-419f-9839-242e272834d6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:37.112049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c77c930b-e49d-419f-9839-242e272834d6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:37.314901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c77c930b-e49d-419f-9839-242e272834d6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:37.323506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c77c930b-e49d-419f-9839-242e272834d6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1322 microversion: 2.1 time: 0.225658 Aug 24 06:18:37.324565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 127/250] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:37 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:37.600178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:18:37.600637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:18:37.601355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:18:37.601981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:18:37.602391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:18:37.612460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:37.613241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:37.613962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:37.614784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:37.615368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:37.616021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:37.648381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-ced70a08-eeef-419b-9e52-c93f468b756a req-0a7616ca-e732-460c-8086-e84ccdb55ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6752dc86-45bf-4d60-b06a-55a478d89775", "tag": "56b6b3bc-bbb2-4822-947b-68f85df40e56"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:37.662302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-ced70a08-eeef-419b-9e52-c93f468b756a req-0a7616ca-e732-460c-8086-e84ccdb55ce7 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:37.665592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-ced70a08-eeef-419b-9e52-c93f468b756a req-0a7616ca-e732-460c-8086-e84ccdb55ce7 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:37.665592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-ced70a08-eeef-419b-9e52-c93f468b756a req-0a7616ca-e732-460c-8086-e84ccdb55ce7 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:37.668833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Getting quotas for project 7315c7714a7f40ed852dde74d497d231. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:18:37.676681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Getting quotas for user 4cb18bdb6d404cd5b303ce0a29212e4f and project 7315c7714a7f40ed852dde74d497d231. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:18:37.686538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-ced70a08-eeef-419b-9e52-c93f468b756a req-0a7616ca-e732-460c-8086-e84ccdb55ce7 service nova] Creating event network-changed:56b6b3bc-bbb2-4822-947b-68f85df40e56 for instance 6752dc86-45bf-4d60-b06a-55a478d89775 on hv-cinder-85426 Aug 24 06:18:37.692065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:18:37.692652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-ced70a08-eeef-419b-9e52-c93f468b756a req-0a7616ca-e732-460c-8086-e84ccdb55ce7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047492 Aug 24 06:18:37.694085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 128/251] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:37.695805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:18:37.808810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0b054a7d-899f-41d5-8b8e-5c3c7f8dc7f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169118 Aug 24 06:18:37.810096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 124/252] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:18:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:18:37.821221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-91a017fc-e4ba-4376-8c45-e6b7ea6a61f9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:37.822891 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-91a017fc-e4ba-4376-8c45-e6b7ea6a61f9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:37.891934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-91a017fc-e4ba-4376-8c45-e6b7ea6a61f9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:37.901365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-91a017fc-e4ba-4376-8c45-e6b7ea6a61f9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1219 microversion: 2.1 time: 0.084428 Aug 24 06:18:37.918236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 129/253] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:37 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:38.104140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-a8f0b010-0571-476d-92ff-20141390145e req-fcd76882-bdd9-49b4-b2ca-abf9bdf846bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967afe19-8139-4888-ae38-b682c1188c8f", "tag": "284c413d-f37f-41e3-a049-9aeaaa40a0c8"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:38.121649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:38.122377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:38.127551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-a8f0b010-0571-476d-92ff-20141390145e req-fcd76882-bdd9-49b4-b2ca-abf9bdf846bf service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:38.128281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-a8f0b010-0571-476d-92ff-20141390145e req-fcd76882-bdd9-49b4-b2ca-abf9bdf846bf service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:38.130202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-a8f0b010-0571-476d-92ff-20141390145e req-fcd76882-bdd9-49b4-b2ca-abf9bdf846bf service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:38.136028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:38.137128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:38.137797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:38.138760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:38.139693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:38.140361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:38.156947 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-a8f0b010-0571-476d-92ff-20141390145e req-fcd76882-bdd9-49b4-b2ca-abf9bdf846bf service nova] Creating event network-changed:284c413d-f37f-41e3-a049-9aeaaa40a0c8 for instance 967afe19-8139-4888-ae38-b682c1188c8f on hv-cinder-85426 Aug 24 06:18:38.168264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-a8f0b010-0571-476d-92ff-20141390145e req-fcd76882-bdd9-49b4-b2ca-abf9bdf846bf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067583 Aug 24 06:18:38.169610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 125/254] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:38.296845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:38.307169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:38.310778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:38.312853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dae7bda8-3630-48ff-a253-91643a3fd259 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1726 microversion: 2.20 time: 0.195319 Aug 24 06:18:38.314265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 130/255] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1726 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:18:38.345536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fbbf2ac1-2d0d-47ec-9929-bd4917b059d2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:38.346171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fbbf2ac1-2d0d-47ec-9929-bd4917b059d2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:38.355265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbbf2ac1-2d0d-47ec-9929-bd4917b059d2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:38.356143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbbf2ac1-2d0d-47ec-9929-bd4917b059d2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:38.356887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbbf2ac1-2d0d-47ec-9929-bd4917b059d2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:38.357815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbbf2ac1-2d0d-47ec-9929-bd4917b059d2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:38.358320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbbf2ac1-2d0d-47ec-9929-bd4917b059d2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:38.361933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbbf2ac1-2d0d-47ec-9929-bd4917b059d2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:38.649027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fbbf2ac1-2d0d-47ec-9929-bd4917b059d2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:38.661382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fbbf2ac1-2d0d-47ec-9929-bd4917b059d2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1322 microversion: 2.1 time: 0.320328 Aug 24 06:18:38.677382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 126/256] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:38 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:38.927927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-53efcc4c-2a1a-4dfb-9eb8-fcb9e7caa8d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:38.928615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-53efcc4c-2a1a-4dfb-9eb8-fcb9e7caa8d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:38.988222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-53efcc4c-2a1a-4dfb-9eb8-fcb9e7caa8d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:38.995681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-53efcc4c-2a1a-4dfb-9eb8-fcb9e7caa8d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1219 microversion: 2.1 time: 0.076243 Aug 24 06:18:39.008963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 131/257] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:38 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:39.337562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:39.337685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:39.344379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:39.344898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:39.345363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:39.346760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:39.347203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:39.347800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:39.500135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:39.509180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:39.510767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:39.511905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a28f51e2-3148-4c33-8776-d19df8008555 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1726 microversion: 2.20 time: 0.179428 Aug 24 06:18:39.512468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 127/258] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:39.693520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8c0263df-bf82-4729-9dc8-d9acddb2a26e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:39.694435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8c0263df-bf82-4729-9dc8-d9acddb2a26e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:39.704327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0263df-bf82-4729-9dc8-d9acddb2a26e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:39.706883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0263df-bf82-4729-9dc8-d9acddb2a26e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:39.707455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0263df-bf82-4729-9dc8-d9acddb2a26e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:39.708558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0263df-bf82-4729-9dc8-d9acddb2a26e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:39.709088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0263df-bf82-4729-9dc8-d9acddb2a26e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:39.709737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0263df-bf82-4729-9dc8-d9acddb2a26e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:39.856361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8c0263df-bf82-4729-9dc8-d9acddb2a26e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:39.864739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8c0263df-bf82-4729-9dc8-d9acddb2a26e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1322 microversion: 2.1 time: 0.181568 Aug 24 06:18:39.865299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 132/259] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:39 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:40.016607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6e112390-b5bf-4dde-857f-2ef0a933d7ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:40.017229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6e112390-b5bf-4dde-857f-2ef0a933d7ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:40.027001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e112390-b5bf-4dde-857f-2ef0a933d7ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:40.027507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e112390-b5bf-4dde-857f-2ef0a933d7ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:40.027945 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e112390-b5bf-4dde-857f-2ef0a933d7ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:40.028698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e112390-b5bf-4dde-857f-2ef0a933d7ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:40.029158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e112390-b5bf-4dde-857f-2ef0a933d7ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:40.029584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e112390-b5bf-4dde-857f-2ef0a933d7ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:40.102538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6e112390-b5bf-4dde-857f-2ef0a933d7ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:40.115824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6e112390-b5bf-4dde-857f-2ef0a933d7ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1223 microversion: 2.1 time: 0.103033 Aug 24 06:18:40.120626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 128/260] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:40 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:40.537427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:40.538739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:40.547891 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:40.548506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:40.550269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:40.551249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:40.551905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:40.552548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:40.596892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-18eafd26-0571-4401-9421-f01ff442fc27 req-47b96962-18e2-4ea8-894d-7c3fe203c3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce39956a-712f-48bb-83fd-c0f2efe66f83", "name": "network-vif-plugged", "status": "completed", "tag": "7e43a66d-183d-446c-b558-8011888536fc"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:40.608593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-18eafd26-0571-4401-9421-f01ff442fc27 req-47b96962-18e2-4ea8-894d-7c3fe203c3b1 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:40.609067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-18eafd26-0571-4401-9421-f01ff442fc27 req-47b96962-18e2-4ea8-894d-7c3fe203c3b1 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:40.609662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-18eafd26-0571-4401-9421-f01ff442fc27 req-47b96962-18e2-4ea8-894d-7c3fe203c3b1 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:40.622817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-18eafd26-0571-4401-9421-f01ff442fc27 req-47b96962-18e2-4ea8-894d-7c3fe203c3b1 service nova] Creating event network-vif-plugged:7e43a66d-183d-446c-b558-8011888536fc for instance ce39956a-712f-48bb-83fd-c0f2efe66f83 on hv-cinder-85426 Aug 24 06:18:40.627941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-18eafd26-0571-4401-9421-f01ff442fc27 req-47b96962-18e2-4ea8-894d-7c3fe203c3b1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036410 Aug 24 06:18:40.628591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 129/261] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:40.758628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:40.762291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:40.781229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:40.785552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:40.786759 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-588312a4-e6fd-4ed4-8748-1b90e5d62d02 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1726 microversion: 2.20 time: 0.255495 Aug 24 06:18:40.820377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 133/262] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1726 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:40.885858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7d2a9561-39b0-4964-bf15-3aab8a9c13c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:40.886549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7d2a9561-39b0-4964-bf15-3aab8a9c13c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:40.892831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d2a9561-39b0-4964-bf15-3aab8a9c13c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:40.893308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d2a9561-39b0-4964-bf15-3aab8a9c13c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:40.893746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d2a9561-39b0-4964-bf15-3aab8a9c13c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:40.894429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d2a9561-39b0-4964-bf15-3aab8a9c13c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:40.895032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d2a9561-39b0-4964-bf15-3aab8a9c13c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:40.895617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d2a9561-39b0-4964-bf15-3aab8a9c13c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:41.001648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-275f73ec-6eaa-434f-ae8c-c8eaa7f600f2 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-997578580"}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:41.002866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-275f73ec-6eaa-434f-ae8c-c8eaa7f600f2 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:41.009462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-275f73ec-6eaa-434f-ae8c-c8eaa7f600f2 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:41.010150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-275f73ec-6eaa-434f-ae8c-c8eaa7f600f2 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:41.010582 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-275f73ec-6eaa-434f-ae8c-c8eaa7f600f2 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:41.011442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-275f73ec-6eaa-434f-ae8c-c8eaa7f600f2 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:41.011893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-275f73ec-6eaa-434f-ae8c-c8eaa7f600f2 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:41.012314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-275f73ec-6eaa-434f-ae8c-c8eaa7f600f2 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:41.161115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.network.security_group_api [None req-275f73ec-6eaa-434f-ae8c-c8eaa7f600f2 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Adding security group cd508345-8094-4d58-b6aa-919baa797c88 to port 284c413d-f37f-41e3-a049-9aeaaa40a0c8 Aug 24 06:18:41.210187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7d2a9561-39b0-4964-bf15-3aab8a9c13c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:41.223902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7d2a9561-39b0-4964-bf15-3aab8a9c13c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1322 microversion: 2.1 time: 0.339118 Aug 24 06:18:41.236794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 130/263] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:40 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1322 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:41.237569 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6ff8f958-8e73-46d6-93c3-e17ea739ca5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:41.238231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6ff8f958-8e73-46d6-93c3-e17ea739ca5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:41.249963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ff8f958-8e73-46d6-93c3-e17ea739ca5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:41.250468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ff8f958-8e73-46d6-93c3-e17ea739ca5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:41.250999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ff8f958-8e73-46d6-93c3-e17ea739ca5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:41.251944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ff8f958-8e73-46d6-93c3-e17ea739ca5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:41.252420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ff8f958-8e73-46d6-93c3-e17ea739ca5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:41.252878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ff8f958-8e73-46d6-93c3-e17ea739ca5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:41.330344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6ff8f958-8e73-46d6-93c3-e17ea739ca5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:41.343199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6ff8f958-8e73-46d6-93c3-e17ea739ca5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1289 microversion: 2.1 time: 0.114896 Aug 24 06:18:41.348003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 131/264] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:41 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1289 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:41.599176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-275f73ec-6eaa-434f-ae8c-c8eaa7f600f2 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "POST /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/action" status: 202 len: 0 microversion: 2.1 time: 0.602533 Aug 24 06:18:41.599853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 134/265] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 24 06:18:40 2022] POST /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:18:41.607473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-d5df9c1e-596b-4864-9a8c-46f7fb13bfc7 req-f6760e6c-2ac1-4797-b450-cd5d6f5d107d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967afe19-8139-4888-ae38-b682c1188c8f", "tag": "284c413d-f37f-41e3-a049-9aeaaa40a0c8"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:41.612564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2f279284-c51c-4b69-96da-9dca1d71feec tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:41.618214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2f279284-c51c-4b69-96da-9dca1d71feec tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:41.628321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f279284-c51c-4b69-96da-9dca1d71feec tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:41.629733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f279284-c51c-4b69-96da-9dca1d71feec tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:41.632103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-d5df9c1e-596b-4864-9a8c-46f7fb13bfc7 req-f6760e6c-2ac1-4797-b450-cd5d6f5d107d service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:41.632827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f279284-c51c-4b69-96da-9dca1d71feec tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:41.633737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f279284-c51c-4b69-96da-9dca1d71feec tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:41.634382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f279284-c51c-4b69-96da-9dca1d71feec tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:41.635050 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-d5df9c1e-596b-4864-9a8c-46f7fb13bfc7 req-f6760e6c-2ac1-4797-b450-cd5d6f5d107d service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:41.635769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f279284-c51c-4b69-96da-9dca1d71feec tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:41.639171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-d5df9c1e-596b-4864-9a8c-46f7fb13bfc7 req-f6760e6c-2ac1-4797-b450-cd5d6f5d107d service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:41.668474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-d5df9c1e-596b-4864-9a8c-46f7fb13bfc7 req-f6760e6c-2ac1-4797-b450-cd5d6f5d107d service nova] Creating event network-changed:284c413d-f37f-41e3-a049-9aeaaa40a0c8 for instance 967afe19-8139-4888-ae38-b682c1188c8f on hv-cinder-85426 Aug 24 06:18:41.678114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-d5df9c1e-596b-4864-9a8c-46f7fb13bfc7 req-f6760e6c-2ac1-4797-b450-cd5d6f5d107d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074103 Aug 24 06:18:41.678889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 132/266] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:41.812109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:41.812589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2f279284-c51c-4b69-96da-9dca1d71feec tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:41.812887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:41.821292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:41.822103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:41.822765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:41.823665 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:41.824330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:41.824958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:41.826836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2f279284-c51c-4b69-96da-9dca1d71feec tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1758 microversion: 2.1 time: 0.217197 Aug 24 06:18:41.827446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 135/267] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:41 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1758 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:42.130645 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:42.138756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:42.140270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:42.141455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-df9fc2af-f5f9-4e0f-b04c-1ef683f324f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1726 microversion: 2.20 time: 0.333867 Aug 24 06:18:42.142014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 133/268] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:41 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1726 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:18:42.251287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cda0f08f-d413-4b9c-80c1-3a8290ba64d4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:42.253798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cda0f08f-d413-4b9c-80c1-3a8290ba64d4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:42.259434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cda0f08f-d413-4b9c-80c1-3a8290ba64d4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:42.259923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cda0f08f-d413-4b9c-80c1-3a8290ba64d4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:42.260362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cda0f08f-d413-4b9c-80c1-3a8290ba64d4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:42.261144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cda0f08f-d413-4b9c-80c1-3a8290ba64d4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:42.261658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cda0f08f-d413-4b9c-80c1-3a8290ba64d4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:42.262166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cda0f08f-d413-4b9c-80c1-3a8290ba64d4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:42.366767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b885e0ba-b0fc-4596-a534-4625923f8140 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:42.367524 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b885e0ba-b0fc-4596-a534-4625923f8140 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:42.374278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b885e0ba-b0fc-4596-a534-4625923f8140 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:42.374768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b885e0ba-b0fc-4596-a534-4625923f8140 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:42.375205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b885e0ba-b0fc-4596-a534-4625923f8140 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:42.375900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b885e0ba-b0fc-4596-a534-4625923f8140 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:42.376555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b885e0ba-b0fc-4596-a534-4625923f8140 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:42.377698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b885e0ba-b0fc-4596-a534-4625923f8140 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:42.406864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cda0f08f-d413-4b9c-80c1-3a8290ba64d4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:42.416352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cda0f08f-d413-4b9c-80c1-3a8290ba64d4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1322 microversion: 2.1 time: 0.168990 Aug 24 06:18:42.418175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 136/269] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:42 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:42.527481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b885e0ba-b0fc-4596-a534-4625923f8140 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:42.537717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b885e0ba-b0fc-4596-a534-4625923f8140 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1319 microversion: 2.1 time: 0.175046 Aug 24 06:18:42.538298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 134/270] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:42 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:43.164135 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:43.164969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:43.171996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:43.172564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:43.173006 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:43.178209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:43.178209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:43.178209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:43.311554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:43.320248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:43.321843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:43.323077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-881d789d-9b03-412f-8cf0-caf1b9c2b958 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1726 microversion: 2.20 time: 0.163121 Aug 24 06:18:43.323633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 137/271] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:43.442635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7ea393d2-b238-4c30-a5a9-c7da7deb3f93 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:43.443989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7ea393d2-b238-4c30-a5a9-c7da7deb3f93 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:43.450814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ea393d2-b238-4c30-a5a9-c7da7deb3f93 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:43.451389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ea393d2-b238-4c30-a5a9-c7da7deb3f93 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:43.451893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ea393d2-b238-4c30-a5a9-c7da7deb3f93 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:43.452951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ea393d2-b238-4c30-a5a9-c7da7deb3f93 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:43.453272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ea393d2-b238-4c30-a5a9-c7da7deb3f93 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:43.453688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ea393d2-b238-4c30-a5a9-c7da7deb3f93 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:43.481365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:43.559421 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-74ea96c9-37ec-48e5-8199-8e9e67a65fc6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:43.560018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-74ea96c9-37ec-48e5-8199-8e9e67a65fc6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:43.566747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74ea96c9-37ec-48e5-8199-8e9e67a65fc6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:43.567446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74ea96c9-37ec-48e5-8199-8e9e67a65fc6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:43.567890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74ea96c9-37ec-48e5-8199-8e9e67a65fc6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:43.568611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74ea96c9-37ec-48e5-8199-8e9e67a65fc6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:43.569056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74ea96c9-37ec-48e5-8199-8e9e67a65fc6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:43.569473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74ea96c9-37ec-48e5-8199-8e9e67a65fc6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:43.714896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-74ea96c9-37ec-48e5-8199-8e9e67a65fc6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:43.725676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-74ea96c9-37ec-48e5-8199-8e9e67a65fc6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1319 microversion: 2.1 time: 0.169766 Aug 24 06:18:43.727007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 138/272] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:43 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:43.745276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7ea393d2-b238-4c30-a5a9-c7da7deb3f93 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:43.753883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7ea393d2-b238-4c30-a5a9-c7da7deb3f93 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1322 microversion: 2.1 time: 0.315876 Aug 24 06:18:43.756374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 135/273] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:43 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:43.870681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-89c2066b-df61-499b-a36d-0cf50088bad5 req-fcc5af65-12a6-432b-8600-3575274480b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86", "tag": "7f444cec-7e1d-44bd-80e2-71b9dd9e0779"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:43.880421 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-89c2066b-df61-499b-a36d-0cf50088bad5 req-fcc5af65-12a6-432b-8600-3575274480b8 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:43.881020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-89c2066b-df61-499b-a36d-0cf50088bad5 req-fcc5af65-12a6-432b-8600-3575274480b8 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:43.881443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-89c2066b-df61-499b-a36d-0cf50088bad5 req-fcc5af65-12a6-432b-8600-3575274480b8 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:43.892695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-89c2066b-df61-499b-a36d-0cf50088bad5 req-fcc5af65-12a6-432b-8600-3575274480b8 service nova] Creating event network-changed:7f444cec-7e1d-44bd-80e2-71b9dd9e0779 for instance ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 on hv-cinder-85426 Aug 24 06:18:43.897800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-89c2066b-df61-499b-a36d-0cf50088bad5 req-fcc5af65-12a6-432b-8600-3575274480b8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030569 Aug 24 06:18:43.898394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 139/274] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:18:44.162502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8929c2a0-6601-42ec-ba4c-9658f89a8307 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:44.168646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8929c2a0-6601-42ec-ba4c-9658f89a8307 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:44.169271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8929c2a0-6601-42ec-ba4c-9658f89a8307 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:44.169729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8929c2a0-6601-42ec-ba4c-9658f89a8307 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:44.232988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8929c2a0-6601-42ec-ba4c-9658f89a8307 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Going to try to stop instance {{(pid=121151) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 06:18:44.348475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:44.349804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:44.356040 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:44.356806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:44.357242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:44.357932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:44.358594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:44.359042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:44.427563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8929c2a0-6601-42ec-ba4c-9658f89a8307 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "POST /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/action" status: 202 len: 0 microversion: 2.1 time: 0.268213 Aug 24 06:18:44.428201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 136/275] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 24 06:18:44 2022] POST /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:18:44.439968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3e990c63-2d19-4775-94d0-5040b1072c7c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:44.441145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3e990c63-2d19-4775-94d0-5040b1072c7c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:44.451633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e990c63-2d19-4775-94d0-5040b1072c7c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:44.453060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e990c63-2d19-4775-94d0-5040b1072c7c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:44.453836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e990c63-2d19-4775-94d0-5040b1072c7c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:44.455461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e990c63-2d19-4775-94d0-5040b1072c7c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:44.456120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e990c63-2d19-4775-94d0-5040b1072c7c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:44.456831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e990c63-2d19-4775-94d0-5040b1072c7c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:44.533695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:44.545286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:44.547690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:44.549440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-86fbd5f8-59fd-4649-bc6b-7bb011d88230 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1726 microversion: 2.20 time: 0.206597 Aug 24 06:18:44.564519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 140/276] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1726 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:18:44.649712 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3e990c63-2d19-4775-94d0-5040b1072c7c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:44.658652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3e990c63-2d19-4775-94d0-5040b1072c7c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.223305 Aug 24 06:18:44.659211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 137/277] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:44 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:44.747241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-866704b4-4f97-490b-a577-c129423d6a91 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:44.747929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-866704b4-4f97-490b-a577-c129423d6a91 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:44.757017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-c2fa2623-dd61-4888-822a-c1793ceb809b req-9c99a118-e314-4128-be5e-1d66268752de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6752dc86-45bf-4d60-b06a-55a478d89775", "name": "network-vif-plugged", "status": "completed", "tag": "56b6b3bc-bbb2-4822-947b-68f85df40e56"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:44.757897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-866704b4-4f97-490b-a577-c129423d6a91 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:44.758568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-866704b4-4f97-490b-a577-c129423d6a91 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:44.759201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-866704b4-4f97-490b-a577-c129423d6a91 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:44.760120 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-866704b4-4f97-490b-a577-c129423d6a91 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:44.760844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-866704b4-4f97-490b-a577-c129423d6a91 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:44.761463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-866704b4-4f97-490b-a577-c129423d6a91 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:44.770397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c2fa2623-dd61-4888-822a-c1793ceb809b req-9c99a118-e314-4128-be5e-1d66268752de service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:44.771089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c2fa2623-dd61-4888-822a-c1793ceb809b req-9c99a118-e314-4128-be5e-1d66268752de service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:44.771694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c2fa2623-dd61-4888-822a-c1793ceb809b req-9c99a118-e314-4128-be5e-1d66268752de service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:44.783890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-c2fa2623-dd61-4888-822a-c1793ceb809b req-9c99a118-e314-4128-be5e-1d66268752de service nova] Creating event network-vif-plugged:56b6b3bc-bbb2-4822-947b-68f85df40e56 for instance 6752dc86-45bf-4d60-b06a-55a478d89775 on hv-cinder-85426 Aug 24 06:18:44.789411 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-c2fa2623-dd61-4888-822a-c1793ceb809b req-9c99a118-e314-4128-be5e-1d66268752de service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037945 Aug 24 06:18:44.790460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 138/278] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:18:44.796713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4262e79d-d12b-44cd-9ae0-017634b9f46b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:44.797641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4262e79d-d12b-44cd-9ae0-017634b9f46b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:44.804778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4262e79d-d12b-44cd-9ae0-017634b9f46b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:44.805523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4262e79d-d12b-44cd-9ae0-017634b9f46b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:44.806111 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4262e79d-d12b-44cd-9ae0-017634b9f46b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:44.806966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4262e79d-d12b-44cd-9ae0-017634b9f46b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:44.807593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4262e79d-d12b-44cd-9ae0-017634b9f46b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:44.808295 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4262e79d-d12b-44cd-9ae0-017634b9f46b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:44.942562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-866704b4-4f97-490b-a577-c129423d6a91 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:44.951502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-866704b4-4f97-490b-a577-c129423d6a91 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1319 microversion: 2.1 time: 0.208007 Aug 24 06:18:44.952957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 141/279] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:44 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:45.027565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4262e79d-d12b-44cd-9ae0-017634b9f46b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:45.035419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4262e79d-d12b-44cd-9ae0-017634b9f46b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1322 microversion: 2.1 time: 0.243623 Aug 24 06:18:45.036380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 139/280] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:44 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:45.572848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:45.573446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:45.579821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:45.580291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:45.580754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:45.581428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:45.581871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:45.582277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:45.679987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6c6df5bf-6698-4899-b0c9-a2ba72d87e7a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:45.680633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6c6df5bf-6698-4899-b0c9-a2ba72d87e7a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:45.687376 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c6df5bf-6698-4899-b0c9-a2ba72d87e7a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:45.687880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c6df5bf-6698-4899-b0c9-a2ba72d87e7a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:45.688386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c6df5bf-6698-4899-b0c9-a2ba72d87e7a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:45.689374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c6df5bf-6698-4899-b0c9-a2ba72d87e7a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:45.689987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c6df5bf-6698-4899-b0c9-a2ba72d87e7a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:45.690485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c6df5bf-6698-4899-b0c9-a2ba72d87e7a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:45.709867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:45.718009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:45.719504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:45.721179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1843551f-ceb9-4abd-b253-00ffaafcafe0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1747 microversion: 2.20 time: 0.151785 Aug 24 06:18:45.724090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 142/281] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1747 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:45.821898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6c6df5bf-6698-4899-b0c9-a2ba72d87e7a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:45.830207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6c6df5bf-6698-4899-b0c9-a2ba72d87e7a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.154031 Aug 24 06:18:45.830771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 140/282] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:45 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:45.974204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1975742f-a2f5-4d8f-89a4-d0b0fdbf97bc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:45.974803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1975742f-a2f5-4d8f-89a4-d0b0fdbf97bc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:45.980743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1975742f-a2f5-4d8f-89a4-d0b0fdbf97bc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:45.981217 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1975742f-a2f5-4d8f-89a4-d0b0fdbf97bc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:45.981638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1975742f-a2f5-4d8f-89a4-d0b0fdbf97bc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:45.982308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1975742f-a2f5-4d8f-89a4-d0b0fdbf97bc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:45.982768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1975742f-a2f5-4d8f-89a4-d0b0fdbf97bc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:45.983161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1975742f-a2f5-4d8f-89a4-d0b0fdbf97bc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:46.056985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9a040d2a-97f9-4988-be67-7f2f6546acd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:46.057626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9a040d2a-97f9-4988-be67-7f2f6546acd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:46.063525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a040d2a-97f9-4988-be67-7f2f6546acd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:46.064007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a040d2a-97f9-4988-be67-7f2f6546acd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:46.064443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a040d2a-97f9-4988-be67-7f2f6546acd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:46.065168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a040d2a-97f9-4988-be67-7f2f6546acd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:46.065622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a040d2a-97f9-4988-be67-7f2f6546acd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:46.066045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a040d2a-97f9-4988-be67-7f2f6546acd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:46.117009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1975742f-a2f5-4d8f-89a4-d0b0fdbf97bc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:46.126752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1975742f-a2f5-4d8f-89a4-d0b0fdbf97bc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1319 microversion: 2.1 time: 0.156974 Aug 24 06:18:46.127410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 143/283] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:45 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:46.200487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9a040d2a-97f9-4988-be67-7f2f6546acd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:46.208882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9a040d2a-97f9-4988-be67-7f2f6546acd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1322 microversion: 2.1 time: 0.155550 Aug 24 06:18:46.209455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 141/284] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:46 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:46.744727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:46.745336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:46.751748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:46.752224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:46.752681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:46.753372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:46.753847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:46.754264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:46.851786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b35cc2c4-994f-4fc6-8ca8-4eb9fdc79220 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:46.852395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b35cc2c4-994f-4fc6-8ca8-4eb9fdc79220 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:46.859018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b35cc2c4-994f-4fc6-8ca8-4eb9fdc79220 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:46.859510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b35cc2c4-994f-4fc6-8ca8-4eb9fdc79220 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:46.859938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b35cc2c4-994f-4fc6-8ca8-4eb9fdc79220 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:46.861467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b35cc2c4-994f-4fc6-8ca8-4eb9fdc79220 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:46.861918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b35cc2c4-994f-4fc6-8ca8-4eb9fdc79220 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:46.862506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b35cc2c4-994f-4fc6-8ca8-4eb9fdc79220 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:46.883827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:46.892439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:46.894036 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:46.895217 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9cabfc14-d8c7-4c49-8a9f-daf8b6e3fafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1747 microversion: 2.20 time: 0.154449 Aug 24 06:18:46.896219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 144/285] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:46.995161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b35cc2c4-994f-4fc6-8ca8-4eb9fdc79220 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:47.004014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b35cc2c4-994f-4fc6-8ca8-4eb9fdc79220 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.156351 Aug 24 06:18:47.004603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 142/286] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:46 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:47.147627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0699f90f-a898-4636-a79f-6c906d16a601 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:47.148234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0699f90f-a898-4636-a79f-6c906d16a601 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:47.154132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0699f90f-a898-4636-a79f-6c906d16a601 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:47.154612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0699f90f-a898-4636-a79f-6c906d16a601 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:47.155048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0699f90f-a898-4636-a79f-6c906d16a601 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:47.155758 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0699f90f-a898-4636-a79f-6c906d16a601 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:47.156210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0699f90f-a898-4636-a79f-6c906d16a601 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:47.156660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0699f90f-a898-4636-a79f-6c906d16a601 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:47.229861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f497e581-a191-45cf-b07b-cf9023d509c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:47.230604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f497e581-a191-45cf-b07b-cf9023d509c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:47.237513 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f497e581-a191-45cf-b07b-cf9023d509c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:47.238001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f497e581-a191-45cf-b07b-cf9023d509c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:47.238443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f497e581-a191-45cf-b07b-cf9023d509c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:47.239143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f497e581-a191-45cf-b07b-cf9023d509c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:47.239597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f497e581-a191-45cf-b07b-cf9023d509c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:47.240019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f497e581-a191-45cf-b07b-cf9023d509c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:47.290601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0699f90f-a898-4636-a79f-6c906d16a601 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:47.301207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0699f90f-a898-4636-a79f-6c906d16a601 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1319 microversion: 2.1 time: 0.157425 Aug 24 06:18:47.301863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 145/287] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:47 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:47.368463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f497e581-a191-45cf-b07b-cf9023d509c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:47.376159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f497e581-a191-45cf-b07b-cf9023d509c6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1322 microversion: 2.1 time: 0.150156 Aug 24 06:18:47.376812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 143/288] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:47 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:47.918123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:47.918789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:47.921236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:47.926166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:47.926642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:47.927073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:47.927760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:47.928209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:47.928650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:48.024875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fd3b39ef-88a1-42a3-be77-9c8403fed3ea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:48.025612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fd3b39ef-88a1-42a3-be77-9c8403fed3ea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:48.027571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:48.028375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=6 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:48.033495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3b39ef-88a1-42a3-be77-9c8403fed3ea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:48.033980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3b39ef-88a1-42a3-be77-9c8403fed3ea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:48.034409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3b39ef-88a1-42a3-be77-9c8403fed3ea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:48.038507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3b39ef-88a1-42a3-be77-9c8403fed3ea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:48.038507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3b39ef-88a1-42a3-be77-9c8403fed3ea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:48.038507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3b39ef-88a1-42a3-be77-9c8403fed3ea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:48.059800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:48.068584 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:48.070097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:48.071282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8a0c5d3a-612b-4094-a5a7-99d7f06c1011 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1742 microversion: 2.20 time: 0.157151 Aug 24 06:18:48.071844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 146/289] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:48.166505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fd3b39ef-88a1-42a3-be77-9c8403fed3ea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:48.175547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fd3b39ef-88a1-42a3-be77-9c8403fed3ea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.154202 Aug 24 06:18:48.176143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 144/290] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:48 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:48.324393 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-12324432-6f68-4bca-93a4-0b2d066e00b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:48.325660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-12324432-6f68-4bca-93a4-0b2d066e00b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:48.331648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12324432-6f68-4bca-93a4-0b2d066e00b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:48.332131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12324432-6f68-4bca-93a4-0b2d066e00b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:48.332587 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12324432-6f68-4bca-93a4-0b2d066e00b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:48.333276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12324432-6f68-4bca-93a4-0b2d066e00b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:48.333730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12324432-6f68-4bca-93a4-0b2d066e00b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:48.334174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12324432-6f68-4bca-93a4-0b2d066e00b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:48.397511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cd983c31-019e-4ad1-a50d-b348c6c534f5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:48.398299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cd983c31-019e-4ad1-a50d-b348c6c534f5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:48.406208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd983c31-019e-4ad1-a50d-b348c6c534f5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:48.406208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd983c31-019e-4ad1-a50d-b348c6c534f5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:48.406731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd983c31-019e-4ad1-a50d-b348c6c534f5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:48.407464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd983c31-019e-4ad1-a50d-b348c6c534f5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:48.408141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd983c31-019e-4ad1-a50d-b348c6c534f5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:48.408626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd983c31-019e-4ad1-a50d-b348c6c534f5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:48.493735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-12324432-6f68-4bca-93a4-0b2d066e00b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:48.505299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-12324432-6f68-4bca-93a4-0b2d066e00b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1319 microversion: 2.1 time: 0.184512 Aug 24 06:18:48.512622 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 147/291] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:48 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:48.575784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cd983c31-019e-4ad1-a50d-b348c6c534f5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:48.590069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cd983c31-019e-4ad1-a50d-b348c6c534f5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1516 microversion: 2.1 time: 0.192102 Aug 24 06:18:48.590069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 145/292] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:48 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:48.606688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-eabf972f-0c47-4f52-8137-f20b062ffd44 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:48.609170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-eabf972f-0c47-4f52-8137-f20b062ffd44 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:48.617236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eabf972f-0c47-4f52-8137-f20b062ffd44 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:48.617713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eabf972f-0c47-4f52-8137-f20b062ffd44 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:48.618193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eabf972f-0c47-4f52-8137-f20b062ffd44 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:48.619089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eabf972f-0c47-4f52-8137-f20b062ffd44 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:48.619573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eabf972f-0c47-4f52-8137-f20b062ffd44 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:48.619990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eabf972f-0c47-4f52-8137-f20b062ffd44 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:48.646953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-eabf972f-0c47-4f52-8137-f20b062ffd44 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lazy-loading 'flavor' on Instance uuid 6752dc86-45bf-4d60-b06a-55a478d89775 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:18:48.777867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-54c7222c-6021-4521-bd1a-e71c2b3dea22 req-1005317b-4de7-4d63-bbea-76798ec67059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9", "name": "network-vif-plugged", "status": "completed", "tag": "6fa5961a-6a56-4ea0-88f8-85ee1d70c184"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:48.789969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-54c7222c-6021-4521-bd1a-e71c2b3dea22 req-1005317b-4de7-4d63-bbea-76798ec67059 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:48.789969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-54c7222c-6021-4521-bd1a-e71c2b3dea22 req-1005317b-4de7-4d63-bbea-76798ec67059 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:48.790405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-54c7222c-6021-4521-bd1a-e71c2b3dea22 req-1005317b-4de7-4d63-bbea-76798ec67059 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:48.808289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-54c7222c-6021-4521-bd1a-e71c2b3dea22 req-1005317b-4de7-4d63-bbea-76798ec67059 service nova] Creating event network-vif-plugged:6fa5961a-6a56-4ea0-88f8-85ee1d70c184 for instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 on hv-cinder-85426 Aug 24 06:18:48.813314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-54c7222c-6021-4521-bd1a-e71c2b3dea22 req-1005317b-4de7-4d63-bbea-76798ec67059 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040683 Aug 24 06:18:48.814623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 146/293] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:18:48.995639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=4 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:49.006154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-eabf972f-0c47-4f52-8137-f20b062ffd44 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "POST /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775/action" status: 200 len: 32 microversion: 2.1 time: 0.403898 Aug 24 06:18:49.006756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 148/294] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 24 06:18:48 2022] POST /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775/action => generated 32 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:18:49.017025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ba19d8c5-a900-4d27-97fe-7f080c75a5d7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:49.018170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ba19d8c5-a900-4d27-97fe-7f080c75a5d7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:49.034108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba19d8c5-a900-4d27-97fe-7f080c75a5d7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:49.035856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba19d8c5-a900-4d27-97fe-7f080c75a5d7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:49.038124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba19d8c5-a900-4d27-97fe-7f080c75a5d7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:49.038124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba19d8c5-a900-4d27-97fe-7f080c75a5d7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:49.038124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba19d8c5-a900-4d27-97fe-7f080c75a5d7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:49.038564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba19d8c5-a900-4d27-97fe-7f080c75a5d7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:49.097098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:49.098163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:49.107786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:49.108568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:49.109148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:49.110154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:49.111223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:49.112171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:49.136401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:49.286366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ba19d8c5-a900-4d27-97fe-7f080c75a5d7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:49.302308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ba19d8c5-a900-4d27-97fe-7f080c75a5d7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.289651 Aug 24 06:18:49.316188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:49.320995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 147/295] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:49 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:49.327591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:49.329192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-07aa77a5-9758-41e0-9b11-15788c8a17a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:49.337315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-07aa77a5-9758-41e0-9b11-15788c8a17a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:49.340169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:49.341903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f04257b0-99e5-4e83-869b-1f155f4522e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1742 microversion: 2.20 time: 0.250478 Aug 24 06:18:49.348807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 149/296] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1742 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:18:49.351189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07aa77a5-9758-41e0-9b11-15788c8a17a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:49.352632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07aa77a5-9758-41e0-9b11-15788c8a17a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:49.353248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07aa77a5-9758-41e0-9b11-15788c8a17a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:49.355677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07aa77a5-9758-41e0-9b11-15788c8a17a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:49.356582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07aa77a5-9758-41e0-9b11-15788c8a17a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:49.360054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07aa77a5-9758-41e0-9b11-15788c8a17a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:49.528214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-18059ab6-6ce8-4841-9369-41f5eeeb13b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:49.528883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-18059ab6-6ce8-4841-9369-41f5eeeb13b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:49.541065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18059ab6-6ce8-4841-9369-41f5eeeb13b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:49.543901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18059ab6-6ce8-4841-9369-41f5eeeb13b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:49.544636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18059ab6-6ce8-4841-9369-41f5eeeb13b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:49.545574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18059ab6-6ce8-4841-9369-41f5eeeb13b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:49.546480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18059ab6-6ce8-4841-9369-41f5eeeb13b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:49.547067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18059ab6-6ce8-4841-9369-41f5eeeb13b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:49.591529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-07aa77a5-9758-41e0-9b11-15788c8a17a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:49.601215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-07aa77a5-9758-41e0-9b11-15788c8a17a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.278890 Aug 24 06:18:49.602179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 148/297] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:49 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:49.707973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-18059ab6-6ce8-4841-9369-41f5eeeb13b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:49.718611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-18059ab6-6ce8-4841-9369-41f5eeeb13b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1319 microversion: 2.1 time: 0.195735 Aug 24 06:18:49.720321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 150/298] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:49 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:50.331953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-08b2bb7d-5d3b-4348-ac8b-e4587198c347 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:50.333268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-08b2bb7d-5d3b-4348-ac8b-e4587198c347 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:50.342949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b2bb7d-5d3b-4348-ac8b-e4587198c347 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:50.343697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b2bb7d-5d3b-4348-ac8b-e4587198c347 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:50.344287 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b2bb7d-5d3b-4348-ac8b-e4587198c347 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:50.345228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b2bb7d-5d3b-4348-ac8b-e4587198c347 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:50.345902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b2bb7d-5d3b-4348-ac8b-e4587198c347 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:50.346326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b2bb7d-5d3b-4348-ac8b-e4587198c347 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:50.366351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:50.367572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:50.381909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:50.382462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:50.383067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:50.383955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:50.384757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:50.385338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:50.578348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:50.587639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:50.594960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-08b2bb7d-5d3b-4348-ac8b-e4587198c347 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:50.598935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:50.598935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6e45b41a-a184-4f33-8008-08d630688725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1742 microversion: 2.20 time: 0.235496 Aug 24 06:18:50.598935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 151/299] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1742 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:18:50.603943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-08b2bb7d-5d3b-4348-ac8b-e4587198c347 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.276515 Aug 24 06:18:50.604559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 149/300] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:50 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:50.625067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b9441193-d427-4add-ab72-d91b2af612ca tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:50.626064 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b9441193-d427-4add-ab72-d91b2af612ca tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:50.634449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9441193-d427-4add-ab72-d91b2af612ca tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:50.635238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9441193-d427-4add-ab72-d91b2af612ca tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:50.635895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9441193-d427-4add-ab72-d91b2af612ca tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:50.636858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9441193-d427-4add-ab72-d91b2af612ca tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:50.637524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9441193-d427-4add-ab72-d91b2af612ca tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:50.638800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9441193-d427-4add-ab72-d91b2af612ca tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:50.745464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-107ae7e4-f69b-4001-9777-bb6c8eda2cb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:50.745464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-107ae7e4-f69b-4001-9777-bb6c8eda2cb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:50.759856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ae7e4-f69b-4001-9777-bb6c8eda2cb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:50.763715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ae7e4-f69b-4001-9777-bb6c8eda2cb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:50.764167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ae7e4-f69b-4001-9777-bb6c8eda2cb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:50.768555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ae7e4-f69b-4001-9777-bb6c8eda2cb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:50.769141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ae7e4-f69b-4001-9777-bb6c8eda2cb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:50.770187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ae7e4-f69b-4001-9777-bb6c8eda2cb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:50.855401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b9441193-d427-4add-ab72-d91b2af612ca tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:50.865522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b9441193-d427-4add-ab72-d91b2af612ca tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.245394 Aug 24 06:18:50.866522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 152/301] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:50 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:50.871308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-d2381cfc-d7ee-4b20-b7b1-4ad982fb1ce2 req-0772916d-6f4c-4798-bee4-553b5f3194dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86", "name": "network-vif-plugged", "status": "completed", "tag": "7f444cec-7e1d-44bd-80e2-71b9dd9e0779"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:50.892244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-d2381cfc-d7ee-4b20-b7b1-4ad982fb1ce2 req-0772916d-6f4c-4798-bee4-553b5f3194dc service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:50.896622 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-d2381cfc-d7ee-4b20-b7b1-4ad982fb1ce2 req-0772916d-6f4c-4798-bee4-553b5f3194dc service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:50.897277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-d2381cfc-d7ee-4b20-b7b1-4ad982fb1ce2 req-0772916d-6f4c-4798-bee4-553b5f3194dc service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:50.930667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-d2381cfc-d7ee-4b20-b7b1-4ad982fb1ce2 req-0772916d-6f4c-4798-bee4-553b5f3194dc service nova] Creating event network-vif-plugged:7f444cec-7e1d-44bd-80e2-71b9dd9e0779 for instance ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 on hv-cinder-85426 Aug 24 06:18:50.937529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-d2381cfc-d7ee-4b20-b7b1-4ad982fb1ce2 req-0772916d-6f4c-4798-bee4-553b5f3194dc service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069674 Aug 24 06:18:50.938279 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 153/302] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:51.099884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-107ae7e4-f69b-4001-9777-bb6c8eda2cb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:51.111272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-107ae7e4-f69b-4001-9777-bb6c8eda2cb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1319 microversion: 2.1 time: 0.370947 Aug 24 06:18:51.112266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 150/303] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:50 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:51.631914 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:51.632825 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-514cf82a-7ac6-4bc7-be09-e6aae0982035 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:51.633936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-514cf82a-7ac6-4bc7-be09-e6aae0982035 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:51.636592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:51.644105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514cf82a-7ac6-4bc7-be09-e6aae0982035 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:51.644825 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514cf82a-7ac6-4bc7-be09-e6aae0982035 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:51.645438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514cf82a-7ac6-4bc7-be09-e6aae0982035 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:51.650811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:51.651807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514cf82a-7ac6-4bc7-be09-e6aae0982035 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:51.652289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514cf82a-7ac6-4bc7-be09-e6aae0982035 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:51.652748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514cf82a-7ac6-4bc7-be09-e6aae0982035 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:51.654330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:51.654761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:51.655472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:51.669575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:51.670179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:51.829916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:51.832846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-514cf82a-7ac6-4bc7-be09-e6aae0982035 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:51.838203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:51.839716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:51.840820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-514cf82a-7ac6-4bc7-be09-e6aae0982035 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.218014 Aug 24 06:18:51.840939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-42d2e36c-227f-44c6-af8a-1e74292e16c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1742 microversion: 2.20 time: 0.224261 Aug 24 06:18:51.841583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 151/304] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:51 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:51.841717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 154/305] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:51 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1742 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:51.846502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c4e849e3-b1b7-448c-b6ce-c5d1c8eb3ef6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Action: 'create', calling method: .version_select at 0x7fcddc304790>, body: {"keypair": {"name": "tempest-keypair-1291965879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxZS+eZW0vYlfg4j66JZEcQzCqL3djNG1NmA3ct+BMzbhZ4hdIPzeb6RatWZWKjEaBuKvkTDL6o+i7ENynU+dgcz+jQ5N6i/LQNiwL0UjdbovvsFRaOTkpj0udI9I29/A=="}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:51.862425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-c4e849e3-b1b7-448c-b6ce-c5d1c8eb3ef6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'key_pairs'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:18:51.867026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-c4e849e3-b1b7-448c-b6ce-c5d1c8eb3ef6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for user 6abfd0a28f9e482badae7018f1b7f9a1 and project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'key_pairs'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:18:51.890709 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dbc53cf3-6cf9-41a6-bed6-6c082c86757c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:51.891304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dbc53cf3-6cf9-41a6-bed6-6c082c86757c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:51.902772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbc53cf3-6cf9-41a6-bed6-6c082c86757c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:51.903246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbc53cf3-6cf9-41a6-bed6-6c082c86757c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:51.903677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbc53cf3-6cf9-41a6-bed6-6c082c86757c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:51.904360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbc53cf3-6cf9-41a6-bed6-6c082c86757c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:51.904856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbc53cf3-6cf9-41a6-bed6-6c082c86757c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:51.905252 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbc53cf3-6cf9-41a6-bed6-6c082c86757c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:52.195399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c4e849e3-b1b7-448c-b6ce-c5d1c8eb3ef6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.352907 Aug 24 06:18:52.202351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 152/306] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 24 06:18:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:18:52.208776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4b85f6e3-deaf-4ee7-8e1f-2c29d78c1675 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:52.209592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4b85f6e3-deaf-4ee7-8e1f-2c29d78c1675 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:52.217899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b85f6e3-deaf-4ee7-8e1f-2c29d78c1675 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:52.218394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b85f6e3-deaf-4ee7-8e1f-2c29d78c1675 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:52.218831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b85f6e3-deaf-4ee7-8e1f-2c29d78c1675 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:52.219604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b85f6e3-deaf-4ee7-8e1f-2c29d78c1675 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:52.220195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b85f6e3-deaf-4ee7-8e1f-2c29d78c1675 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:52.221104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b85f6e3-deaf-4ee7-8e1f-2c29d78c1675 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:52.243122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:52.296084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dbc53cf3-6cf9-41a6-bed6-6c082c86757c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:52.307812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dbc53cf3-6cf9-41a6-bed6-6c082c86757c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.420772 Aug 24 06:18:52.308859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 155/307] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:51 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:52.393296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4b85f6e3-deaf-4ee7-8e1f-2c29d78c1675 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:52.403809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4b85f6e3-deaf-4ee7-8e1f-2c29d78c1675 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1319 microversion: 2.1 time: 0.199841 Aug 24 06:18:52.407875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 153/308] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:52 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:52.865271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-55d52551-2584-4a09-be21-ab11ddb7c07e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:52.865271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-55d52551-2584-4a09-be21-ab11ddb7c07e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:52.870359 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:52.871514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:52.896016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:52.896580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:52.900786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:52.900786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:52.900786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:52.900786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:52.903859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55d52551-2584-4a09-be21-ab11ddb7c07e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:52.904350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55d52551-2584-4a09-be21-ab11ddb7c07e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:52.904825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55d52551-2584-4a09-be21-ab11ddb7c07e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:52.905567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55d52551-2584-4a09-be21-ab11ddb7c07e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:52.909647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55d52551-2584-4a09-be21-ab11ddb7c07e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:52.909647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55d52551-2584-4a09-be21-ab11ddb7c07e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:53.070713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-55d52551-2584-4a09-be21-ab11ddb7c07e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:53.083513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-55d52551-2584-4a09-be21-ab11ddb7c07e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.224014 Aug 24 06:18:53.084422 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 156/309] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:52 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:53.106452 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:53.115881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:53.119420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:53.120763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4712966e-8a06-49e6-a56f-3505d63213c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1742 microversion: 2.20 time: 0.253748 Aug 24 06:18:53.120929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 154/310] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1742 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:18:53.330700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c2612069-ad43-4ba6-9496-bf37808f8e8f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:53.331471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c2612069-ad43-4ba6-9496-bf37808f8e8f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:53.339110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2612069-ad43-4ba6-9496-bf37808f8e8f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:53.339583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2612069-ad43-4ba6-9496-bf37808f8e8f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:53.340059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2612069-ad43-4ba6-9496-bf37808f8e8f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:53.340782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2612069-ad43-4ba6-9496-bf37808f8e8f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:53.341240 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2612069-ad43-4ba6-9496-bf37808f8e8f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:53.341641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2612069-ad43-4ba6-9496-bf37808f8e8f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:53.426302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4cf201c2-cad7-4804-8046-26a4b038f831 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:53.429169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4cf201c2-cad7-4804-8046-26a4b038f831 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:53.448573 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cf201c2-cad7-4804-8046-26a4b038f831 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:53.449197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cf201c2-cad7-4804-8046-26a4b038f831 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:53.449692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cf201c2-cad7-4804-8046-26a4b038f831 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:53.452373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cf201c2-cad7-4804-8046-26a4b038f831 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:53.452373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cf201c2-cad7-4804-8046-26a4b038f831 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:53.452373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cf201c2-cad7-4804-8046-26a4b038f831 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:53.616968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c2612069-ad43-4ba6-9496-bf37808f8e8f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:53.633220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c2612069-ad43-4ba6-9496-bf37808f8e8f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.307426 Aug 24 06:18:53.633994 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 157/311] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:53 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:53.672440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4cf201c2-cad7-4804-8046-26a4b038f831 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:53.684488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4cf201c2-cad7-4804-8046-26a4b038f831 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1319 microversion: 2.1 time: 0.262188 Aug 24 06:18:53.698987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 155/312] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:53 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:54.109054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5cd830e0-804f-4f5b-b8f4-7aef5266342b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:54.109863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5cd830e0-804f-4f5b-b8f4-7aef5266342b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:54.121354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd830e0-804f-4f5b-b8f4-7aef5266342b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:54.122024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd830e0-804f-4f5b-b8f4-7aef5266342b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:54.122567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd830e0-804f-4f5b-b8f4-7aef5266342b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:54.123441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd830e0-804f-4f5b-b8f4-7aef5266342b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:54.123959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd830e0-804f-4f5b-b8f4-7aef5266342b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:54.124446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd830e0-804f-4f5b-b8f4-7aef5266342b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:54.146714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:54.147540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:54.154445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:54.155016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:54.155563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:54.156324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:54.156862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:54.157351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:54.344700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5cd830e0-804f-4f5b-b8f4-7aef5266342b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:54.349604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:54.357490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5cd830e0-804f-4f5b-b8f4-7aef5266342b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.253766 Aug 24 06:18:54.361641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:54.362634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 158/313] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:54 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:54.363223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:54.364527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-08b3839c-83a0-4e31-b8d1-c6147c3de3a9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1742 microversion: 2.20 time: 0.221915 Aug 24 06:18:54.369907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 156/314] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:54 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1742 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:18:54.655213 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ea47d1dd-0d03-4875-99b0-c32f96feef03 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:54.655894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ea47d1dd-0d03-4875-99b0-c32f96feef03 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:54.662339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea47d1dd-0d03-4875-99b0-c32f96feef03 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:54.662900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea47d1dd-0d03-4875-99b0-c32f96feef03 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:54.663404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea47d1dd-0d03-4875-99b0-c32f96feef03 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:54.664174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea47d1dd-0d03-4875-99b0-c32f96feef03 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:54.664671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea47d1dd-0d03-4875-99b0-c32f96feef03 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:54.665099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea47d1dd-0d03-4875-99b0-c32f96feef03 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:54.715383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d8d1b119-af15-48e7-8a31-ed0cbfba112c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:54.715994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d8d1b119-af15-48e7-8a31-ed0cbfba112c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:54.743756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8d1b119-af15-48e7-8a31-ed0cbfba112c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:54.750599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8d1b119-af15-48e7-8a31-ed0cbfba112c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:54.751299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8d1b119-af15-48e7-8a31-ed0cbfba112c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:54.752750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8d1b119-af15-48e7-8a31-ed0cbfba112c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:54.753358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8d1b119-af15-48e7-8a31-ed0cbfba112c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:54.753954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8d1b119-af15-48e7-8a31-ed0cbfba112c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:54.862652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ea47d1dd-0d03-4875-99b0-c32f96feef03 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:54.880202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ea47d1dd-0d03-4875-99b0-c32f96feef03 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.228636 Aug 24 06:18:54.881038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 159/315] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:54 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:54.913612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1662406262", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51fe0999-9ccc-4b64-9b23-f80a9285df9a"}], "security_groups": [{"name": "tempest-securitygroup--1689616798"}], "key_name": "tempest-keypair-1291965879", "user_data": "}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:18:54.964184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d8d1b119-af15-48e7-8a31-ed0cbfba112c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:54.981239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d8d1b119-af15-48e7-8a31-ed0cbfba112c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1508 microversion: 2.1 time: 0.269660 Aug 24 06:18:54.981835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 157/316] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:54 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:55.070776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.network.neutron [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] validate_networks() for [('51fe0999-9ccc-4b64-9b23-f80a9285df9a', None, None, None, None, None)] {{(pid=121150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:18:55.385748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4cedbdf9-d076-4fe6-bbac-1b162338224c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:55.386484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4cedbdf9-d076-4fe6-bbac-1b162338224c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:55.394926 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cedbdf9-d076-4fe6-bbac-1b162338224c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:55.395417 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cedbdf9-d076-4fe6-bbac-1b162338224c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:55.395877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cedbdf9-d076-4fe6-bbac-1b162338224c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:55.396667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cedbdf9-d076-4fe6-bbac-1b162338224c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:55.397346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cedbdf9-d076-4fe6-bbac-1b162338224c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:55.398036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cedbdf9-d076-4fe6-bbac-1b162338224c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:55.480713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Flavor limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:18:55.481227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Image limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:18:55.481591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Flavor pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:18:55.482043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Image pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:18:55.482469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:18:55.491632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:55.492107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:55.492573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:55.493297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:55.493744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:55.494163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:55.511607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:18:55.515600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for user 6abfd0a28f9e482badae7018f1b7f9a1 and project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:18:55.527532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Going to run 1 instances... {{(pid=121150) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:18:55.529865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:18:55.544406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4cedbdf9-d076-4fe6-bbac-1b162338224c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:55.552595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4cedbdf9-d076-4fe6-bbac-1b162338224c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.170963 Aug 24 06:18:55.561677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 158/317] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:55 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:55.561677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:55.561677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:55.566649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:55.567304 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:55.567735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:55.568458 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:55.568958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:55.569377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:55.663602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cce43bcd-c933-418b-9f92-d91e71adbd2c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.758273 Aug 24 06:18:55.669974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 160/318] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:18:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:18:55.687257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ae899b6b-7cda-4a47-87c0-a6bf412e5d36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:55.694141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ae899b6b-7cda-4a47-87c0-a6bf412e5d36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:55.765395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:55.773518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ae899b6b-7cda-4a47-87c0-a6bf412e5d36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:55.777725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:55.779624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:55.781388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ae899b6b-7cda-4a47-87c0-a6bf412e5d36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1242 microversion: 2.1 time: 0.104305 Aug 24 06:18:55.781689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a30c1724-2710-4348-984c-93fef847c85a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1742 microversion: 2.20 time: 0.227378 Aug 24 06:18:55.782098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 161/319] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:55 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:55.797206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 159/320] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1742 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:55.903291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-67616d0a-b00e-4005-8cf4-07fb710ea1a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:55.904383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-67616d0a-b00e-4005-8cf4-07fb710ea1a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:55.923901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67616d0a-b00e-4005-8cf4-07fb710ea1a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:55.924792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67616d0a-b00e-4005-8cf4-07fb710ea1a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:55.925803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67616d0a-b00e-4005-8cf4-07fb710ea1a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:55.926716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67616d0a-b00e-4005-8cf4-07fb710ea1a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:55.927407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67616d0a-b00e-4005-8cf4-07fb710ea1a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:55.927936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67616d0a-b00e-4005-8cf4-07fb710ea1a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:56.106230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-67616d0a-b00e-4005-8cf4-07fb710ea1a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:56.119003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-67616d0a-b00e-4005-8cf4-07fb710ea1a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.221018 Aug 24 06:18:56.120238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 162/321] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:55 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:56.574741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8aad2d7d-baa4-4cf0-9bd0-da2fa2ceae76 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:56.576797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8aad2d7d-baa4-4cf0-9bd0-da2fa2ceae76 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:56.579929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:56.585000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8aad2d7d-baa4-4cf0-9bd0-da2fa2ceae76 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:56.587132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8aad2d7d-baa4-4cf0-9bd0-da2fa2ceae76 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:56.587811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8aad2d7d-baa4-4cf0-9bd0-da2fa2ceae76 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:56.588801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8aad2d7d-baa4-4cf0-9bd0-da2fa2ceae76 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:56.589459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8aad2d7d-baa4-4cf0-9bd0-da2fa2ceae76 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:56.590100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8aad2d7d-baa4-4cf0-9bd0-da2fa2ceae76 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:56.759454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8aad2d7d-baa4-4cf0-9bd0-da2fa2ceae76 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:56.770070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8aad2d7d-baa4-4cf0-9bd0-da2fa2ceae76 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.200001 Aug 24 06:18:56.772241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 160/322] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:56 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:56.805664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-74c5c2e2-44fe-4e61-979b-59098ad36a18 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:56.806558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-74c5c2e2-44fe-4e61-979b-59098ad36a18 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:56.818829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:56.819433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:56.823897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74c5c2e2-44fe-4e61-979b-59098ad36a18 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:56.825745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74c5c2e2-44fe-4e61-979b-59098ad36a18 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:56.825745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74c5c2e2-44fe-4e61-979b-59098ad36a18 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:56.828030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:56.828532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:56.828969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:56.830197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74c5c2e2-44fe-4e61-979b-59098ad36a18 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:56.830915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74c5c2e2-44fe-4e61-979b-59098ad36a18 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:56.831693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74c5c2e2-44fe-4e61-979b-59098ad36a18 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:56.832541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:56.833101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:56.833548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:56.924363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-74c5c2e2-44fe-4e61-979b-59098ad36a18 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:56.933976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-74c5c2e2-44fe-4e61-979b-59098ad36a18 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1246 microversion: 2.1 time: 0.132623 Aug 24 06:18:56.935015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 163/323] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:56 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1246 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:57.042610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:57.061131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:57.062981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:57.064698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-52ecc678-b924-4a56-a370-b6d4c1186af1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1742 microversion: 2.20 time: 0.250305 Aug 24 06:18:57.065647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 161/324] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1742 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:57.144862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b6bd5dee-ba6a-475c-9d8d-c7dd391c99e0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:57.145831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b6bd5dee-ba6a-475c-9d8d-c7dd391c99e0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:57.152646 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6bd5dee-ba6a-475c-9d8d-c7dd391c99e0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:57.153129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6bd5dee-ba6a-475c-9d8d-c7dd391c99e0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:57.153757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6bd5dee-ba6a-475c-9d8d-c7dd391c99e0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:57.154607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6bd5dee-ba6a-475c-9d8d-c7dd391c99e0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:57.155201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6bd5dee-ba6a-475c-9d8d-c7dd391c99e0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:57.155774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6bd5dee-ba6a-475c-9d8d-c7dd391c99e0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:57.338833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b6bd5dee-ba6a-475c-9d8d-c7dd391c99e0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:57.348203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b6bd5dee-ba6a-475c-9d8d-c7dd391c99e0 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.207023 Aug 24 06:18:57.349485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 164/325] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:57 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:57.792306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-93547088-e34c-478f-95c8-17fab47ddb97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:57.792933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-93547088-e34c-478f-95c8-17fab47ddb97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:57.804917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93547088-e34c-478f-95c8-17fab47ddb97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:57.805407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93547088-e34c-478f-95c8-17fab47ddb97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:57.805840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93547088-e34c-478f-95c8-17fab47ddb97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:57.806545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93547088-e34c-478f-95c8-17fab47ddb97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:57.806987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93547088-e34c-478f-95c8-17fab47ddb97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:57.807566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93547088-e34c-478f-95c8-17fab47ddb97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:57.957432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-26c4de19-e83f-4a6c-ae53-a1dcc29351f2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:57.958058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-26c4de19-e83f-4a6c-ae53-a1dcc29351f2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:57.973322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-93547088-e34c-478f-95c8-17fab47ddb97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:57.978126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26c4de19-e83f-4a6c-ae53-a1dcc29351f2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:57.978627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26c4de19-e83f-4a6c-ae53-a1dcc29351f2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:57.979057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26c4de19-e83f-4a6c-ae53-a1dcc29351f2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:57.979776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26c4de19-e83f-4a6c-ae53-a1dcc29351f2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:57.980213 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26c4de19-e83f-4a6c-ae53-a1dcc29351f2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:57.980456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-93547088-e34c-478f-95c8-17fab47ddb97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.191829 Aug 24 06:18:57.980721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26c4de19-e83f-4a6c-ae53-a1dcc29351f2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:57.981203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 162/326] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:57 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:58.063240 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-26c4de19-e83f-4a6c-ae53-a1dcc29351f2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:58.077835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-26c4de19-e83f-4a6c-ae53-a1dcc29351f2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1294 microversion: 2.1 time: 0.125579 Aug 24 06:18:58.084544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 165/327] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:57 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1294 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:18:58.100210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:58.102718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:58.109554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:58.118379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:58.118379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:58.118379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:58.118379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:58.118948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:58.336255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:58.350632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:58.353779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:58.354977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3f427360-528a-495b-be8f-2e8ebd1d1d76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1742 microversion: 2.20 time: 0.267747 Aug 24 06:18:58.370525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 163/328] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:58 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1742 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:58.371317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d847e6e4-6c94-4bec-b3d4-94027cca4f88 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:58.372151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d847e6e4-6c94-4bec-b3d4-94027cca4f88 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:58.381911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d847e6e4-6c94-4bec-b3d4-94027cca4f88 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:58.382910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d847e6e4-6c94-4bec-b3d4-94027cca4f88 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:58.383532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d847e6e4-6c94-4bec-b3d4-94027cca4f88 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:58.391656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d847e6e4-6c94-4bec-b3d4-94027cca4f88 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:58.391656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d847e6e4-6c94-4bec-b3d4-94027cca4f88 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:58.391656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d847e6e4-6c94-4bec-b3d4-94027cca4f88 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:58.596529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d847e6e4-6c94-4bec-b3d4-94027cca4f88 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:58.605443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d847e6e4-6c94-4bec-b3d4-94027cca4f88 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.238118 Aug 24 06:18:58.606029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 166/329] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:58 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:59.001874 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f85e5dfe-0b44-4a45-941d-45c9c6165a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:59.002492 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f85e5dfe-0b44-4a45-941d-45c9c6165a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:59.023627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f85e5dfe-0b44-4a45-941d-45c9c6165a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:59.024257 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f85e5dfe-0b44-4a45-941d-45c9c6165a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:59.024800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f85e5dfe-0b44-4a45-941d-45c9c6165a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:59.025584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f85e5dfe-0b44-4a45-941d-45c9c6165a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:59.026156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f85e5dfe-0b44-4a45-941d-45c9c6165a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:59.026619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f85e5dfe-0b44-4a45-941d-45c9c6165a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:59.101695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1668308f-dca1-4db3-aa1f-aca828036312 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:59.102364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1668308f-dca1-4db3-aa1f-aca828036312 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:59.108701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1668308f-dca1-4db3-aa1f-aca828036312 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:59.109538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1668308f-dca1-4db3-aa1f-aca828036312 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:59.110235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1668308f-dca1-4db3-aa1f-aca828036312 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:59.111148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1668308f-dca1-4db3-aa1f-aca828036312 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:59.111604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1668308f-dca1-4db3-aa1f-aca828036312 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:59.112055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1668308f-dca1-4db3-aa1f-aca828036312 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:59.183034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1668308f-dca1-4db3-aa1f-aca828036312 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:59.193241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1668308f-dca1-4db3-aa1f-aca828036312 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1300 microversion: 2.1 time: 0.094184 Aug 24 06:18:59.193241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 167/330] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:59 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:59.268701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f85e5dfe-0b44-4a45-941d-45c9c6165a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:59.276515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f85e5dfe-0b44-4a45-941d-45c9c6165a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.279046 Aug 24 06:18:59.277100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 164/331] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:58 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:18:59.383478 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:59.384195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:59.390246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:59.390727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:59.391155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:59.391844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:59.392290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:59.394962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:59.419032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:18:59.575783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:59.588917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:59.603783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:59.606027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1fb2905f-55c9-45d5-b15e-1a479f688854 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1742 microversion: 2.20 time: 0.227092 Aug 24 06:18:59.608384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 168/332] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:18:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1742 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:18:59.635913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-28c20bc2-b4a3-41ca-bbb7-73b78b9dc257 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:18:59.636811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-28c20bc2-b4a3-41ca-bbb7-73b78b9dc257 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:18:59.649680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28c20bc2-b4a3-41ca-bbb7-73b78b9dc257 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:59.650802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28c20bc2-b4a3-41ca-bbb7-73b78b9dc257 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:59.651861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28c20bc2-b4a3-41ca-bbb7-73b78b9dc257 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:59.664138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28c20bc2-b4a3-41ca-bbb7-73b78b9dc257 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:18:59.665023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28c20bc2-b4a3-41ca-bbb7-73b78b9dc257 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:18:59.666093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28c20bc2-b4a3-41ca-bbb7-73b78b9dc257 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:18:59.878157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-28c20bc2-b4a3-41ca-bbb7-73b78b9dc257 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:18:59.893016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-28c20bc2-b4a3-41ca-bbb7-73b78b9dc257 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.265519 Aug 24 06:18:59.896104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 165/333] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:18:59 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:00.216594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-994a2739-5438-4e33-8269-cb8ed2a1ae36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:00.217691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-994a2739-5438-4e33-8269-cb8ed2a1ae36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:00.228087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994a2739-5438-4e33-8269-cb8ed2a1ae36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:00.228819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994a2739-5438-4e33-8269-cb8ed2a1ae36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:00.229455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994a2739-5438-4e33-8269-cb8ed2a1ae36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:00.230509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994a2739-5438-4e33-8269-cb8ed2a1ae36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:00.231192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994a2739-5438-4e33-8269-cb8ed2a1ae36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:00.231811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994a2739-5438-4e33-8269-cb8ed2a1ae36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:00.304676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-01ef8514-30ba-4f34-a3d8-273f8653329a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:00.305696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-01ef8514-30ba-4f34-a3d8-273f8653329a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:00.312210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01ef8514-30ba-4f34-a3d8-273f8653329a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:00.312678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01ef8514-30ba-4f34-a3d8-273f8653329a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:00.313321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01ef8514-30ba-4f34-a3d8-273f8653329a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:00.314026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01ef8514-30ba-4f34-a3d8-273f8653329a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:00.314472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01ef8514-30ba-4f34-a3d8-273f8653329a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:00.314890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01ef8514-30ba-4f34-a3d8-273f8653329a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:00.420507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-994a2739-5438-4e33-8269-cb8ed2a1ae36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:00.428750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-994a2739-5438-4e33-8269-cb8ed2a1ae36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1368 microversion: 2.1 time: 0.218068 Aug 24 06:19:00.429321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 169/334] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:00 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:00.562696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-01ef8514-30ba-4f34-a3d8-273f8653329a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:00.572303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-01ef8514-30ba-4f34-a3d8-273f8653329a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.273959 Aug 24 06:19:00.824401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 166/335] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:00 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:00.825851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:00.825851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:00.825851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:00.825851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:00.826364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:00.826364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:00.826364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:00.826364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:00.826631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:00.826631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:00.826818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:00.826818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3ff7a30a-30de-4511-8164-d2061db9e7dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1742 microversion: 2.20 time: 0.157189 Aug 24 06:19:00.826818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 170/336] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:00 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:19:00.919168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b413924c-85d5-456d-b511-6a2730b6c85a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:00.919794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b413924c-85d5-456d-b511-6a2730b6c85a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:00.926910 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b413924c-85d5-456d-b511-6a2730b6c85a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:00.927395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b413924c-85d5-456d-b511-6a2730b6c85a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:00.928048 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b413924c-85d5-456d-b511-6a2730b6c85a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:00.928737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b413924c-85d5-456d-b511-6a2730b6c85a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:00.929260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b413924c-85d5-456d-b511-6a2730b6c85a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:00.929755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b413924c-85d5-456d-b511-6a2730b6c85a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:01.160442 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b413924c-85d5-456d-b511-6a2730b6c85a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:01.169041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b413924c-85d5-456d-b511-6a2730b6c85a tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.253742 Aug 24 06:19:01.169811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 167/337] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:00 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:01.317555 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-be942682-5ea6-48a0-b2c4-b6b7de3bacea req-e12697d7-a172-4823-beec-85323f5a6ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183454a1-0335-4121-8d9f-c6599b8f2532", "tag": "8f28ca28-dd97-4a09-8e4f-a05e462a5fa6"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:01.323205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-be942682-5ea6-48a0-b2c4-b6b7de3bacea req-e12697d7-a172-4823-beec-85323f5a6ce3 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:01.323677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-be942682-5ea6-48a0-b2c4-b6b7de3bacea req-e12697d7-a172-4823-beec-85323f5a6ce3 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:01.324106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-be942682-5ea6-48a0-b2c4-b6b7de3bacea req-e12697d7-a172-4823-beec-85323f5a6ce3 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:01.337704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-be942682-5ea6-48a0-b2c4-b6b7de3bacea req-e12697d7-a172-4823-beec-85323f5a6ce3 service nova] Creating event network-changed:8f28ca28-dd97-4a09-8e4f-a05e462a5fa6 for instance 183454a1-0335-4121-8d9f-c6599b8f2532 on hv-cinder-85426 Aug 24 06:19:01.345758 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-be942682-5ea6-48a0-b2c4-b6b7de3bacea req-e12697d7-a172-4823-beec-85323f5a6ce3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033159 Aug 24 06:19:01.345758 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 171/338] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:19:01.451260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-507de810-8844-4610-baa3-5762f09c36b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:01.451851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-507de810-8844-4610-baa3-5762f09c36b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:01.458996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-507de810-8844-4610-baa3-5762f09c36b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:01.459475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-507de810-8844-4610-baa3-5762f09c36b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:01.459908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-507de810-8844-4610-baa3-5762f09c36b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:01.460619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-507de810-8844-4610-baa3-5762f09c36b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:01.461068 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-507de810-8844-4610-baa3-5762f09c36b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:01.461490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-507de810-8844-4610-baa3-5762f09c36b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:01.591395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-507de810-8844-4610-baa3-5762f09c36b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:01.599112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-507de810-8844-4610-baa3-5762f09c36b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1368 microversion: 2.1 time: 0.151825 Aug 24 06:19:01.599617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 168/339] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:01 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:01.837804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2553f86c-2fc1-4958-ae0e-b69dbbb728f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:01.838613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2553f86c-2fc1-4958-ae0e-b69dbbb728f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:01.840666 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:01.844479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:01.845885 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2553f86c-2fc1-4958-ae0e-b69dbbb728f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:01.846471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2553f86c-2fc1-4958-ae0e-b69dbbb728f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:01.847000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2553f86c-2fc1-4958-ae0e-b69dbbb728f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:01.847807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2553f86c-2fc1-4958-ae0e-b69dbbb728f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:01.848361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2553f86c-2fc1-4958-ae0e-b69dbbb728f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:01.849222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2553f86c-2fc1-4958-ae0e-b69dbbb728f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:01.849788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:01.850451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:01.851227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:01.851927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:01.852375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:01.853005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:01.874382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=4 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:01.989096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2553f86c-2fc1-4958-ae0e-b69dbbb728f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:01.997689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2553f86c-2fc1-4958-ae0e-b69dbbb728f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.164806 Aug 24 06:19:01.998261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 172/340] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:01 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:02.147233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:02.155689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:02.157301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:02.158925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c749cad7-d3d9-4587-9275-38927153bba6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1724 microversion: 2.20 time: 0.322317 Aug 24 06:19:02.159478 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 169/341] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1724 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:19:02.190935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-42d18246-0857-42c6-a4af-fa8bc7b339de tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:02.191577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-42d18246-0857-42c6-a4af-fa8bc7b339de tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:02.197802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d18246-0857-42c6-a4af-fa8bc7b339de tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:02.198287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d18246-0857-42c6-a4af-fa8bc7b339de tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:02.199165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d18246-0857-42c6-a4af-fa8bc7b339de tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:02.199396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d18246-0857-42c6-a4af-fa8bc7b339de tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:02.199847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d18246-0857-42c6-a4af-fa8bc7b339de tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:02.200264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42d18246-0857-42c6-a4af-fa8bc7b339de tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:02.341795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-42d18246-0857-42c6-a4af-fa8bc7b339de tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:02.350817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-42d18246-0857-42c6-a4af-fa8bc7b339de tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.163711 Aug 24 06:19:02.354915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 173/342] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:02 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:02.620465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e8e60632-3446-4ad1-a404-e89b923353cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:02.624538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e8e60632-3446-4ad1-a404-e89b923353cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:02.628347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e60632-3446-4ad1-a404-e89b923353cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:02.629102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e60632-3446-4ad1-a404-e89b923353cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:02.629536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e60632-3446-4ad1-a404-e89b923353cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:02.630243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e60632-3446-4ad1-a404-e89b923353cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:02.630786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e60632-3446-4ad1-a404-e89b923353cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:02.631260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e60632-3446-4ad1-a404-e89b923353cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:02.635636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:02.847069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e8e60632-3446-4ad1-a404-e89b923353cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:02.855511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e8e60632-3446-4ad1-a404-e89b923353cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1368 microversion: 2.1 time: 0.238860 Aug 24 06:19:02.856100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 170/343] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:02 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1368 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:03.019907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f2a47f2f-1c0f-4425-a622-a4ba538e3361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:03.020567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f2a47f2f-1c0f-4425-a622-a4ba538e3361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:03.027183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2a47f2f-1c0f-4425-a622-a4ba538e3361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:03.027661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2a47f2f-1c0f-4425-a622-a4ba538e3361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:03.028094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2a47f2f-1c0f-4425-a622-a4ba538e3361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:03.028812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2a47f2f-1c0f-4425-a622-a4ba538e3361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:03.029265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2a47f2f-1c0f-4425-a622-a4ba538e3361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:03.029685 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2a47f2f-1c0f-4425-a622-a4ba538e3361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:03.158760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f2a47f2f-1c0f-4425-a622-a4ba538e3361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:03.166755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f2a47f2f-1c0f-4425-a622-a4ba538e3361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.151324 Aug 24 06:19:03.167334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 174/344] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:03 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:03.189583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:03.190184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:03.196140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:03.196649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:03.197071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:03.197745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:03.198196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:03.198636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:03.326681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:03.334878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:03.336364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:03.337551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-471f1f4e-db34-4244-a25f-26adb5eee2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1724 microversion: 2.20 time: 0.158998 Aug 24 06:19:03.338109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 171/345] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:03.371705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4a2f628e-45b0-4744-9f78-e7c28639f599 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:03.372324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4a2f628e-45b0-4744-9f78-e7c28639f599 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:03.378984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a2f628e-45b0-4744-9f78-e7c28639f599 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:03.379477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a2f628e-45b0-4744-9f78-e7c28639f599 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:03.379900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a2f628e-45b0-4744-9f78-e7c28639f599 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:03.380605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a2f628e-45b0-4744-9f78-e7c28639f599 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:03.381061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a2f628e-45b0-4744-9f78-e7c28639f599 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:03.381476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a2f628e-45b0-4744-9f78-e7c28639f599 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:03.516822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4a2f628e-45b0-4744-9f78-e7c28639f599 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:03.526308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4a2f628e-45b0-4744-9f78-e7c28639f599 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.158246 Aug 24 06:19:03.526866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 175/346] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:03 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:03.881912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-995224b5-f090-485a-87d4-2f81bdd802dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:03.882454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-995224b5-f090-485a-87d4-2f81bdd802dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:03.888847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-995224b5-f090-485a-87d4-2f81bdd802dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:03.889321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-995224b5-f090-485a-87d4-2f81bdd802dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:03.889783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-995224b5-f090-485a-87d4-2f81bdd802dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:03.890488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-995224b5-f090-485a-87d4-2f81bdd802dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:03.890938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-995224b5-f090-485a-87d4-2f81bdd802dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:03.891354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-995224b5-f090-485a-87d4-2f81bdd802dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:04.025897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-995224b5-f090-485a-87d4-2f81bdd802dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:04.034335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-995224b5-f090-485a-87d4-2f81bdd802dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1368 microversion: 2.1 time: 0.156439 Aug 24 06:19:04.034890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 172/347] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:03 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:04.187707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a79f296e-67cf-4dea-b30e-52dddcd64c23 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:04.188304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a79f296e-67cf-4dea-b30e-52dddcd64c23 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:04.194767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a79f296e-67cf-4dea-b30e-52dddcd64c23 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:04.195241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a79f296e-67cf-4dea-b30e-52dddcd64c23 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:04.195670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a79f296e-67cf-4dea-b30e-52dddcd64c23 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:04.196348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a79f296e-67cf-4dea-b30e-52dddcd64c23 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:04.196855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a79f296e-67cf-4dea-b30e-52dddcd64c23 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:04.197265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a79f296e-67cf-4dea-b30e-52dddcd64c23 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:04.331892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a79f296e-67cf-4dea-b30e-52dddcd64c23 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:04.339703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a79f296e-67cf-4dea-b30e-52dddcd64c23 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.155828 Aug 24 06:19:04.340260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 176/348] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:04 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:04.362977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:04.363580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:04.369634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:04.370139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:04.370570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:04.371252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:04.371701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:04.372120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:04.502568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:04.511560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:04.513099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:04.514288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9532b366-063f-44d7-9ea3-aa747c372a4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1724 microversion: 2.20 time: 0.155076 Aug 24 06:19:04.514850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 173/349] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:04 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:04.547388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fea5d989-ed79-43b3-bfa1-e67f3c37dfab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:04.548038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fea5d989-ed79-43b3-bfa1-e67f3c37dfab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:04.554374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fea5d989-ed79-43b3-bfa1-e67f3c37dfab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:04.554860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fea5d989-ed79-43b3-bfa1-e67f3c37dfab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:04.555291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fea5d989-ed79-43b3-bfa1-e67f3c37dfab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:04.555979 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fea5d989-ed79-43b3-bfa1-e67f3c37dfab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:04.556425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fea5d989-ed79-43b3-bfa1-e67f3c37dfab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:04.556871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fea5d989-ed79-43b3-bfa1-e67f3c37dfab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:04.689569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fea5d989-ed79-43b3-bfa1-e67f3c37dfab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:04.697815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fea5d989-ed79-43b3-bfa1-e67f3c37dfab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.154616 Aug 24 06:19:04.698374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 177/350] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:04 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:05.055756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bc8daf48-5116-4df2-bcc8-80b343e93665 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:05.056334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bc8daf48-5116-4df2-bcc8-80b343e93665 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:05.062704 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8daf48-5116-4df2-bcc8-80b343e93665 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:05.063181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8daf48-5116-4df2-bcc8-80b343e93665 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:05.063610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8daf48-5116-4df2-bcc8-80b343e93665 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:05.064295 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8daf48-5116-4df2-bcc8-80b343e93665 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:05.065325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8daf48-5116-4df2-bcc8-80b343e93665 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:05.065743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8daf48-5116-4df2-bcc8-80b343e93665 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:05.197963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bc8daf48-5116-4df2-bcc8-80b343e93665 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:05.206218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bc8daf48-5116-4df2-bcc8-80b343e93665 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1368 microversion: 2.1 time: 0.153801 Aug 24 06:19:05.206784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 174/351] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:05 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:05.362303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f63f81a8-95f2-41d1-b571-0925968e17f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:05.362839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f63f81a8-95f2-41d1-b571-0925968e17f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:05.369587 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f63f81a8-95f2-41d1-b571-0925968e17f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:05.370067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f63f81a8-95f2-41d1-b571-0925968e17f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:05.370521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f63f81a8-95f2-41d1-b571-0925968e17f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:05.371200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f63f81a8-95f2-41d1-b571-0925968e17f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:05.371643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f63f81a8-95f2-41d1-b571-0925968e17f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:05.372082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f63f81a8-95f2-41d1-b571-0925968e17f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:05.500786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:05.505896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f63f81a8-95f2-41d1-b571-0925968e17f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:05.513537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f63f81a8-95f2-41d1-b571-0925968e17f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.156128 Aug 24 06:19:05.514094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 178/352] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:05 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:05.537825 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:05.538426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:05.544364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:05.544942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:05.545367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:05.546056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:05.546499 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:05.546911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:05.685736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:05.694915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:05.696657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:05.697949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-788d451e-f555-47fc-9248-2d608d4d9580 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1724 microversion: 2.20 time: 0.164274 Aug 24 06:19:05.698574 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 175/353] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:05.719221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-35bbd4a1-bca2-434b-ba40-9a03fa74be70 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:05.719833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-35bbd4a1-bca2-434b-ba40-9a03fa74be70 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:05.726618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35bbd4a1-bca2-434b-ba40-9a03fa74be70 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:05.727094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35bbd4a1-bca2-434b-ba40-9a03fa74be70 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:05.727527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35bbd4a1-bca2-434b-ba40-9a03fa74be70 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:05.728207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35bbd4a1-bca2-434b-ba40-9a03fa74be70 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:05.728690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35bbd4a1-bca2-434b-ba40-9a03fa74be70 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:05.729111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35bbd4a1-bca2-434b-ba40-9a03fa74be70 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:05.778894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=8 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:05.866706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-35bbd4a1-bca2-434b-ba40-9a03fa74be70 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:05.875035 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-35bbd4a1-bca2-434b-ba40-9a03fa74be70 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.159987 Aug 24 06:19:05.875612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 179/354] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:05 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:06.227863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3c5f9e02-e0c7-4883-bf31-df02d8c84535 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:06.228465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3c5f9e02-e0c7-4883-bf31-df02d8c84535 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:06.235668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c5f9e02-e0c7-4883-bf31-df02d8c84535 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:06.236315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c5f9e02-e0c7-4883-bf31-df02d8c84535 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:06.236907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c5f9e02-e0c7-4883-bf31-df02d8c84535 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:06.237651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c5f9e02-e0c7-4883-bf31-df02d8c84535 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:06.238140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c5f9e02-e0c7-4883-bf31-df02d8c84535 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:06.238565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c5f9e02-e0c7-4883-bf31-df02d8c84535 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:06.374212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3c5f9e02-e0c7-4883-bf31-df02d8c84535 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:06.381826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3c5f9e02-e0c7-4883-bf31-df02d8c84535 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1368 microversion: 2.1 time: 0.157761 Aug 24 06:19:06.385057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 176/355] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:06 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:06.534456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0a7bed86-b82d-43ed-aea2-4234c1b1fbc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:06.535059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0a7bed86-b82d-43ed-aea2-4234c1b1fbc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:06.542144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a7bed86-b82d-43ed-aea2-4234c1b1fbc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:06.542656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a7bed86-b82d-43ed-aea2-4234c1b1fbc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:06.543261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a7bed86-b82d-43ed-aea2-4234c1b1fbc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:06.543945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a7bed86-b82d-43ed-aea2-4234c1b1fbc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:06.544763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a7bed86-b82d-43ed-aea2-4234c1b1fbc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:06.544872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a7bed86-b82d-43ed-aea2-4234c1b1fbc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:06.678727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-2ae1fd7d-c7d9-4717-839a-759255eaa724 req-4ee0606c-aaea-43c3-b19e-bc0e35d50108 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9", "name": "network-vif-unplugged", "status": "completed", "tag": "6fa5961a-6a56-4ea0-88f8-85ee1d70c184"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:06.690252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-2ae1fd7d-c7d9-4717-839a-759255eaa724 req-4ee0606c-aaea-43c3-b19e-bc0e35d50108 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:06.690664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-2ae1fd7d-c7d9-4717-839a-759255eaa724 req-4ee0606c-aaea-43c3-b19e-bc0e35d50108 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:06.691099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-2ae1fd7d-c7d9-4717-839a-759255eaa724 req-4ee0606c-aaea-43c3-b19e-bc0e35d50108 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:06.702418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-2ae1fd7d-c7d9-4717-839a-759255eaa724 req-4ee0606c-aaea-43c3-b19e-bc0e35d50108 service nova] Creating event network-vif-unplugged:6fa5961a-6a56-4ea0-88f8-85ee1d70c184 for instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 on hv-cinder-85426 Aug 24 06:19:06.709061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0a7bed86-b82d-43ed-aea2-4234c1b1fbc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:06.709205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-2ae1fd7d-c7d9-4717-839a-759255eaa724 req-4ee0606c-aaea-43c3-b19e-bc0e35d50108 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035195 Aug 24 06:19:06.710059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 177/356] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:19:06.715854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0a7bed86-b82d-43ed-aea2-4234c1b1fbc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.185117 Aug 24 06:19:06.717016 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 180/357] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:06 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:06.725273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:06.726449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:06.732152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:06.732677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:06.733114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:06.733809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:06.734249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:06.734667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:06.875291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:06.885003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:06.886553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:06.887891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-522d0b0f-7875-454d-8880-5722253e3845 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1727 microversion: 2.20 time: 0.170851 Aug 24 06:19:06.888461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 178/358] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:19:06.895902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8e25b18a-3f31-49a6-a990-bc21476e6df7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:06.896524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8e25b18a-3f31-49a6-a990-bc21476e6df7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:06.902448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e25b18a-3f31-49a6-a990-bc21476e6df7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:06.902923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e25b18a-3f31-49a6-a990-bc21476e6df7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:06.903352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e25b18a-3f31-49a6-a990-bc21476e6df7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:06.904069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e25b18a-3f31-49a6-a990-bc21476e6df7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:06.904621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e25b18a-3f31-49a6-a990-bc21476e6df7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:06.905213 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e25b18a-3f31-49a6-a990-bc21476e6df7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:06.910824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3cc8fc94-539e-4cf6-9599-1adfd0813457 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a01f5e3e-39bb-4b44-a27c-72b28f97b3ea"}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:06.914444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3cc8fc94-539e-4cf6-9599-1adfd0813457 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:06.920421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cc8fc94-539e-4cf6-9599-1adfd0813457 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:06.920984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cc8fc94-539e-4cf6-9599-1adfd0813457 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:06.921416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cc8fc94-539e-4cf6-9599-1adfd0813457 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:06.930139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cc8fc94-539e-4cf6-9599-1adfd0813457 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:06.930139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cc8fc94-539e-4cf6-9599-1adfd0813457 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:06.930139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cc8fc94-539e-4cf6-9599-1adfd0813457 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:07.036849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8e25b18a-3f31-49a6-a990-bc21476e6df7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:07.045178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8e25b18a-3f31-49a6-a990-bc21476e6df7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.153407 Aug 24 06:19:07.045737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 181/359] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:06 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:07.403341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-72890b13-bf1d-441e-a2f8-88b5d8518f4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:07.403943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-72890b13-bf1d-441e-a2f8-88b5d8518f4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:07.409897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72890b13-bf1d-441e-a2f8-88b5d8518f4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:07.410373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72890b13-bf1d-441e-a2f8-88b5d8518f4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:07.410803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72890b13-bf1d-441e-a2f8-88b5d8518f4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:07.411483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72890b13-bf1d-441e-a2f8-88b5d8518f4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:07.411931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72890b13-bf1d-441e-a2f8-88b5d8518f4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:07.412348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72890b13-bf1d-441e-a2f8-88b5d8518f4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:07.541851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-72890b13-bf1d-441e-a2f8-88b5d8518f4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:07.550814 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-72890b13-bf1d-441e-a2f8-88b5d8518f4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1368 microversion: 2.1 time: 0.151031 Aug 24 06:19:07.551391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 182/360] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:07 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:07.667614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3cc8fc94-539e-4cf6-9599-1adfd0813457 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "POST /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.761408 Aug 24 06:19:07.668176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 179/361] 10.222.0.62 () {62 vars in 1364 bytes} [Wed Aug 24 06:19:06 2022] POST /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 188 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:19:07.737523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fd29fc93-bc10-40dc-9c55-4f0039256b6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:07.738123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fd29fc93-bc10-40dc-9c55-4f0039256b6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:07.744151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd29fc93-bc10-40dc-9c55-4f0039256b6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:07.744661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd29fc93-bc10-40dc-9c55-4f0039256b6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:07.745272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd29fc93-bc10-40dc-9c55-4f0039256b6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:07.745943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd29fc93-bc10-40dc-9c55-4f0039256b6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:07.746588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd29fc93-bc10-40dc-9c55-4f0039256b6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:07.747006 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd29fc93-bc10-40dc-9c55-4f0039256b6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:07.797974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3d0a485f-89df-42f7-a970-35278197a41b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:07.798567 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3d0a485f-89df-42f7-a970-35278197a41b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:07.805519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d0a485f-89df-42f7-a970-35278197a41b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:07.806005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d0a485f-89df-42f7-a970-35278197a41b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:07.806437 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d0a485f-89df-42f7-a970-35278197a41b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:07.807131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d0a485f-89df-42f7-a970-35278197a41b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:07.807578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d0a485f-89df-42f7-a970-35278197a41b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:07.807996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d0a485f-89df-42f7-a970-35278197a41b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:07.851150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3d0a485f-89df-42f7-a970-35278197a41b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121151) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 06:19:07.881126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fd29fc93-bc10-40dc-9c55-4f0039256b6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:07.888728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fd29fc93-bc10-40dc-9c55-4f0039256b6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.155465 Aug 24 06:19:07.889286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 183/362] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:07 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:08.066915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-42a50844-cb85-4ee7-8849-b2e41ab47fb9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:08.067631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-42a50844-cb85-4ee7-8849-b2e41ab47fb9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:08.073843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42a50844-cb85-4ee7-8849-b2e41ab47fb9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:08.074315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42a50844-cb85-4ee7-8849-b2e41ab47fb9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:08.080633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42a50844-cb85-4ee7-8849-b2e41ab47fb9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:08.080633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42a50844-cb85-4ee7-8849-b2e41ab47fb9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:08.080633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42a50844-cb85-4ee7-8849-b2e41ab47fb9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:08.080633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42a50844-cb85-4ee7-8849-b2e41ab47fb9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:08.202320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-42a50844-cb85-4ee7-8849-b2e41ab47fb9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:08.210389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-42a50844-cb85-4ee7-8849-b2e41ab47fb9 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.147740 Aug 24 06:19:08.210945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 184/363] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:08 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:08.226835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3d0a485f-89df-42f7-a970-35278197a41b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "POST /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/action" status: 202 len: 0 microversion: 2.20 time: 0.432740 Aug 24 06:19:08.227448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 180/364] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Aug 24 06:19:07 2022] POST /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:19:08.235624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:08.236235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:08.243110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:08.244733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:08.244733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:08.244923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:08.245262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:08.245688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:08.381216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:08.384679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:08.390145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:08.391651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:08.393385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c806923e-ea40-492f-9c26-20b2e850b31c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1753 microversion: 2.20 time: 0.161098 Aug 24 06:19:08.393937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 185/365] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:08.571729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cda9b523-09aa-4df8-ae22-6f2f2606e322 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:08.572755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cda9b523-09aa-4df8-ae22-6f2f2606e322 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:08.578973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda9b523-09aa-4df8-ae22-6f2f2606e322 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:08.579497 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda9b523-09aa-4df8-ae22-6f2f2606e322 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:08.579925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda9b523-09aa-4df8-ae22-6f2f2606e322 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:08.581168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda9b523-09aa-4df8-ae22-6f2f2606e322 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:08.581625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda9b523-09aa-4df8-ae22-6f2f2606e322 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:08.582064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda9b523-09aa-4df8-ae22-6f2f2606e322 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:08.723839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cda9b523-09aa-4df8-ae22-6f2f2606e322 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:08.731682 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cda9b523-09aa-4df8-ae22-6f2f2606e322 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1368 microversion: 2.1 time: 0.164345 Aug 24 06:19:08.732251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 181/366] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:08 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:08.909929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-06bdbd58-2686-4dd6-858e-7c4fea343052 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:08.910537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-06bdbd58-2686-4dd6-858e-7c4fea343052 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:08.917498 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-06bdbd58-2686-4dd6-858e-7c4fea343052 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:08.917980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-06bdbd58-2686-4dd6-858e-7c4fea343052 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:08.918411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-06bdbd58-2686-4dd6-858e-7c4fea343052 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:08.921861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-06bdbd58-2686-4dd6-858e-7c4fea343052 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:08.921861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-06bdbd58-2686-4dd6-858e-7c4fea343052 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:08.921861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-06bdbd58-2686-4dd6-858e-7c4fea343052 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:09.055240 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-06bdbd58-2686-4dd6-858e-7c4fea343052 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:09.063404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-06bdbd58-2686-4dd6-858e-7c4fea343052 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.157791 Aug 24 06:19:09.063987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 186/367] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:08 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:09.233045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1f8380ee-cea9-4eb2-9252-369350e9c0b2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:09.233797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1f8380ee-cea9-4eb2-9252-369350e9c0b2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:09.241411 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f8380ee-cea9-4eb2-9252-369350e9c0b2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:09.242001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f8380ee-cea9-4eb2-9252-369350e9c0b2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:09.242914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f8380ee-cea9-4eb2-9252-369350e9c0b2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:09.243627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f8380ee-cea9-4eb2-9252-369350e9c0b2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:09.244057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f8380ee-cea9-4eb2-9252-369350e9c0b2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:09.244473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f8380ee-cea9-4eb2-9252-369350e9c0b2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:09.377610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1f8380ee-cea9-4eb2-9252-369350e9c0b2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:09.386011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1f8380ee-cea9-4eb2-9252-369350e9c0b2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.157262 Aug 24 06:19:09.386568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 182/368] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:09 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:09.415495 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:09.416123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:09.418171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:09.422823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:09.425440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:09.425440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:09.425440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:09.425440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:09.426083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:09.560598 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:09.569896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:09.573828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:09.573828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4ccfcf0a-de33-441a-bc84-35ea04efffad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1753 microversion: 2.20 time: 0.161000 Aug 24 06:19:09.573828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 187/369] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:09.754097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-74047398-e3b3-4cfc-ade9-07f757a6c2d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:09.755300 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-74047398-e3b3-4cfc-ade9-07f757a6c2d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:09.761941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74047398-e3b3-4cfc-ade9-07f757a6c2d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:09.762388 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74047398-e3b3-4cfc-ade9-07f757a6c2d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:09.762817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74047398-e3b3-4cfc-ade9-07f757a6c2d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:09.763511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74047398-e3b3-4cfc-ade9-07f757a6c2d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:09.764567 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74047398-e3b3-4cfc-ade9-07f757a6c2d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:09.764993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74047398-e3b3-4cfc-ade9-07f757a6c2d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:09.901634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-74047398-e3b3-4cfc-ade9-07f757a6c2d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:09.905338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:09.910112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-74047398-e3b3-4cfc-ade9-07f757a6c2d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1368 microversion: 2.1 time: 0.160262 Aug 24 06:19:09.910674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 183/370] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:09 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:10.084133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d0b1f9fd-5394-431d-a48b-77144b45ce12 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:10.084779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d0b1f9fd-5394-431d-a48b-77144b45ce12 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:10.091148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1f9fd-5394-431d-a48b-77144b45ce12 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:10.091625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1f9fd-5394-431d-a48b-77144b45ce12 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:10.092079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1f9fd-5394-431d-a48b-77144b45ce12 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:10.092794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1f9fd-5394-431d-a48b-77144b45ce12 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:10.093274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1f9fd-5394-431d-a48b-77144b45ce12 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:10.093660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1f9fd-5394-431d-a48b-77144b45ce12 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:10.219783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d0b1f9fd-5394-431d-a48b-77144b45ce12 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:10.227863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d0b1f9fd-5394-431d-a48b-77144b45ce12 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.147519 Aug 24 06:19:10.228422 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 188/371] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:10 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:10.407697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cc8da91e-18f8-4f8b-8cb4-d9baba2ed832 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:10.408199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cc8da91e-18f8-4f8b-8cb4-d9baba2ed832 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:10.415118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc8da91e-18f8-4f8b-8cb4-d9baba2ed832 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:10.415590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc8da91e-18f8-4f8b-8cb4-d9baba2ed832 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:10.416012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc8da91e-18f8-4f8b-8cb4-d9baba2ed832 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:10.416714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc8da91e-18f8-4f8b-8cb4-d9baba2ed832 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:10.417158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc8da91e-18f8-4f8b-8cb4-d9baba2ed832 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:10.417571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc8da91e-18f8-4f8b-8cb4-d9baba2ed832 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:10.551652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cc8da91e-18f8-4f8b-8cb4-d9baba2ed832 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:10.560967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cc8da91e-18f8-4f8b-8cb4-d9baba2ed832 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1721 microversion: 2.1 time: 0.157579 Aug 24 06:19:10.563453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 184/372] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:10 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:10.597217 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:10.597969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:10.604753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:10.605243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:10.605674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:10.606362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:10.606817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:10.607264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:10.758729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-ce301560-edff-4744-8697-b1ae048a962d req-9f17861d-7aa1-4c6d-9c25-b34a18f6c6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183454a1-0335-4121-8d9f-c6599b8f2532", "name": "network-vif-plugged", "status": "completed", "tag": "8f28ca28-dd97-4a09-8e4f-a05e462a5fa6"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:10.759229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:10.765434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:10.767223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:10.768194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-ce301560-edff-4744-8697-b1ae048a962d req-9f17861d-7aa1-4c6d-9c25-b34a18f6c6fd service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:10.768860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-ce301560-edff-4744-8697-b1ae048a962d req-9f17861d-7aa1-4c6d-9c25-b34a18f6c6fd service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:10.769200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-de2d0255-7f2e-4662-8214-35987b1774d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1755 microversion: 2.20 time: 0.176815 Aug 24 06:19:10.769571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-ce301560-edff-4744-8697-b1ae048a962d req-9f17861d-7aa1-4c6d-9c25-b34a18f6c6fd service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:10.769724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 189/373] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:10 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:10.785715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-ce301560-edff-4744-8697-b1ae048a962d req-9f17861d-7aa1-4c6d-9c25-b34a18f6c6fd service nova] Creating event network-vif-plugged:8f28ca28-dd97-4a09-8e4f-a05e462a5fa6 for instance 183454a1-0335-4121-8d9f-c6599b8f2532 on hv-cinder-85426 Aug 24 06:19:10.790686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-ce301560-edff-4744-8697-b1ae048a962d req-9f17861d-7aa1-4c6d-9c25-b34a18f6c6fd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040393 Aug 24 06:19:10.791368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 185/374] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:19:10.932990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bea07378-259b-40ba-a4e8-1cc386e9bce1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:10.933546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bea07378-259b-40ba-a4e8-1cc386e9bce1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:10.939825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bea07378-259b-40ba-a4e8-1cc386e9bce1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:10.940392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bea07378-259b-40ba-a4e8-1cc386e9bce1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:10.943703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bea07378-259b-40ba-a4e8-1cc386e9bce1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:10.943703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bea07378-259b-40ba-a4e8-1cc386e9bce1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:10.943703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bea07378-259b-40ba-a4e8-1cc386e9bce1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:10.943703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bea07378-259b-40ba-a4e8-1cc386e9bce1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.041787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ffbe00e4-bdb5-42dd-9ccd-f9950bcaef48 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:11.044102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ffbe00e4-bdb5-42dd-9ccd-f9950bcaef48 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:11.050313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffbe00e4-bdb5-42dd-9ccd-f9950bcaef48 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.051041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffbe00e4-bdb5-42dd-9ccd-f9950bcaef48 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.052268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffbe00e4-bdb5-42dd-9ccd-f9950bcaef48 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.053164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffbe00e4-bdb5-42dd-9ccd-f9950bcaef48 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.053784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffbe00e4-bdb5-42dd-9ccd-f9950bcaef48 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.054437 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffbe00e4-bdb5-42dd-9ccd-f9950bcaef48 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.079648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bea07378-259b-40ba-a4e8-1cc386e9bce1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:11.088907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bea07378-259b-40ba-a4e8-1cc386e9bce1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1368 microversion: 2.1 time: 0.159604 Aug 24 06:19:11.094063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 190/375] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:10 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:11.249097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d4b1fe8d-8c70-4f1e-9fe9-a6f6af481e06 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:11.254513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d4b1fe8d-8c70-4f1e-9fe9-a6f6af481e06 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:11.256581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4b1fe8d-8c70-4f1e-9fe9-a6f6af481e06 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.257068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4b1fe8d-8c70-4f1e-9fe9-a6f6af481e06 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.257495 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4b1fe8d-8c70-4f1e-9fe9-a6f6af481e06 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.258178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4b1fe8d-8c70-4f1e-9fe9-a6f6af481e06 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.258625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4b1fe8d-8c70-4f1e-9fe9-a6f6af481e06 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.259041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4b1fe8d-8c70-4f1e-9fe9-a6f6af481e06 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.278404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ffbe00e4-bdb5-42dd-9ccd-f9950bcaef48 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "POST /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/action" status: 202 len: 0 microversion: 2.1 time: 0.240715 Aug 24 06:19:11.279038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 186/376] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 24 06:19:11 2022] POST /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:19:11.287754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-499df0da-3a5e-48f2-8f8b-fee1a6ed8f94 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:11.288441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-499df0da-3a5e-48f2-8f8b-fee1a6ed8f94 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:11.295012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499df0da-3a5e-48f2-8f8b-fee1a6ed8f94 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.300356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499df0da-3a5e-48f2-8f8b-fee1a6ed8f94 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.300356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499df0da-3a5e-48f2-8f8b-fee1a6ed8f94 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.300356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499df0da-3a5e-48f2-8f8b-fee1a6ed8f94 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.300356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499df0da-3a5e-48f2-8f8b-fee1a6ed8f94 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.301042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499df0da-3a5e-48f2-8f8b-fee1a6ed8f94 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.392157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d4b1fe8d-8c70-4f1e-9fe9-a6f6af481e06 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:11.400668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d4b1fe8d-8c70-4f1e-9fe9-a6f6af481e06 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.155345 Aug 24 06:19:11.401247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 191/377] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:11 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:11.447861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-499df0da-3a5e-48f2-8f8b-fee1a6ed8f94 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:11.456116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-499df0da-3a5e-48f2-8f8b-fee1a6ed8f94 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1750 microversion: 2.1 time: 0.172339 Aug 24 06:19:11.456700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 187/378] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:11 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:11.582191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7c6a28e9-3252-46a2-b7eb-c7fc5feef7ab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:11.582745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7c6a28e9-3252-46a2-b7eb-c7fc5feef7ab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:11.588759 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c6a28e9-3252-46a2-b7eb-c7fc5feef7ab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.589232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c6a28e9-3252-46a2-b7eb-c7fc5feef7ab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.589656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c6a28e9-3252-46a2-b7eb-c7fc5feef7ab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.590378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c6a28e9-3252-46a2-b7eb-c7fc5feef7ab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.590831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c6a28e9-3252-46a2-b7eb-c7fc5feef7ab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.591242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c6a28e9-3252-46a2-b7eb-c7fc5feef7ab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.726633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7c6a28e9-3252-46a2-b7eb-c7fc5feef7ab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:11.735048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7c6a28e9-3252-46a2-b7eb-c7fc5feef7ab tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1698 microversion: 2.1 time: 0.156788 Aug 24 06:19:11.735639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 192/379] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:11 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:11.755566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-eb34a46e-a2dd-4a5f-ae5f-4b7d7fb8029b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:11.761718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb34a46e-a2dd-4a5f-ae5f-4b7d7fb8029b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.762303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb34a46e-a2dd-4a5f-ae5f-4b7d7fb8029b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.762613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb34a46e-a2dd-4a5f-ae5f-4b7d7fb8029b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.784221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-eb34a46e-a2dd-4a5f-ae5f-4b7d7fb8029b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Going to try to start instance {{(pid=121151) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 06:19:11.792910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:11.793509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:11.800131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.800905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.801374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.802114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.802549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.802968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.932442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:11.943441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:11.945156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:11.946241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e022a0c2-1147-4d5c-9708-c892533a48f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.157143 Aug 24 06:19:11.946785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 193/380] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:19:11.952553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-eb34a46e-a2dd-4a5f-ae5f-4b7d7fb8029b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "POST /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/action" status: 202 len: 0 microversion: 2.1 time: 0.200738 Aug 24 06:19:11.953148 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 188/381] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 24 06:19:11 2022] POST /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:19:11.967027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ede6e097-66fd-4aa2-a020-91b8e31293cc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:11.967630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ede6e097-66fd-4aa2-a020-91b8e31293cc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:11.974134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ede6e097-66fd-4aa2-a020-91b8e31293cc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.974613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ede6e097-66fd-4aa2-a020-91b8e31293cc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.975044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ede6e097-66fd-4aa2-a020-91b8e31293cc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:11.975728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ede6e097-66fd-4aa2-a020-91b8e31293cc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:11.976180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ede6e097-66fd-4aa2-a020-91b8e31293cc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:11.976632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ede6e097-66fd-4aa2-a020-91b8e31293cc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:12.110882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ede6e097-66fd-4aa2-a020-91b8e31293cc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:12.111214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-be6698cc-6ba1-4262-b5b7-b6e50abb8e54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:12.111910 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-be6698cc-6ba1-4262-b5b7-b6e50abb8e54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:12.118369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be6698cc-6ba1-4262-b5b7-b6e50abb8e54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:12.118855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be6698cc-6ba1-4262-b5b7-b6e50abb8e54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:12.119292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be6698cc-6ba1-4262-b5b7-b6e50abb8e54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:12.119543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ede6e097-66fd-4aa2-a020-91b8e31293cc tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1707 microversion: 2.1 time: 0.156185 Aug 24 06:19:12.119992 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be6698cc-6ba1-4262-b5b7-b6e50abb8e54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:12.132585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 194/382] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:11 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:12.132759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be6698cc-6ba1-4262-b5b7-b6e50abb8e54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:12.132759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be6698cc-6ba1-4262-b5b7-b6e50abb8e54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:12.249677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-be6698cc-6ba1-4262-b5b7-b6e50abb8e54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:12.257243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-be6698cc-6ba1-4262-b5b7-b6e50abb8e54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1368 microversion: 2.1 time: 0.150543 Aug 24 06:19:12.257796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 189/383] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:12 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:12.421115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7516514a-4379-4426-9ccd-2b622177efe6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:12.421739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7516514a-4379-4426-9ccd-2b622177efe6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:12.428386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7516514a-4379-4426-9ccd-2b622177efe6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:12.428903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7516514a-4379-4426-9ccd-2b622177efe6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:12.429339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7516514a-4379-4426-9ccd-2b622177efe6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:12.430027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7516514a-4379-4426-9ccd-2b622177efe6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:12.430479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7516514a-4379-4426-9ccd-2b622177efe6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:12.430896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7516514a-4379-4426-9ccd-2b622177efe6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:12.477518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-28a5b11e-30b0-4f2c-93d7-5b6a97aeea2c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:12.478126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-28a5b11e-30b0-4f2c-93d7-5b6a97aeea2c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:12.483990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a5b11e-30b0-4f2c-93d7-5b6a97aeea2c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:12.484535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a5b11e-30b0-4f2c-93d7-5b6a97aeea2c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:12.484974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a5b11e-30b0-4f2c-93d7-5b6a97aeea2c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:12.485675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a5b11e-30b0-4f2c-93d7-5b6a97aeea2c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:12.486106 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a5b11e-30b0-4f2c-93d7-5b6a97aeea2c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:12.486523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a5b11e-30b0-4f2c-93d7-5b6a97aeea2c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:12.564172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7516514a-4379-4426-9ccd-2b622177efe6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:12.574928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7516514a-4379-4426-9ccd-2b622177efe6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.157598 Aug 24 06:19:12.582256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 195/384] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:12 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:12.778939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-28a5b11e-30b0-4f2c-93d7-5b6a97aeea2c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:12.787439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-28a5b11e-30b0-4f2c-93d7-5b6a97aeea2c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1750 microversion: 2.1 time: 0.313663 Aug 24 06:19:12.791709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 190/385] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:12 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1750 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:12.971569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:12.973468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:12.979905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:12.980456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:12.980973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:12.981732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:12.982248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:12.982724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:12.998219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d70ebef4-a84c-4c2d-9f74-dec8158855f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "374dd07e-c3a6-44fb-82af-efe087aec831", "device": "/dev/sdb"}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:13.004129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d70ebef4-a84c-4c2d-9f74-dec8158855f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:13.010300 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d70ebef4-a84c-4c2d-9f74-dec8158855f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:13.010780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d70ebef4-a84c-4c2d-9f74-dec8158855f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:13.011201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d70ebef4-a84c-4c2d-9f74-dec8158855f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:13.011889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d70ebef4-a84c-4c2d-9f74-dec8158855f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:13.012333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d70ebef4-a84c-4c2d-9f74-dec8158855f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:13.012784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d70ebef4-a84c-4c2d-9f74-dec8158855f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:13.127887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:13.136392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:13.137902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:13.139049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5f5cf06c-64cd-4a82-a7f1-363b7a829413 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.171602 Aug 24 06:19:13.139596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 196/386] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:13.143910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8e80e3a9-00ce-411d-a5fa-1b3d0e11f8e2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:13.144521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8e80e3a9-00ce-411d-a5fa-1b3d0e11f8e2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:13.150263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e80e3a9-00ce-411d-a5fa-1b3d0e11f8e2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:13.150781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e80e3a9-00ce-411d-a5fa-1b3d0e11f8e2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:13.151203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e80e3a9-00ce-411d-a5fa-1b3d0e11f8e2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:13.151881 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e80e3a9-00ce-411d-a5fa-1b3d0e11f8e2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:13.152322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e80e3a9-00ce-411d-a5fa-1b3d0e11f8e2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:13.152811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e80e3a9-00ce-411d-a5fa-1b3d0e11f8e2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:13.286567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8e80e3a9-00ce-411d-a5fa-1b3d0e11f8e2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:13.294718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8e80e3a9-00ce-411d-a5fa-1b3d0e11f8e2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1707 microversion: 2.1 time: 0.154207 Aug 24 06:19:13.295279 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 197/387] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:13 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:13.300140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fbf4e400-6a1d-4fcd-95a5-4f925ef39546 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:13.301020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fbf4e400-6a1d-4fcd-95a5-4f925ef39546 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:13.306713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fbf4e400-6a1d-4fcd-95a5-4f925ef39546 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:13.307166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fbf4e400-6a1d-4fcd-95a5-4f925ef39546 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:13.307588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fbf4e400-6a1d-4fcd-95a5-4f925ef39546 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:13.308321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fbf4e400-6a1d-4fcd-95a5-4f925ef39546 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:13.308797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fbf4e400-6a1d-4fcd-95a5-4f925ef39546 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:13.309238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fbf4e400-6a1d-4fcd-95a5-4f925ef39546 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:13.480611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fbf4e400-6a1d-4fcd-95a5-4f925ef39546 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:13.488950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fbf4e400-6a1d-4fcd-95a5-4f925ef39546 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1557 microversion: 2.1 time: 0.192691 Aug 24 06:19:13.489522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 198/388] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:13 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1557 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:13.509129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a0da9cfc-67bd-41b8-bd51-dd658da65678 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:13.509620 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a0da9cfc-67bd-41b8-bd51-dd658da65678 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:13.516250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0da9cfc-67bd-41b8-bd51-dd658da65678 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:13.516753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0da9cfc-67bd-41b8-bd51-dd658da65678 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:13.517180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0da9cfc-67bd-41b8-bd51-dd658da65678 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:13.518424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0da9cfc-67bd-41b8-bd51-dd658da65678 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:13.519168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0da9cfc-67bd-41b8-bd51-dd658da65678 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:13.519842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0da9cfc-67bd-41b8-bd51-dd658da65678 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:13.627991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a0da9cfc-67bd-41b8-bd51-dd658da65678 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122951 Aug 24 06:19:13.628889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 199/389] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 24 06:19:13 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:19:13.636924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6244d796-b817-4855-9252-d1242b2cd272 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:13.637548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6244d796-b817-4855-9252-d1242b2cd272 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:13.648800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6244d796-b817-4855-9252-d1242b2cd272 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:13.649307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6244d796-b817-4855-9252-d1242b2cd272 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:13.649748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6244d796-b817-4855-9252-d1242b2cd272 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:13.650471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6244d796-b817-4855-9252-d1242b2cd272 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:13.651111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6244d796-b817-4855-9252-d1242b2cd272 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:13.651698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6244d796-b817-4855-9252-d1242b2cd272 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:14.276726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6244d796-b817-4855-9252-d1242b2cd272 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:14.284857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6244d796-b817-4855-9252-d1242b2cd272 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.652128 Aug 24 06:19:14.285619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 200/390] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:13 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:14.291534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-91a7db8e-98b2-4ee6-9059-b5f5911eee14 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:14.291534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-91a7db8e-98b2-4ee6-9059-b5f5911eee14 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:14.297189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91a7db8e-98b2-4ee6-9059-b5f5911eee14 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:14.297901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91a7db8e-98b2-4ee6-9059-b5f5911eee14 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:14.298407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91a7db8e-98b2-4ee6-9059-b5f5911eee14 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:14.300428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91a7db8e-98b2-4ee6-9059-b5f5911eee14 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:14.301239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91a7db8e-98b2-4ee6-9059-b5f5911eee14 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:14.301744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91a7db8e-98b2-4ee6-9059-b5f5911eee14 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:14.364566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d70ebef4-a84c-4c2d-9f74-dec8158855f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "POST /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.369973 Aug 24 06:19:14.370664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 191/391] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 24 06:19:12 2022] POST /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86/os-volume_attachments => generated 194 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:19:14.376842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:14.378286 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:14.384776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:14.385505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:14.386275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:14.387213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:14.388201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:14.388669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:14.552058 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:14.566843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:14.568203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:14.569560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-509f0828-0343-4025-89cf-e7c65565f6a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.197495 Aug 24 06:19:14.570500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 192/392] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:14.575183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e5acfebc-7cbd-40cc-bc4b-e5390db02556 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:14.575975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e5acfebc-7cbd-40cc-bc4b-e5390db02556 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:14.590943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5acfebc-7cbd-40cc-bc4b-e5390db02556 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:14.596664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5acfebc-7cbd-40cc-bc4b-e5390db02556 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:14.596664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5acfebc-7cbd-40cc-bc4b-e5390db02556 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:14.596664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5acfebc-7cbd-40cc-bc4b-e5390db02556 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:14.596664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5acfebc-7cbd-40cc-bc4b-e5390db02556 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:14.596991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5acfebc-7cbd-40cc-bc4b-e5390db02556 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:14.696364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-91a7db8e-98b2-4ee6-9059-b5f5911eee14 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:14.715333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-91a7db8e-98b2-4ee6-9059-b5f5911eee14 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1750 microversion: 2.1 time: 0.428414 Aug 24 06:19:14.716402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 201/393] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:14 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1750 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:14.748044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e5acfebc-7cbd-40cc-bc4b-e5390db02556 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:14.756249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e5acfebc-7cbd-40cc-bc4b-e5390db02556 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1707 microversion: 2.1 time: 0.184830 Aug 24 06:19:14.756887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 193/394] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:14 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1707 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:15.239138 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-a85bcd2e-82d9-4537-8f0a-c4f65feff5e7 req-ca7dcaa8-831c-40be-a7bb-41f8f3a18a16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "183454a1-0335-4121-8d9f-c6599b8f2532", "tag": "8f28ca28-dd97-4a09-8e4f-a05e462a5fa6"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:15.248833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-a85bcd2e-82d9-4537-8f0a-c4f65feff5e7 req-ca7dcaa8-831c-40be-a7bb-41f8f3a18a16 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:15.249320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-a85bcd2e-82d9-4537-8f0a-c4f65feff5e7 req-ca7dcaa8-831c-40be-a7bb-41f8f3a18a16 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:15.249790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-a85bcd2e-82d9-4537-8f0a-c4f65feff5e7 req-ca7dcaa8-831c-40be-a7bb-41f8f3a18a16 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:15.261356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-a85bcd2e-82d9-4537-8f0a-c4f65feff5e7 req-ca7dcaa8-831c-40be-a7bb-41f8f3a18a16 service nova] Creating event network-changed:8f28ca28-dd97-4a09-8e4f-a05e462a5fa6 for instance 183454a1-0335-4121-8d9f-c6599b8f2532 on hv-cinder-85426 Aug 24 06:19:15.266570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-a85bcd2e-82d9-4537-8f0a-c4f65feff5e7 req-ca7dcaa8-831c-40be-a7bb-41f8f3a18a16 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031277 Aug 24 06:19:15.275288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 202/395] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:19:15.306326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b39f7f02-15ae-4d3f-b567-8d159e08d9b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:15.306935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b39f7f02-15ae-4d3f-b567-8d159e08d9b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:15.313083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b39f7f02-15ae-4d3f-b567-8d159e08d9b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:15.314432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b39f7f02-15ae-4d3f-b567-8d159e08d9b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:15.314866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b39f7f02-15ae-4d3f-b567-8d159e08d9b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:15.315749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b39f7f02-15ae-4d3f-b567-8d159e08d9b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:15.316410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b39f7f02-15ae-4d3f-b567-8d159e08d9b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:15.316885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b39f7f02-15ae-4d3f-b567-8d159e08d9b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:15.504526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b39f7f02-15ae-4d3f-b567-8d159e08d9b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:15.515934 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b39f7f02-15ae-4d3f-b567-8d159e08d9b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.213341 Aug 24 06:19:15.518607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 194/396] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:15 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:15.593996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:15.594690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:15.606238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:15.612742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:15.612742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:15.612742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:15.612742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:15.614134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:15.668079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:15.742243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d1541adf-5b31-4bfc-b6cf-d4ad49b50bce tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:15.742890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d1541adf-5b31-4bfc-b6cf-d4ad49b50bce tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:15.759012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1541adf-5b31-4bfc-b6cf-d4ad49b50bce tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:15.759563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1541adf-5b31-4bfc-b6cf-d4ad49b50bce tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:15.759989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1541adf-5b31-4bfc-b6cf-d4ad49b50bce tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:15.760769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1541adf-5b31-4bfc-b6cf-d4ad49b50bce tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:15.761268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1541adf-5b31-4bfc-b6cf-d4ad49b50bce tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:15.761717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1541adf-5b31-4bfc-b6cf-d4ad49b50bce tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:15.846928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:15.857151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:15.858813 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:15.860119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3b2a33b8-0138-48a2-b1c7-85f541c62560 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.271821 Aug 24 06:19:15.872990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 203/397] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:15.883297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-26cc7196-14ab-42b0-a653-f3e8a129290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:15.884348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-26cc7196-14ab-42b0-a653-f3e8a129290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:15.896745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26cc7196-14ab-42b0-a653-f3e8a129290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:15.897283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26cc7196-14ab-42b0-a653-f3e8a129290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:15.897717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26cc7196-14ab-42b0-a653-f3e8a129290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:15.898465 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26cc7196-14ab-42b0-a653-f3e8a129290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:15.898953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26cc7196-14ab-42b0-a653-f3e8a129290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:15.899829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26cc7196-14ab-42b0-a653-f3e8a129290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:15.972568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d1541adf-5b31-4bfc-b6cf-d4ad49b50bce tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:15.986807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d1541adf-5b31-4bfc-b6cf-d4ad49b50bce tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.247886 Aug 24 06:19:15.989807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 195/398] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:15 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:16.098922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-26cc7196-14ab-42b0-a653-f3e8a129290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:16.109915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-26cc7196-14ab-42b0-a653-f3e8a129290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1711 microversion: 2.1 time: 0.235391 Aug 24 06:19:16.112387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 204/399] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:15 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1711 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:16.540210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-30c9de2e-965e-48ee-bad8-e81c9e8f26ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:16.541516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-30c9de2e-965e-48ee-bad8-e81c9e8f26ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:16.548191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30c9de2e-965e-48ee-bad8-e81c9e8f26ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:16.549628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30c9de2e-965e-48ee-bad8-e81c9e8f26ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:16.550063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30c9de2e-965e-48ee-bad8-e81c9e8f26ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:16.551041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30c9de2e-965e-48ee-bad8-e81c9e8f26ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:16.551487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30c9de2e-965e-48ee-bad8-e81c9e8f26ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:16.551903 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30c9de2e-965e-48ee-bad8-e81c9e8f26ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:16.725537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-30c9de2e-965e-48ee-bad8-e81c9e8f26ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:16.737724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-30c9de2e-965e-48ee-bad8-e81c9e8f26ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.201676 Aug 24 06:19:16.738345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 196/400] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:16 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:16.891428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:16.891428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:16.897488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:16.897969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:16.898441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:16.899143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:16.899586 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:16.899998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:17.014353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9d12359d-abcf-4861-885d-10ae085d3740 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:17.015291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9d12359d-abcf-4861-885d-10ae085d3740 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:17.022624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d12359d-abcf-4861-885d-10ae085d3740 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:17.023367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d12359d-abcf-4861-885d-10ae085d3740 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:17.023965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d12359d-abcf-4861-885d-10ae085d3740 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:17.024874 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d12359d-abcf-4861-885d-10ae085d3740 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:17.025491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d12359d-abcf-4861-885d-10ae085d3740 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:17.025918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d12359d-abcf-4861-885d-10ae085d3740 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:17.119338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:17.129047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:17.130816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:17.132370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e3e219d1-62e4-4044-a613-790dc38f2751 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.247279 Aug 24 06:19:17.149980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 205/401] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:16 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:17.241079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9d12359d-abcf-4861-885d-10ae085d3740 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:17.244795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:17.250180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9d12359d-abcf-4861-885d-10ae085d3740 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.239639 Aug 24 06:19:17.250767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 197/402] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:17 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:17.760391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fa9850e3-f1e3-4bac-a6e3-d1749622c58b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:17.761074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fa9850e3-f1e3-4bac-a6e3-d1749622c58b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:17.768544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9850e3-f1e3-4bac-a6e3-d1749622c58b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:17.769103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9850e3-f1e3-4bac-a6e3-d1749622c58b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:17.769598 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9850e3-f1e3-4bac-a6e3-d1749622c58b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:17.770597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9850e3-f1e3-4bac-a6e3-d1749622c58b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:17.771283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9850e3-f1e3-4bac-a6e3-d1749622c58b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:17.771853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9850e3-f1e3-4bac-a6e3-d1749622c58b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:17.950313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fa9850e3-f1e3-4bac-a6e3-d1749622c58b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:17.958192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fa9850e3-f1e3-4bac-a6e3-d1749622c58b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.201647 Aug 24 06:19:17.958751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 206/403] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:17 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:18.162595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:18.163782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:18.180362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:18.181463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:18.182417 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:18.184016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:18.185510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:18.188553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:18.272682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-97a42451-14b4-42f6-b542-6d1ea20c4a5b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:18.273372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-97a42451-14b4-42f6-b542-6d1ea20c4a5b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:18.279781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-97a42451-14b4-42f6-b542-6d1ea20c4a5b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:18.280472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-97a42451-14b4-42f6-b542-6d1ea20c4a5b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:18.280950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-97a42451-14b4-42f6-b542-6d1ea20c4a5b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:18.281735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-97a42451-14b4-42f6-b542-6d1ea20c4a5b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:18.282221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-97a42451-14b4-42f6-b542-6d1ea20c4a5b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:18.282655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-97a42451-14b4-42f6-b542-6d1ea20c4a5b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:18.362632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:18.372643 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:18.378994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:18.380772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d93ce8b0-8c28-4162-95da-2cfbb5ab450c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.228667 Aug 24 06:19:18.381844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 198/404] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:18.466351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-97a42451-14b4-42f6-b542-6d1ea20c4a5b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:18.475677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-97a42451-14b4-42f6-b542-6d1ea20c4a5b tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.207060 Aug 24 06:19:18.476453 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 207/405] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:18 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:18.981014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-440657fb-0552-4924-b354-a9b6f822ea89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:18.981725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-440657fb-0552-4924-b354-a9b6f822ea89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:18.988020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-440657fb-0552-4924-b354-a9b6f822ea89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:18.988615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-440657fb-0552-4924-b354-a9b6f822ea89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:18.989273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-440657fb-0552-4924-b354-a9b6f822ea89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:18.990046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-440657fb-0552-4924-b354-a9b6f822ea89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:18.990693 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-440657fb-0552-4924-b354-a9b6f822ea89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:18.991198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-440657fb-0552-4924-b354-a9b6f822ea89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:19.128186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-440657fb-0552-4924-b354-a9b6f822ea89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:19.136329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-440657fb-0552-4924-b354-a9b6f822ea89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.159559 Aug 24 06:19:19.147058 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 199/406] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:18 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:19.403351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:19.404247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:19.410815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:19.411431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:19.411964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:19.412794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:19.413497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:19.414235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:19.499045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ee23d45a-1d6b-4483-95a2-87d31fd373e1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:19.499679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ee23d45a-1d6b-4483-95a2-87d31fd373e1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:19.508266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee23d45a-1d6b-4483-95a2-87d31fd373e1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:19.508643 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee23d45a-1d6b-4483-95a2-87d31fd373e1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:19.509332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee23d45a-1d6b-4483-95a2-87d31fd373e1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:19.510148 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee23d45a-1d6b-4483-95a2-87d31fd373e1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:19.510670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee23d45a-1d6b-4483-95a2-87d31fd373e1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:19.511199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee23d45a-1d6b-4483-95a2-87d31fd373e1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:19.562433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:19.579352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:19.581820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:19.583193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a576cad4-1a34-4d90-9765-db204ca32ce1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.183816 Aug 24 06:19:19.598516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 208/407] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:19.698118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ee23d45a-1d6b-4483-95a2-87d31fd373e1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:19.720456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ee23d45a-1d6b-4483-95a2-87d31fd373e1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.227404 Aug 24 06:19:19.721128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 200/408] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:19 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:20.158791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2906b5ed-775d-45d7-a464-6ae0692f7e5a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:20.159318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2906b5ed-775d-45d7-a464-6ae0692f7e5a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:20.165858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2906b5ed-775d-45d7-a464-6ae0692f7e5a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:20.166344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2906b5ed-775d-45d7-a464-6ae0692f7e5a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:20.166778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2906b5ed-775d-45d7-a464-6ae0692f7e5a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:20.167468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2906b5ed-775d-45d7-a464-6ae0692f7e5a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:20.168103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2906b5ed-775d-45d7-a464-6ae0692f7e5a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:20.168390 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2906b5ed-775d-45d7-a464-6ae0692f7e5a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:20.308338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2906b5ed-775d-45d7-a464-6ae0692f7e5a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:20.316278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2906b5ed-775d-45d7-a464-6ae0692f7e5a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.162036 Aug 24 06:19:20.317153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 209/409] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:20 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:20.606149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:20.607023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:20.614286 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:20.614855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:20.615365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:20.616135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:20.616857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:20.617346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:20.742463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3a0eec21-8fa3-4e50-bf8c-e64dcae6adff tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:20.743045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3a0eec21-8fa3-4e50-bf8c-e64dcae6adff tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:20.749508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a0eec21-8fa3-4e50-bf8c-e64dcae6adff tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:20.749987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a0eec21-8fa3-4e50-bf8c-e64dcae6adff tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:20.750409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a0eec21-8fa3-4e50-bf8c-e64dcae6adff tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:20.751094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a0eec21-8fa3-4e50-bf8c-e64dcae6adff tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:20.751538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a0eec21-8fa3-4e50-bf8c-e64dcae6adff tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:20.752476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a0eec21-8fa3-4e50-bf8c-e64dcae6adff tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:20.766359 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:20.778767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:20.780441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:20.781722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d7e65445-2afd-4b66-9e55-96a3ebfef01a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.179596 Aug 24 06:19:20.782420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 201/410] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:20 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:20.908741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3a0eec21-8fa3-4e50-bf8c-e64dcae6adff tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:20.919054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3a0eec21-8fa3-4e50-bf8c-e64dcae6adff tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.181313 Aug 24 06:19:20.919638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 210/411] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:20 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:21.337352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3c6b5f4b-977a-4149-ab88-b91b45e03156 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:21.338087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3c6b5f4b-977a-4149-ab88-b91b45e03156 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:21.344235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c6b5f4b-977a-4149-ab88-b91b45e03156 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:21.344826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c6b5f4b-977a-4149-ab88-b91b45e03156 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:21.345359 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c6b5f4b-977a-4149-ab88-b91b45e03156 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:21.346713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c6b5f4b-977a-4149-ab88-b91b45e03156 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:21.347258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c6b5f4b-977a-4149-ab88-b91b45e03156 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:21.347787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c6b5f4b-977a-4149-ab88-b91b45e03156 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:21.485544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3c6b5f4b-977a-4149-ab88-b91b45e03156 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:21.493522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3c6b5f4b-977a-4149-ab88-b91b45e03156 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.159960 Aug 24 06:19:21.494327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 202/412] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:21 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:21.809683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:21.810361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:21.817264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:21.817999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:21.818531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:21.819227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:21.819680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:21.820100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:21.943444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ec7cadc2-d854-4f55-a5af-16932d364e67 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:21.943444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ec7cadc2-d854-4f55-a5af-16932d364e67 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:21.950027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec7cadc2-d854-4f55-a5af-16932d364e67 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:21.950604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec7cadc2-d854-4f55-a5af-16932d364e67 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:21.951139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec7cadc2-d854-4f55-a5af-16932d364e67 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:21.951920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec7cadc2-d854-4f55-a5af-16932d364e67 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:21.952444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec7cadc2-d854-4f55-a5af-16932d364e67 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:21.953073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec7cadc2-d854-4f55-a5af-16932d364e67 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:21.961778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:21.982134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:21.983651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:21.984835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2a165b51-7d64-42ce-b10b-be074a3a8097 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.179081 Aug 24 06:19:21.996599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 211/413] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:22.121102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ec7cadc2-d854-4f55-a5af-16932d364e67 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:22.129517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ec7cadc2-d854-4f55-a5af-16932d364e67 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.190817 Aug 24 06:19:22.130092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 203/414] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:21 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:22.514778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8c0c718a-9687-4d3f-986c-2ed908d4c287 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:22.515395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8c0c718a-9687-4d3f-986c-2ed908d4c287 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:22.521579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0c718a-9687-4d3f-986c-2ed908d4c287 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:22.522062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0c718a-9687-4d3f-986c-2ed908d4c287 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:22.522492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0c718a-9687-4d3f-986c-2ed908d4c287 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:22.523184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0c718a-9687-4d3f-986c-2ed908d4c287 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:22.523635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0c718a-9687-4d3f-986c-2ed908d4c287 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:22.524048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0c718a-9687-4d3f-986c-2ed908d4c287 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:22.675647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8c0c718a-9687-4d3f-986c-2ed908d4c287 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:22.684196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8c0c718a-9687-4d3f-986c-2ed908d4c287 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.173348 Aug 24 06:19:22.684799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 212/415] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:22 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:23.007987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:23.008636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:23.015770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:23.016270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:23.016731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:23.017443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:23.017895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:23.019015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:23.151462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f81ecf95-3f34-49e3-959d-6bd508cd08af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:23.154154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f81ecf95-3f34-49e3-959d-6bd508cd08af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:23.166864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81ecf95-3f34-49e3-959d-6bd508cd08af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:23.167627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81ecf95-3f34-49e3-959d-6bd508cd08af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:23.168077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81ecf95-3f34-49e3-959d-6bd508cd08af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:23.168826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81ecf95-3f34-49e3-959d-6bd508cd08af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:23.169280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81ecf95-3f34-49e3-959d-6bd508cd08af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:23.169703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81ecf95-3f34-49e3-959d-6bd508cd08af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:23.177686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:23.186676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:23.188785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:23.190809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-005a5025-72c9-4625-a516-964a48bb8e21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.186178 Aug 24 06:19:23.192220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 204/416] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:23.337083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f81ecf95-3f34-49e3-959d-6bd508cd08af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:23.347017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f81ecf95-3f34-49e3-959d-6bd508cd08af tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.199485 Aug 24 06:19:23.350181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 213/417] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:23 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:23.707256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-68264375-6bf3-4ef4-8507-1198a8f6f5bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:23.708160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-68264375-6bf3-4ef4-8507-1198a8f6f5bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:23.714291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68264375-6bf3-4ef4-8507-1198a8f6f5bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:23.714768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68264375-6bf3-4ef4-8507-1198a8f6f5bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:23.715199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68264375-6bf3-4ef4-8507-1198a8f6f5bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:23.715888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68264375-6bf3-4ef4-8507-1198a8f6f5bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:23.716337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68264375-6bf3-4ef4-8507-1198a8f6f5bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:23.716783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68264375-6bf3-4ef4-8507-1198a8f6f5bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:23.862276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-68264375-6bf3-4ef4-8507-1198a8f6f5bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:23.871339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-68264375-6bf3-4ef4-8507-1198a8f6f5bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.168591 Aug 24 06:19:23.872035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 205/418] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:23 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:24.214655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:24.215269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:24.222243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:24.222727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:24.223271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:24.223970 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:24.224442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:24.224884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:24.367606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b5d8f6f0-a974-42f6-b49f-4ac8c4f281c1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:24.368207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b5d8f6f0-a974-42f6-b49f-4ac8c4f281c1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:24.370180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:24.376166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5d8f6f0-a974-42f6-b49f-4ac8c4f281c1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:24.377007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5d8f6f0-a974-42f6-b49f-4ac8c4f281c1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:24.377673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5d8f6f0-a974-42f6-b49f-4ac8c4f281c1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:24.378602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5d8f6f0-a974-42f6-b49f-4ac8c4f281c1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:24.379954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5d8f6f0-a974-42f6-b49f-4ac8c4f281c1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:24.380441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5d8f6f0-a974-42f6-b49f-4ac8c4f281c1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:24.380593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:24.382000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:24.383205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a8ba6083-6fc1-4f96-8770-a30927bea932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.172530 Aug 24 06:19:24.383934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 214/419] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:24.525429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b5d8f6f0-a974-42f6-b49f-4ac8c4f281c1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:24.533646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b5d8f6f0-a974-42f6-b49f-4ac8c4f281c1 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.170424 Aug 24 06:19:24.534208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 206/420] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:24 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:24.892765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-935b9e4e-80f3-4b0c-8860-c5ce4a41ff1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:24.893362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-935b9e4e-80f3-4b0c-8860-c5ce4a41ff1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:24.899319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-935b9e4e-80f3-4b0c-8860-c5ce4a41ff1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:24.899797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-935b9e4e-80f3-4b0c-8860-c5ce4a41ff1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:24.900227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-935b9e4e-80f3-4b0c-8860-c5ce4a41ff1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:24.900942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-935b9e4e-80f3-4b0c-8860-c5ce4a41ff1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:24.901393 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-935b9e4e-80f3-4b0c-8860-c5ce4a41ff1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:24.901811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-935b9e4e-80f3-4b0c-8860-c5ce4a41ff1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:25.027755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-935b9e4e-80f3-4b0c-8860-c5ce4a41ff1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:25.035886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-935b9e4e-80f3-4b0c-8860-c5ce4a41ff1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.146384 Aug 24 06:19:25.036441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 215/421] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:24 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:25.412462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:25.413084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:25.416405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:25.419692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:25.420156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:25.420603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:25.421280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:25.421769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:25.422183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:25.555748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fb711016-b699-4187-85a2-4cfd9ccfb091 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:25.556351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fb711016-b699-4187-85a2-4cfd9ccfb091 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:25.560870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:25.562489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb711016-b699-4187-85a2-4cfd9ccfb091 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:25.562963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb711016-b699-4187-85a2-4cfd9ccfb091 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:25.563388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb711016-b699-4187-85a2-4cfd9ccfb091 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:25.564072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb711016-b699-4187-85a2-4cfd9ccfb091 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:25.564538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb711016-b699-4187-85a2-4cfd9ccfb091 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:25.564954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb711016-b699-4187-85a2-4cfd9ccfb091 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:25.569630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:25.571134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:25.572288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-65dc7577-dade-41cf-a91b-b8d08e36ef6f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.164149 Aug 24 06:19:25.572881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 207/422] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:25.751460 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fb711016-b699-4187-85a2-4cfd9ccfb091 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:25.759650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fb711016-b699-4187-85a2-4cfd9ccfb091 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.207680 Aug 24 06:19:25.760149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 216/423] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:25 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:26.055950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-99962bdc-234e-4122-9c24-ca02aaa9b3bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:26.056475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-99962bdc-234e-4122-9c24-ca02aaa9b3bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:26.062523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-99962bdc-234e-4122-9c24-ca02aaa9b3bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:26.063002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-99962bdc-234e-4122-9c24-ca02aaa9b3bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:26.063433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-99962bdc-234e-4122-9c24-ca02aaa9b3bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:26.064113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-99962bdc-234e-4122-9c24-ca02aaa9b3bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:26.064590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-99962bdc-234e-4122-9c24-ca02aaa9b3bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:26.065015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-99962bdc-234e-4122-9c24-ca02aaa9b3bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:26.198271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-99962bdc-234e-4122-9c24-ca02aaa9b3bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:26.205955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-99962bdc-234e-4122-9c24-ca02aaa9b3bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.153947 Aug 24 06:19:26.206527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 208/424] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:26 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:26.595260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:26.595796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:26.603036 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:26.603503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:26.603924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:26.604625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:26.605071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:26.605485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:26.733065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:26.741686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:26.743188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:26.744362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c80d67b3-7c50-4bb7-b2c3-0e3f66ea2b35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.153140 Aug 24 06:19:26.744948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 217/425] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:26.780941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0e326e2d-6a91-44dd-ad20-9ab004aee3b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:26.781549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0e326e2d-6a91-44dd-ad20-9ab004aee3b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:26.787852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e326e2d-6a91-44dd-ad20-9ab004aee3b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:26.788344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e326e2d-6a91-44dd-ad20-9ab004aee3b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:26.788791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e326e2d-6a91-44dd-ad20-9ab004aee3b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:26.789471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e326e2d-6a91-44dd-ad20-9ab004aee3b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:26.789917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e326e2d-6a91-44dd-ad20-9ab004aee3b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:26.790335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e326e2d-6a91-44dd-ad20-9ab004aee3b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:26.932607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0e326e2d-6a91-44dd-ad20-9ab004aee3b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:26.940700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0e326e2d-6a91-44dd-ad20-9ab004aee3b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.163488 Aug 24 06:19:26.941780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 209/426] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:26 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:27.227210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-89d1e603-1de3-4a07-8ae5-25ef9b0f28ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:27.228154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-89d1e603-1de3-4a07-8ae5-25ef9b0f28ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:27.234123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89d1e603-1de3-4a07-8ae5-25ef9b0f28ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:27.234596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89d1e603-1de3-4a07-8ae5-25ef9b0f28ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:27.235050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89d1e603-1de3-4a07-8ae5-25ef9b0f28ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:27.235774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89d1e603-1de3-4a07-8ae5-25ef9b0f28ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:27.236218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89d1e603-1de3-4a07-8ae5-25ef9b0f28ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:27.236669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89d1e603-1de3-4a07-8ae5-25ef9b0f28ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:27.366604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-89d1e603-1de3-4a07-8ae5-25ef9b0f28ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:27.374773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-89d1e603-1de3-4a07-8ae5-25ef9b0f28ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.151354 Aug 24 06:19:27.389084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 218/427] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:27 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:27.767483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:27.768011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:27.774038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:27.774519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:27.774956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:27.775649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:27.776103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:27.776574 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:27.908178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:27.917505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:27.919006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:27.920146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4906cdd3-e393-444f-b1a1-7dc23b69168f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.156741 Aug 24 06:19:27.920752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 210/428] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:27.961920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bb39c02e-5ecd-4372-af54-0ef4eec0331d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:27.962548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bb39c02e-5ecd-4372-af54-0ef4eec0331d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:27.968897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb39c02e-5ecd-4372-af54-0ef4eec0331d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:27.969372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb39c02e-5ecd-4372-af54-0ef4eec0331d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:27.969795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb39c02e-5ecd-4372-af54-0ef4eec0331d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:27.970493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb39c02e-5ecd-4372-af54-0ef4eec0331d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:27.970936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb39c02e-5ecd-4372-af54-0ef4eec0331d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:27.971471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb39c02e-5ecd-4372-af54-0ef4eec0331d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:28.108359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bb39c02e-5ecd-4372-af54-0ef4eec0331d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:28.116807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bb39c02e-5ecd-4372-af54-0ef4eec0331d tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.158633 Aug 24 06:19:28.117376 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 219/429] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:27 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:28.395507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ccf0bca0-93d3-4ada-83eb-7da61d100d1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:28.396145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ccf0bca0-93d3-4ada-83eb-7da61d100d1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:28.402035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf0bca0-93d3-4ada-83eb-7da61d100d1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:28.402522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf0bca0-93d3-4ada-83eb-7da61d100d1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:28.402957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf0bca0-93d3-4ada-83eb-7da61d100d1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:28.403647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf0bca0-93d3-4ada-83eb-7da61d100d1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:28.404107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf0bca0-93d3-4ada-83eb-7da61d100d1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:28.404558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf0bca0-93d3-4ada-83eb-7da61d100d1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:28.534660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ccf0bca0-93d3-4ada-83eb-7da61d100d1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:28.542577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ccf0bca0-93d3-4ada-83eb-7da61d100d1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.151419 Aug 24 06:19:28.543263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 211/430] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:28 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:28.943305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:28.943840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:28.950410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:28.950855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:28.951285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:28.952030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:28.952451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:28.952938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:28.957839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:29.093250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:29.105354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:29.106963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:29.108119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1c15d946-396e-4736-9800-d089f37ac795 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.168985 Aug 24 06:19:29.108749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 220/431] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:28 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:19:29.138245 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d715b8e2-4317-4490-9966-7c0c31150fed tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:29.138852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d715b8e2-4317-4490-9966-7c0c31150fed tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:29.145283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d715b8e2-4317-4490-9966-7c0c31150fed tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:29.145767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d715b8e2-4317-4490-9966-7c0c31150fed tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:29.146206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d715b8e2-4317-4490-9966-7c0c31150fed tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:29.146895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d715b8e2-4317-4490-9966-7c0c31150fed tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:29.147345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d715b8e2-4317-4490-9966-7c0c31150fed tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:29.147765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d715b8e2-4317-4490-9966-7c0c31150fed tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:29.300308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d715b8e2-4317-4490-9966-7c0c31150fed tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:29.309676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d715b8e2-4317-4490-9966-7c0c31150fed tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.175646 Aug 24 06:19:29.310268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 212/432] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:29 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:29.564122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-98432c0a-8372-49cd-b062-8e1da0740211 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:29.564739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-98432c0a-8372-49cd-b062-8e1da0740211 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:29.570651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98432c0a-8372-49cd-b062-8e1da0740211 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:29.571156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98432c0a-8372-49cd-b062-8e1da0740211 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:29.571578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98432c0a-8372-49cd-b062-8e1da0740211 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:29.572249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98432c0a-8372-49cd-b062-8e1da0740211 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:29.572726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98432c0a-8372-49cd-b062-8e1da0740211 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:29.573177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98432c0a-8372-49cd-b062-8e1da0740211 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:29.717585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-98432c0a-8372-49cd-b062-8e1da0740211 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:29.725628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-98432c0a-8372-49cd-b062-8e1da0740211 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.165299 Aug 24 06:19:29.726457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 221/433] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:29 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:30.133122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:30.133722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:30.145236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:30.145236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:30.145236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:30.145236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:30.146085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:30.146085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:30.270113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:30.278919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:30.280417 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:30.281613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3deea40d-521e-4774-b446-4815e4169b97 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.153045 Aug 24 06:19:30.282170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 213/434] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:30.330781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6822b2eb-b648-4931-815e-7b6bdcf78982 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:30.331385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6822b2eb-b648-4931-815e-7b6bdcf78982 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:30.337957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6822b2eb-b648-4931-815e-7b6bdcf78982 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:30.338422 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6822b2eb-b648-4931-815e-7b6bdcf78982 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:30.338852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6822b2eb-b648-4931-815e-7b6bdcf78982 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:30.339538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6822b2eb-b648-4931-815e-7b6bdcf78982 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:30.339981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6822b2eb-b648-4931-815e-7b6bdcf78982 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:30.340397 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6822b2eb-b648-4931-815e-7b6bdcf78982 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:30.481304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6822b2eb-b648-4931-815e-7b6bdcf78982 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:30.490239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6822b2eb-b648-4931-815e-7b6bdcf78982 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.163725 Aug 24 06:19:30.490806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 222/435] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:30 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:30.750628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7dcaaadd-8464-4019-8103-d508233711ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:30.751229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7dcaaadd-8464-4019-8103-d508233711ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:30.757090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dcaaadd-8464-4019-8103-d508233711ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:30.757560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dcaaadd-8464-4019-8103-d508233711ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:30.757991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dcaaadd-8464-4019-8103-d508233711ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:30.758666 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dcaaadd-8464-4019-8103-d508233711ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:30.759109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dcaaadd-8464-4019-8103-d508233711ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:30.759522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dcaaadd-8464-4019-8103-d508233711ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:30.777207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:30.892411 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7dcaaadd-8464-4019-8103-d508233711ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:30.900826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7dcaaadd-8464-4019-8103-d508233711ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1522 microversion: 2.1 time: 0.154146 Aug 24 06:19:30.901396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 214/436] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:30 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:31.304189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:31.304728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:31.310717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:31.311190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:31.311616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:31.312288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:31.312767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:31.313180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:31.441534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:31.450561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:31.452063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:31.453239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-10164e3f-02ec-41b4-9e46-ef45db56ba09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.153291 Aug 24 06:19:31.453798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 223/437] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:31.511398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-79442a29-5dd4-4390-9bf9-11d7f26320ea tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:31.512037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-79442a29-5dd4-4390-9bf9-11d7f26320ea tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:31.518430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79442a29-5dd4-4390-9bf9-11d7f26320ea tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:31.518905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79442a29-5dd4-4390-9bf9-11d7f26320ea tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:31.519337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79442a29-5dd4-4390-9bf9-11d7f26320ea tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:31.520074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79442a29-5dd4-4390-9bf9-11d7f26320ea tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:31.521162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79442a29-5dd4-4390-9bf9-11d7f26320ea tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:31.521587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79442a29-5dd4-4390-9bf9-11d7f26320ea tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:31.660761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-79442a29-5dd4-4390-9bf9-11d7f26320ea tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:31.668984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-79442a29-5dd4-4390-9bf9-11d7f26320ea tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.161454 Aug 24 06:19:31.669741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 215/438] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:31 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:31.921514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-86de168c-0fec-4d2c-a30d-fc0e6af98178 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:31.922151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-86de168c-0fec-4d2c-a30d-fc0e6af98178 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:31.929202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86de168c-0fec-4d2c-a30d-fc0e6af98178 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:31.929676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86de168c-0fec-4d2c-a30d-fc0e6af98178 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:31.930100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86de168c-0fec-4d2c-a30d-fc0e6af98178 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:31.930774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86de168c-0fec-4d2c-a30d-fc0e6af98178 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:31.931218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86de168c-0fec-4d2c-a30d-fc0e6af98178 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:31.931658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-86de168c-0fec-4d2c-a30d-fc0e6af98178 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:32.057357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-86de168c-0fec-4d2c-a30d-fc0e6af98178 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:32.064864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-86de168c-0fec-4d2c-a30d-fc0e6af98178 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1502 microversion: 2.1 time: 0.147182 Aug 24 06:19:32.065419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 224/439] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:31 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1502 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:32.084290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ac9eec83-76fc-4465-beed-0d123a647ca3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:32.087135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ac9eec83-76fc-4465-beed-0d123a647ca3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:32.090922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac9eec83-76fc-4465-beed-0d123a647ca3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:32.091399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac9eec83-76fc-4465-beed-0d123a647ca3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:32.091832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac9eec83-76fc-4465-beed-0d123a647ca3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:32.092536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac9eec83-76fc-4465-beed-0d123a647ca3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:32.092987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac9eec83-76fc-4465-beed-0d123a647ca3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:32.093409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac9eec83-76fc-4465-beed-0d123a647ca3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:32.227036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ac9eec83-76fc-4465-beed-0d123a647ca3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:32.235132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ac9eec83-76fc-4465-beed-0d123a647ca3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1516 microversion: 2.1 time: 0.154609 Aug 24 06:19:32.235708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 216/440] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:32 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:32.477515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:32.478048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:32.484073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:32.485810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:32.485810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:32.485810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:32.486183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:32.486565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:32.614692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:32.623633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:32.625325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:32.626331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6e3c2f69-bb9a-4155-93a8-dd5022c7926b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.153491 Aug 24 06:19:32.626884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 225/441] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:32.691088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a92a18e2-4fb2-4994-a7a6-ee1c7aff4045 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:32.691529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a92a18e2-4fb2-4994-a7a6-ee1c7aff4045 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:32.698370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a92a18e2-4fb2-4994-a7a6-ee1c7aff4045 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:32.698849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a92a18e2-4fb2-4994-a7a6-ee1c7aff4045 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:32.699385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a92a18e2-4fb2-4994-a7a6-ee1c7aff4045 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:32.700073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a92a18e2-4fb2-4994-a7a6-ee1c7aff4045 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:32.700550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a92a18e2-4fb2-4994-a7a6-ee1c7aff4045 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:32.701091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a92a18e2-4fb2-4994-a7a6-ee1c7aff4045 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:32.849125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a92a18e2-4fb2-4994-a7a6-ee1c7aff4045 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:32.858356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a92a18e2-4fb2-4994-a7a6-ee1c7aff4045 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.170986 Aug 24 06:19:32.858826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 217/442] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:32 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:33.649620 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:33.653034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:33.657259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:33.657742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:33.658177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:33.658879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:33.659369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:33.659791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:33.793565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:33.802596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:33.804094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:33.805421 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6b1a66ca-ba4a-4539-a108-23b8e38e3b28 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.159680 Aug 24 06:19:33.805982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 226/443] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:33.878777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4099fde5-fbaa-45a6-90ad-44da87cec4a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:33.879411 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4099fde5-fbaa-45a6-90ad-44da87cec4a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:33.885754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4099fde5-fbaa-45a6-90ad-44da87cec4a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:33.886228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4099fde5-fbaa-45a6-90ad-44da87cec4a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:33.886650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4099fde5-fbaa-45a6-90ad-44da87cec4a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:33.887327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4099fde5-fbaa-45a6-90ad-44da87cec4a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:33.887772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4099fde5-fbaa-45a6-90ad-44da87cec4a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:33.888185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4099fde5-fbaa-45a6-90ad-44da87cec4a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:34.029097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4099fde5-fbaa-45a6-90ad-44da87cec4a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:34.037232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4099fde5-fbaa-45a6-90ad-44da87cec4a0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1755 microversion: 2.1 time: 0.162340 Aug 24 06:19:34.038333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 218/444] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:33 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:34.828086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:34.828747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:34.835193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:34.835691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:34.836116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:34.836847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:34.837319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:34.837731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:34.969022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:34.978370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:34.979874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:34.981087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-40268340-c2db-4a6c-a679-ae85d4d0a384 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.156876 Aug 24 06:19:34.981638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 227/445] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:34 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:35.060131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fea5a2fd-7b13-4dc9-8125-ba9367ac4faf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:35.061572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fea5a2fd-7b13-4dc9-8125-ba9367ac4faf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:35.068314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fea5a2fd-7b13-4dc9-8125-ba9367ac4faf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:35.068860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fea5a2fd-7b13-4dc9-8125-ba9367ac4faf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:35.069316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fea5a2fd-7b13-4dc9-8125-ba9367ac4faf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:35.070030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fea5a2fd-7b13-4dc9-8125-ba9367ac4faf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:35.070586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fea5a2fd-7b13-4dc9-8125-ba9367ac4faf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:35.071001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fea5a2fd-7b13-4dc9-8125-ba9367ac4faf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:35.219843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fea5a2fd-7b13-4dc9-8125-ba9367ac4faf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:35.230189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fea5a2fd-7b13-4dc9-8125-ba9367ac4faf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1758 microversion: 2.1 time: 0.174190 Aug 24 06:19:35.244458 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 219/446] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:35 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:35.979109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-637e3498-0338-4f91-8e01-03461125936f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:35.981673 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-637e3498-0338-4f91-8e01-03461125936f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:35.988349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-637e3498-0338-4f91-8e01-03461125936f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:35.988857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-637e3498-0338-4f91-8e01-03461125936f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:35.989284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-637e3498-0338-4f91-8e01-03461125936f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:35.989961 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-637e3498-0338-4f91-8e01-03461125936f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:35.990916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-637e3498-0338-4f91-8e01-03461125936f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:35.991316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-637e3498-0338-4f91-8e01-03461125936f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:36.004401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:36.005585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:36.011832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:36.012315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:36.012784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:36.013483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:36.013932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:36.014374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:36.014906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-637e3498-0338-4f91-8e01-03461125936f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lazy-loading 'flavor' on Instance uuid ce39956a-712f-48bb-83fd-c0f2efe66f83 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:19:36.145728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:36.155670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:36.156092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:36.157274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9f036a88-7ed0-43dd-9404-ed2db55e59aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.156720 Aug 24 06:19:36.157824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 220/447] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:19:36.307295 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-637e3498-0338-4f91-8e01-03461125936f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "POST /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83/action" status: 200 len: 32 microversion: 2.1 time: 0.332011 Aug 24 06:19:36.307846 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 228/448] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 24 06:19:35 2022] POST /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83/action => generated 32 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:19:36.317136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a6aea5da-2ad0-4565-9977-5f2091e1b265 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:36.317802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a6aea5da-2ad0-4565-9977-5f2091e1b265 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:36.324451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aea5da-2ad0-4565-9977-5f2091e1b265 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:36.324968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aea5da-2ad0-4565-9977-5f2091e1b265 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:36.325392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aea5da-2ad0-4565-9977-5f2091e1b265 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:36.326077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aea5da-2ad0-4565-9977-5f2091e1b265 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:36.326520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aea5da-2ad0-4565-9977-5f2091e1b265 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:36.326935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aea5da-2ad0-4565-9977-5f2091e1b265 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:36.456740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a6aea5da-2ad0-4565-9977-5f2091e1b265 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:36.464358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a6aea5da-2ad0-4565-9977-5f2091e1b265 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.151063 Aug 24 06:19:36.464953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 221/449] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:36 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:37.180397 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:37.181120 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:37.188065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:37.188986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:37.189100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:37.189723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:37.190174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:37.190593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:37.325233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:37.333922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:37.335982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:37.337177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9722c7cc-08b0-4fe4-b5f3-145fd386dffc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.161453 Aug 24 06:19:37.337757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 229/450] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:37.485646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-49254f99-934f-4649-b8d9-65d677fd78b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:37.486195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-49254f99-934f-4649-b8d9-65d677fd78b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:37.493252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49254f99-934f-4649-b8d9-65d677fd78b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:37.493732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49254f99-934f-4649-b8d9-65d677fd78b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:37.494164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49254f99-934f-4649-b8d9-65d677fd78b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:37.494852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49254f99-934f-4649-b8d9-65d677fd78b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:37.495302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49254f99-934f-4649-b8d9-65d677fd78b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:37.495753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49254f99-934f-4649-b8d9-65d677fd78b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:37.623265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-49254f99-934f-4649-b8d9-65d677fd78b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:37.630847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-49254f99-934f-4649-b8d9-65d677fd78b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.149151 Aug 24 06:19:37.632030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 222/451] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:37 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:38.360105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:38.360738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:38.367787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:38.368261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:38.368752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:38.369433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:38.369901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:38.370334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:38.497144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:38.506672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:38.508192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:38.509381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-160cdd34-98a5-4f1a-ad12-ea86d854b2fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.153214 Aug 24 06:19:38.510057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 230/452] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:38.653761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e45aa5ca-815b-4bd2-b4cf-b6eefdceb810 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:38.654307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e45aa5ca-815b-4bd2-b4cf-b6eefdceb810 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:38.660766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e45aa5ca-815b-4bd2-b4cf-b6eefdceb810 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:38.661240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e45aa5ca-815b-4bd2-b4cf-b6eefdceb810 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:38.661670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e45aa5ca-815b-4bd2-b4cf-b6eefdceb810 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:38.662894 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e45aa5ca-815b-4bd2-b4cf-b6eefdceb810 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:38.663342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e45aa5ca-815b-4bd2-b4cf-b6eefdceb810 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:38.663757 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e45aa5ca-815b-4bd2-b4cf-b6eefdceb810 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:38.796175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e45aa5ca-815b-4bd2-b4cf-b6eefdceb810 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:38.804981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e45aa5ca-815b-4bd2-b4cf-b6eefdceb810 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.155011 Aug 24 06:19:38.805563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 223/453] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:38 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:39.532010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:39.532648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:39.535034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=88 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:39.539895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:39.540375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:39.540834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:39.541528 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:39.541977 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:39.542458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:39.674430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:39.683482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:39.685027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:39.686196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ccd2587b-7820-4e87-adb9-ef875cb5f56f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.158144 Aug 24 06:19:39.686756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 231/454] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:39.826307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-709caf0e-8618-44ad-af56-b7a7c4b327b2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:39.826874 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-709caf0e-8618-44ad-af56-b7a7c4b327b2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:39.833571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-709caf0e-8618-44ad-af56-b7a7c4b327b2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:39.834093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-709caf0e-8618-44ad-af56-b7a7c4b327b2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:39.836892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-709caf0e-8618-44ad-af56-b7a7c4b327b2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:39.836892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-709caf0e-8618-44ad-af56-b7a7c4b327b2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:39.836892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-709caf0e-8618-44ad-af56-b7a7c4b327b2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:39.836892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-709caf0e-8618-44ad-af56-b7a7c4b327b2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:39.975900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-709caf0e-8618-44ad-af56-b7a7c4b327b2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:39.984071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-709caf0e-8618-44ad-af56-b7a7c4b327b2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.161887 Aug 24 06:19:40.000079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 224/455] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:39 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:40.710499 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:40.710899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:40.717251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:40.717737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:40.718162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:40.718857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:40.719306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:40.719728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:40.847640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:40.857068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:40.858588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:40.859787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0f683369-d183-4ed1-b3fd-37de293ded09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.154279 Aug 24 06:19:40.860364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 232/456] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:41.008855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d2087edf-c255-4357-bfdd-487918a66538 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:41.009395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d2087edf-c255-4357-bfdd-487918a66538 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:41.016122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2087edf-c255-4357-bfdd-487918a66538 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:41.016672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2087edf-c255-4357-bfdd-487918a66538 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:41.017112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2087edf-c255-4357-bfdd-487918a66538 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:41.017848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2087edf-c255-4357-bfdd-487918a66538 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:41.018562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2087edf-c255-4357-bfdd-487918a66538 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:41.018994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2087edf-c255-4357-bfdd-487918a66538 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:41.150586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d2087edf-c255-4357-bfdd-487918a66538 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:41.158584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d2087edf-c255-4357-bfdd-487918a66538 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.154409 Aug 24 06:19:41.159162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 225/457] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:41 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:41.884552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:41.885157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:41.891673 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:41.892150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:41.892604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:41.893308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:41.893743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:41.894163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:42.022631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:42.031585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:42.033132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:42.034282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a4101974-d7e4-48ac-bf20-90e4b80e14fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.154458 Aug 24 06:19:42.034838 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 233/458] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:41 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:42.180510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-56139983-5883-4b12-b3b1-8a0706d56420 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:42.181136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-56139983-5883-4b12-b3b1-8a0706d56420 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:42.187582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-56139983-5883-4b12-b3b1-8a0706d56420 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:42.188086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-56139983-5883-4b12-b3b1-8a0706d56420 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:42.188540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-56139983-5883-4b12-b3b1-8a0706d56420 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:42.189244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-56139983-5883-4b12-b3b1-8a0706d56420 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:42.189692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-56139983-5883-4b12-b3b1-8a0706d56420 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:42.190110 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-56139983-5883-4b12-b3b1-8a0706d56420 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:42.323708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-56139983-5883-4b12-b3b1-8a0706d56420 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:42.331696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-56139983-5883-4b12-b3b1-8a0706d56420 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.155882 Aug 24 06:19:42.332259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 226/459] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:42 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:43.056984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:43.057508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:43.063873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:43.064345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:43.064814 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:43.065494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:43.065942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:43.066359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:43.354014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-22488789-9e20-44a3-b5ab-aa8ae513f18a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:43.354580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-22488789-9e20-44a3-b5ab-aa8ae513f18a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:43.361004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22488789-9e20-44a3-b5ab-aa8ae513f18a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:43.361483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22488789-9e20-44a3-b5ab-aa8ae513f18a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:43.361914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22488789-9e20-44a3-b5ab-aa8ae513f18a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:43.362602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22488789-9e20-44a3-b5ab-aa8ae513f18a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:43.363049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22488789-9e20-44a3-b5ab-aa8ae513f18a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:43.363465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22488789-9e20-44a3-b5ab-aa8ae513f18a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:43.412067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:43.415576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:43.421405 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:43.423049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:43.424228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9a3b6d72-8bc7-46ab-8860-c82a74ab4c13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.371346 Aug 24 06:19:43.424807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 234/460] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:43.500363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-22488789-9e20-44a3-b5ab-aa8ae513f18a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:43.509391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-22488789-9e20-44a3-b5ab-aa8ae513f18a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.159315 Aug 24 06:19:43.509963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 227/461] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:43 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:44.447108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:44.447701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:44.454908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:44.455378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:44.455805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:44.456477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:44.456946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:44.457440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:44.529714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-44f3a019-6f82-49a7-9485-02882c840c68 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:44.530692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-44f3a019-6f82-49a7-9485-02882c840c68 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:44.538508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44f3a019-6f82-49a7-9485-02882c840c68 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:44.539195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44f3a019-6f82-49a7-9485-02882c840c68 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:44.539784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44f3a019-6f82-49a7-9485-02882c840c68 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:44.540557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44f3a019-6f82-49a7-9485-02882c840c68 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:44.541014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44f3a019-6f82-49a7-9485-02882c840c68 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:44.541440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44f3a019-6f82-49a7-9485-02882c840c68 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:44.590476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:44.600846 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:44.602383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:44.603521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d48406a8-e899-4698-a1f7-cc4343952664 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.160312 Aug 24 06:19:44.604214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 235/462] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:44.681841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-44f3a019-6f82-49a7-9485-02882c840c68 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:44.689981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-44f3a019-6f82-49a7-9485-02882c840c68 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.163890 Aug 24 06:19:44.690519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 228/463] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:44 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:45.456259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-bb5299c2-eefd-40f1-a24f-9fd355bac902 req-0b2a96ae-0434-4bcc-a6f2-c470bca6314a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9", "name": "network-vif-plugged", "status": "completed", "tag": "6fa5961a-6a56-4ea0-88f8-85ee1d70c184"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:45.466286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-bb5299c2-eefd-40f1-a24f-9fd355bac902 req-0b2a96ae-0434-4bcc-a6f2-c470bca6314a service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:45.466763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-bb5299c2-eefd-40f1-a24f-9fd355bac902 req-0b2a96ae-0434-4bcc-a6f2-c470bca6314a service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:45.467183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-bb5299c2-eefd-40f1-a24f-9fd355bac902 req-0b2a96ae-0434-4bcc-a6f2-c470bca6314a service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:45.478879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-bb5299c2-eefd-40f1-a24f-9fd355bac902 req-0b2a96ae-0434-4bcc-a6f2-c470bca6314a service nova] Creating event network-vif-plugged:6fa5961a-6a56-4ea0-88f8-85ee1d70c184 for instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 on hv-cinder-85426 Aug 24 06:19:45.483939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-bb5299c2-eefd-40f1-a24f-9fd355bac902 req-0b2a96ae-0434-4bcc-a6f2-c470bca6314a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031342 Aug 24 06:19:45.484544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 236/464] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:19:45.626105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:45.626703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:45.633221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:45.633690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:45.634122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:45.634800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:45.635241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:45.635654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:45.712023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c85bb680-b8c4-4a22-965c-0ceed4bb88f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:45.712813 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c85bb680-b8c4-4a22-965c-0ceed4bb88f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:45.719434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85bb680-b8c4-4a22-965c-0ceed4bb88f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:45.719986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85bb680-b8c4-4a22-965c-0ceed4bb88f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:45.720596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85bb680-b8c4-4a22-965c-0ceed4bb88f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:45.721447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85bb680-b8c4-4a22-965c-0ceed4bb88f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:45.721894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85bb680-b8c4-4a22-965c-0ceed4bb88f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:45.722334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85bb680-b8c4-4a22-965c-0ceed4bb88f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:45.767849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:45.777463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:45.779081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:45.780238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-76d79668-af7c-4412-ad7d-cc1f1ca85818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.158084 Aug 24 06:19:45.780896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 229/465] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:45.856670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c85bb680-b8c4-4a22-965c-0ceed4bb88f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:45.864617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c85bb680-b8c4-4a22-965c-0ceed4bb88f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.156946 Aug 24 06:19:45.865234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 237/466] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:45 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:46.804557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:46.805160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:46.811531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:46.812002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:46.812430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:46.813188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:46.813586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:46.814001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:46.885593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-af5070b0-9c52-436f-a033-eb20fe4a7ad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:46.886143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-af5070b0-9c52-436f-a033-eb20fe4a7ad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:46.893172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af5070b0-9c52-436f-a033-eb20fe4a7ad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:46.893678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af5070b0-9c52-436f-a033-eb20fe4a7ad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:46.894103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af5070b0-9c52-436f-a033-eb20fe4a7ad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:46.894786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af5070b0-9c52-436f-a033-eb20fe4a7ad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:46.895231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af5070b0-9c52-436f-a033-eb20fe4a7ad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:46.895643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af5070b0-9c52-436f-a033-eb20fe4a7ad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:46.954898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:46.966247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:46.967997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:46.969729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-81f731fa-46ea-4a84-8903-99f457f986a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.169885 Aug 24 06:19:46.984235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 230/467] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:47.034915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-af5070b0-9c52-436f-a033-eb20fe4a7ad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:47.044314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-af5070b0-9c52-436f-a033-eb20fe4a7ad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.162583 Aug 24 06:19:47.044963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 238/468] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:46 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:47.712576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-999479d9-56c3-4d96-a432-4caa837f5d1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:47.713077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-999479d9-56c3-4d96-a432-4caa837f5d1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:47.719006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-999479d9-56c3-4d96-a432-4caa837f5d1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:47.719485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-999479d9-56c3-4d96-a432-4caa837f5d1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:47.719927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-999479d9-56c3-4d96-a432-4caa837f5d1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:47.720722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-999479d9-56c3-4d96-a432-4caa837f5d1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:47.721176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-999479d9-56c3-4d96-a432-4caa837f5d1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:47.721597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-999479d9-56c3-4d96-a432-4caa837f5d1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:47.751374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:47.845836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.objects.instance [None req-999479d9-56c3-4d96-a432-4caa837f5d1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lazy-loading 'services' on Instance uuid ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 {{(pid=121151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:19:47.994895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:47.995515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:48.002918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:48.003546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:48.003985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:48.004907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:48.005364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:48.006395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:48.084457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-999479d9-56c3-4d96-a432-4caa837f5d1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86/os-volume_attachments/374dd07e-c3a6-44fb-82af-efe087aec831" status: 202 len: 0 microversion: 2.1 time: 0.376260 Aug 24 06:19:48.085261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 231/469] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 24 06:19:47 2022] DELETE /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86/os-volume_attachments/374dd07e-c3a6-44fb-82af-efe087aec831 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:19:48.092319 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0926f00e-ee96-4e08-a816-b8815e8f50eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:48.093041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0926f00e-ee96-4e08-a816-b8815e8f50eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:48.101918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0926f00e-ee96-4e08-a816-b8815e8f50eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:48.105559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0926f00e-ee96-4e08-a816-b8815e8f50eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:48.105559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0926f00e-ee96-4e08-a816-b8815e8f50eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:48.105559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0926f00e-ee96-4e08-a816-b8815e8f50eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:48.105559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0926f00e-ee96-4e08-a816-b8815e8f50eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:48.105904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0926f00e-ee96-4e08-a816-b8815e8f50eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:48.145404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:48.154219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:48.155705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:48.156880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c37b1b68-9e1b-4b0e-827a-16976952a997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.167019 Aug 24 06:19:48.157438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 239/470] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:19:48.235984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0926f00e-ee96-4e08-a816-b8815e8f50eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:48.244283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0926f00e-ee96-4e08-a816-b8815e8f50eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.157613 Aug 24 06:19:48.244811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 232/471] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:48 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:49.179894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:49.180962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:49.187519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:49.188068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:49.188444 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:49.189192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:49.189650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:49.190077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:49.266071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-34dcc57f-bc3a-4c70-a35c-fe409bb3410e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:49.267061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-34dcc57f-bc3a-4c70-a35c-fe409bb3410e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:49.274385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34dcc57f-bc3a-4c70-a35c-fe409bb3410e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:49.274875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34dcc57f-bc3a-4c70-a35c-fe409bb3410e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:49.275338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34dcc57f-bc3a-4c70-a35c-fe409bb3410e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:49.276034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34dcc57f-bc3a-4c70-a35c-fe409bb3410e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:49.276517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34dcc57f-bc3a-4c70-a35c-fe409bb3410e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:49.277001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34dcc57f-bc3a-4c70-a35c-fe409bb3410e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:49.328853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:49.338150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:49.339717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:49.340902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e1abea48-92b5-460c-8707-5fc63c68a245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1811 microversion: 2.20 time: 0.165395 Aug 24 06:19:49.341605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 240/472] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1811 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:19:49.412121 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-34dcc57f-bc3a-4c70-a35c-fe409bb3410e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:49.419916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-34dcc57f-bc3a-4c70-a35c-fe409bb3410e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.157832 Aug 24 06:19:49.420506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 233/473] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:49 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:19:50.272677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5a387ea3-9acc-4f21-b26e-11907080106f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:50.273346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5a387ea3-9acc-4f21-b26e-11907080106f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:50.279867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5a387ea3-9acc-4f21-b26e-11907080106f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:50.280342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5a387ea3-9acc-4f21-b26e-11907080106f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:50.280800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5a387ea3-9acc-4f21-b26e-11907080106f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:50.281564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5a387ea3-9acc-4f21-b26e-11907080106f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:50.282024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5a387ea3-9acc-4f21-b26e-11907080106f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:50.282437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5a387ea3-9acc-4f21-b26e-11907080106f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:50.314954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5a387ea3-9acc-4f21-b26e-11907080106f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Going to try to terminate instance {{(pid=121150) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:19:50.453061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:50.453061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:50.453061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:50.453061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:50.453852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:50.453852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:50.453852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:50.453852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:50.514435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:50.523805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:50.525372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:50.526558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-460715ed-7797-47be-bd3a-3d7ee4bdd0b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1798 microversion: 2.20 time: 0.167259 Aug 24 06:19:50.527115 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 234/474] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:19:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1798 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:19:50.531765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-19b2c2f8-365c-473b-8e68-4b65b77c43a1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:50.532366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-19b2c2f8-365c-473b-8e68-4b65b77c43a1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:50.538820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19b2c2f8-365c-473b-8e68-4b65b77c43a1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:50.539384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19b2c2f8-365c-473b-8e68-4b65b77c43a1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:50.540285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19b2c2f8-365c-473b-8e68-4b65b77c43a1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:50.541196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19b2c2f8-365c-473b-8e68-4b65b77c43a1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:50.541655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19b2c2f8-365c-473b-8e68-4b65b77c43a1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:50.542071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19b2c2f8-365c-473b-8e68-4b65b77c43a1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:50.674797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-19b2c2f8-365c-473b-8e68-4b65b77c43a1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:50.683553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-19b2c2f8-365c-473b-8e68-4b65b77c43a1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.155417 Aug 24 06:19:50.684132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 235/475] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:50 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:50.701771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5a387ea3-9acc-4f21-b26e-11907080106f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 204 len: 0 microversion: 2.1 time: 0.434946 Aug 24 06:19:50.702357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 241/476] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:19:50 2022] DELETE /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:19:50.710623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b80d5906-3896-4b62-b238-219b16117e1e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:50.711240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b80d5906-3896-4b62-b238-219b16117e1e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:50.717361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b80d5906-3896-4b62-b238-219b16117e1e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:50.722791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b80d5906-3896-4b62-b238-219b16117e1e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:50.722791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b80d5906-3896-4b62-b238-219b16117e1e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:50.722791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b80d5906-3896-4b62-b238-219b16117e1e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:50.722791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b80d5906-3896-4b62-b238-219b16117e1e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:50.723151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b80d5906-3896-4b62-b238-219b16117e1e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:50.850002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b80d5906-3896-4b62-b238-219b16117e1e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:50.858026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b80d5906-3896-4b62-b238-219b16117e1e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1514 microversion: 2.1 time: 0.151309 Aug 24 06:19:50.858605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 236/477] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:50 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:51.705375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6001f778-a151-4a39-b1ba-44d4cc405c64 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:51.706065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6001f778-a151-4a39-b1ba-44d4cc405c64 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:51.713268 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6001f778-a151-4a39-b1ba-44d4cc405c64 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:51.713748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6001f778-a151-4a39-b1ba-44d4cc405c64 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:51.714176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6001f778-a151-4a39-b1ba-44d4cc405c64 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:51.714896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6001f778-a151-4a39-b1ba-44d4cc405c64 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:51.715342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6001f778-a151-4a39-b1ba-44d4cc405c64 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:51.715760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6001f778-a151-4a39-b1ba-44d4cc405c64 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:51.846704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6001f778-a151-4a39-b1ba-44d4cc405c64 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:51.854371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6001f778-a151-4a39-b1ba-44d4cc405c64 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.153226 Aug 24 06:19:51.854932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 242/478] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:51 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:51.879755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4613ed19-220f-4a4b-ac53-723f192dec0a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:51.880385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4613ed19-220f-4a4b-ac53-723f192dec0a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:51.887443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4613ed19-220f-4a4b-ac53-723f192dec0a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:51.887922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4613ed19-220f-4a4b-ac53-723f192dec0a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:51.888357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4613ed19-220f-4a4b-ac53-723f192dec0a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:51.889069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4613ed19-220f-4a4b-ac53-723f192dec0a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:51.889518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4613ed19-220f-4a4b-ac53-723f192dec0a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:51.889937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4613ed19-220f-4a4b-ac53-723f192dec0a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:52.015850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4613ed19-220f-4a4b-ac53-723f192dec0a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:52.023627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4613ed19-220f-4a4b-ac53-723f192dec0a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1514 microversion: 2.1 time: 0.147671 Aug 24 06:19:52.024204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 237/479] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:51 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:52.875232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6a531d0c-3896-4345-a5e2-9b8f47703530 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:52.875763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6a531d0c-3896-4345-a5e2-9b8f47703530 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:52.882834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a531d0c-3896-4345-a5e2-9b8f47703530 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:52.883320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a531d0c-3896-4345-a5e2-9b8f47703530 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:52.883751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a531d0c-3896-4345-a5e2-9b8f47703530 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:52.884436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a531d0c-3896-4345-a5e2-9b8f47703530 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:52.884920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a531d0c-3896-4345-a5e2-9b8f47703530 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:52.885340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a531d0c-3896-4345-a5e2-9b8f47703530 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:53.012756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6a531d0c-3896-4345-a5e2-9b8f47703530 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:53.020358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6a531d0c-3896-4345-a5e2-9b8f47703530 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.149079 Aug 24 06:19:53.020953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 243/480] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:52 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:53.043856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cc20f6c6-04ac-4a1d-932b-f214d97d6039 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:53.044511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cc20f6c6-04ac-4a1d-932b-f214d97d6039 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:53.051042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc20f6c6-04ac-4a1d-932b-f214d97d6039 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:53.051771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc20f6c6-04ac-4a1d-932b-f214d97d6039 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:53.052201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc20f6c6-04ac-4a1d-932b-f214d97d6039 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:53.052949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc20f6c6-04ac-4a1d-932b-f214d97d6039 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:53.053397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc20f6c6-04ac-4a1d-932b-f214d97d6039 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:53.053817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc20f6c6-04ac-4a1d-932b-f214d97d6039 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:53.185619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cc20f6c6-04ac-4a1d-932b-f214d97d6039 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:53.193875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cc20f6c6-04ac-4a1d-932b-f214d97d6039 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1514 microversion: 2.1 time: 0.153848 Aug 24 06:19:53.194445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 238/481] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:53 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:54.042476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-25428722-85a0-4606-8de6-a8dfd8cbf3be tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:54.043163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-25428722-85a0-4606-8de6-a8dfd8cbf3be tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:54.049897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25428722-85a0-4606-8de6-a8dfd8cbf3be tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:54.050384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25428722-85a0-4606-8de6-a8dfd8cbf3be tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:54.052626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25428722-85a0-4606-8de6-a8dfd8cbf3be tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:54.052626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25428722-85a0-4606-8de6-a8dfd8cbf3be tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:54.052626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25428722-85a0-4606-8de6-a8dfd8cbf3be tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:54.052930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25428722-85a0-4606-8de6-a8dfd8cbf3be tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:54.089299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-b6faa771-640a-4c8d-8530-14f93307ad5e req-06286508-2e4a-4788-b628-b722d8dc4f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86", "name": "network-vif-deleted", "tag": "7f444cec-7e1d-44bd-80e2-71b9dd9e0779"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:19:54.099216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-b6faa771-640a-4c8d-8530-14f93307ad5e req-06286508-2e4a-4788-b628-b722d8dc4f28 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:54.105466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-b6faa771-640a-4c8d-8530-14f93307ad5e req-06286508-2e4a-4788-b628-b722d8dc4f28 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:54.105466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-b6faa771-640a-4c8d-8530-14f93307ad5e req-06286508-2e4a-4788-b628-b722d8dc4f28 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:54.112231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-b6faa771-640a-4c8d-8530-14f93307ad5e req-06286508-2e4a-4788-b628-b722d8dc4f28 service nova] Creating event network-vif-deleted:7f444cec-7e1d-44bd-80e2-71b9dd9e0779 for instance ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 on hv-cinder-85426 Aug 24 06:19:54.117235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-b6faa771-640a-4c8d-8530-14f93307ad5e req-06286508-2e4a-4788-b628-b722d8dc4f28 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031954 Aug 24 06:19:54.117831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 239/482] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:19:54.184830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-25428722-85a0-4606-8de6-a8dfd8cbf3be tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:54.192758 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-25428722-85a0-4606-8de6-a8dfd8cbf3be tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.154283 Aug 24 06:19:54.193329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 244/483] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:54 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:54.215935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-dc0b1008-8812-4a58-b12b-79663a693368 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:54.216719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-dc0b1008-8812-4a58-b12b-79663a693368 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:54.222875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc0b1008-8812-4a58-b12b-79663a693368 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:54.223406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc0b1008-8812-4a58-b12b-79663a693368 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:54.223841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc0b1008-8812-4a58-b12b-79663a693368 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:54.225203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc0b1008-8812-4a58-b12b-79663a693368 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:54.225648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc0b1008-8812-4a58-b12b-79663a693368 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:54.226061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc0b1008-8812-4a58-b12b-79663a693368 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:54.291657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-dc0b1008-8812-4a58-b12b-79663a693368 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:54.299440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-dc0b1008-8812-4a58-b12b-79663a693368 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 200 len: 1304 microversion: 2.1 time: 0.088352 Aug 24 06:19:54.300027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 240/484] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:54 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:55.213380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-83960947-5045-4eac-bf75-ce7cb7212a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:55.214008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-83960947-5045-4eac-bf75-ce7cb7212a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:55.220445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83960947-5045-4eac-bf75-ce7cb7212a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:55.220972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83960947-5045-4eac-bf75-ce7cb7212a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:55.221395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83960947-5045-4eac-bf75-ce7cb7212a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:55.222066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83960947-5045-4eac-bf75-ce7cb7212a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:55.222508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83960947-5045-4eac-bf75-ce7cb7212a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:55.222918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83960947-5045-4eac-bf75-ce7cb7212a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:55.321427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:55.322031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:55.328385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:55.328905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:55.329331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:55.330016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:55.330462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:55.330888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:55.344564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] HTTP exception thrown: Instance ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 could not be found. Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Request method failure captured: Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 HTTP/1.1 Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcK5Jum_OK20fgXpBN-ZSjFarq7xKoyh-q1m6DDRErDtPxytlAoIYd4UCo-NawVRJc323fIeKJ3_zwGtF6vC5RbNCLhFQgOIk1QSc9nW0azam-vCjz-YBNIJf7r2gn7uEUc_VC0nKhU0oJ1RlJleo_gvTirrpL0QSBGAmnTNP4ojN-c Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: 7315c7714a7f40ed852dde74d497d231 Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-VolumesSnapshotTestJSON-506271099 Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:19:55.346293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7315c7714a7f40ed852dde74d497d231"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/7315c7714a7f40ed852dde74d497d231"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/7315c7714a7f40ed852dde74d497d231"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_7315c7714a7f40ed852dde74d497d231", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-VolumesSnapshotTestJSON-506271099 Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: 7315c7714a7f40ed852dde74d497d231 Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-506271099 Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-VolumesSnapshotTestJSON-506271099-project Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 4cb18bdb6d404cd5b303ce0a29212e4f Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-VolumesSnapshotTestJSON-506271099-project Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 could not be found. Aug 24 06:19:55.347808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': 'ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86'} Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 could not be found. Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:19:55.348935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 could not be found. Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 could not be found. Aug 24 06:19:55.350901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:19:55.351948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Returning 404 to user: Instance ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:19:55.351948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c2868979-57d9-484d-9883-63b3ef5a6bd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86" status: 404 len: 111 microversion: 2.1 time: 0.031137 Aug 24 06:19:55.351948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 241/485] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:55 2022] GET /compute/v2.1/servers/ee193ecf-56d3-4dbc-be7b-c0aa02ab7e86 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:19:55.356206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-83960947-5045-4eac-bf75-ce7cb7212a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:55.364401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-83960947-5045-4eac-bf75-ce7cb7212a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.154829 Aug 24 06:19:55.365425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 245/486] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:55 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:56.386726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f4be1c67-86e5-4b65-8ff2-8a5a64b5717d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:56.387360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f4be1c67-86e5-4b65-8ff2-8a5a64b5717d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:56.389772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=69 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:19:56.394455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4be1c67-86e5-4b65-8ff2-8a5a64b5717d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:56.394929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4be1c67-86e5-4b65-8ff2-8a5a64b5717d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:56.395362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4be1c67-86e5-4b65-8ff2-8a5a64b5717d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:56.396045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4be1c67-86e5-4b65-8ff2-8a5a64b5717d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:56.396505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4be1c67-86e5-4b65-8ff2-8a5a64b5717d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:56.396950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4be1c67-86e5-4b65-8ff2-8a5a64b5717d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:56.527546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f4be1c67-86e5-4b65-8ff2-8a5a64b5717d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:56.535288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f4be1c67-86e5-4b65-8ff2-8a5a64b5717d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.152477 Aug 24 06:19:56.535853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 242/487] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:56 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:57.556950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d64aff46-e86d-411c-9b07-7405ce58737c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:57.557549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d64aff46-e86d-411c-9b07-7405ce58737c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:57.564037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64aff46-e86d-411c-9b07-7405ce58737c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:57.564544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64aff46-e86d-411c-9b07-7405ce58737c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:57.564985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64aff46-e86d-411c-9b07-7405ce58737c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:57.565702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64aff46-e86d-411c-9b07-7405ce58737c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:57.566128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64aff46-e86d-411c-9b07-7405ce58737c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:57.566567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64aff46-e86d-411c-9b07-7405ce58737c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:57.691072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d64aff46-e86d-411c-9b07-7405ce58737c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:57.698956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d64aff46-e86d-411c-9b07-7405ce58737c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.146514 Aug 24 06:19:57.699517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 246/488] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:57 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:58.719133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ba40c8bd-76ed-419d-8b26-8434b7b30559 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:58.719743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ba40c8bd-76ed-419d-8b26-8434b7b30559 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:58.726265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba40c8bd-76ed-419d-8b26-8434b7b30559 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:58.726745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba40c8bd-76ed-419d-8b26-8434b7b30559 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:58.727181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba40c8bd-76ed-419d-8b26-8434b7b30559 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:58.727869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba40c8bd-76ed-419d-8b26-8434b7b30559 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:58.728328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba40c8bd-76ed-419d-8b26-8434b7b30559 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:58.728781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ba40c8bd-76ed-419d-8b26-8434b7b30559 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:58.857601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ba40c8bd-76ed-419d-8b26-8434b7b30559 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:19:58.865952 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ba40c8bd-76ed-419d-8b26-8434b7b30559 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.150626 Aug 24 06:19:58.866532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 243/489] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:58 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:19:59.887010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-200132e7-26db-4145-8035-30ea098ea39c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:19:59.887626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-200132e7-26db-4145-8035-30ea098ea39c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:19:59.894039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-200132e7-26db-4145-8035-30ea098ea39c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:59.894520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-200132e7-26db-4145-8035-30ea098ea39c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:59.894952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-200132e7-26db-4145-8035-30ea098ea39c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:19:59.895638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-200132e7-26db-4145-8035-30ea098ea39c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:19:59.896731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-200132e7-26db-4145-8035-30ea098ea39c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:19:59.897157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-200132e7-26db-4145-8035-30ea098ea39c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:00.035320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-200132e7-26db-4145-8035-30ea098ea39c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:00.043175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-200132e7-26db-4145-8035-30ea098ea39c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.160017 Aug 24 06:20:00.043764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 247/490] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:19:59 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:01.064839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a847e1fd-1027-4551-8da3-03777367d838 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:01.065385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a847e1fd-1027-4551-8da3-03777367d838 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:01.071982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a847e1fd-1027-4551-8da3-03777367d838 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:01.072465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a847e1fd-1027-4551-8da3-03777367d838 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:01.072928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a847e1fd-1027-4551-8da3-03777367d838 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:01.073624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a847e1fd-1027-4551-8da3-03777367d838 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:01.074077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a847e1fd-1027-4551-8da3-03777367d838 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:01.074501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a847e1fd-1027-4551-8da3-03777367d838 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:01.206756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a847e1fd-1027-4551-8da3-03777367d838 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:01.214441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a847e1fd-1027-4551-8da3-03777367d838 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.153557 Aug 24 06:20:01.215005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 244/491] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:01 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:02.236053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c75afa29-b2eb-446a-a2eb-7e0924dfadfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:02.236660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c75afa29-b2eb-446a-a2eb-7e0924dfadfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:02.243576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c75afa29-b2eb-446a-a2eb-7e0924dfadfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:02.244055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c75afa29-b2eb-446a-a2eb-7e0924dfadfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:02.244479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c75afa29-b2eb-446a-a2eb-7e0924dfadfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:02.245181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c75afa29-b2eb-446a-a2eb-7e0924dfadfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:02.245749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c75afa29-b2eb-446a-a2eb-7e0924dfadfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:02.246163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c75afa29-b2eb-446a-a2eb-7e0924dfadfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:02.371776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c75afa29-b2eb-446a-a2eb-7e0924dfadfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:02.379310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c75afa29-b2eb-446a-a2eb-7e0924dfadfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.147148 Aug 24 06:20:02.379878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 248/492] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:02 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:03.400898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2d7ce2dd-f834-4653-a391-e534ea844b31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:03.401496 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2d7ce2dd-f834-4653-a391-e534ea844b31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:03.407957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2d7ce2dd-f834-4653-a391-e534ea844b31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:03.408437 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2d7ce2dd-f834-4653-a391-e534ea844b31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:03.408901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2d7ce2dd-f834-4653-a391-e534ea844b31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:03.409591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2d7ce2dd-f834-4653-a391-e534ea844b31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:03.410047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2d7ce2dd-f834-4653-a391-e534ea844b31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:03.410466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2d7ce2dd-f834-4653-a391-e534ea844b31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:03.536569 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2d7ce2dd-f834-4653-a391-e534ea844b31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:03.544265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2d7ce2dd-f834-4653-a391-e534ea844b31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.147343 Aug 24 06:20:03.544858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 245/493] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:03 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:04.565209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-39a42081-2f73-429d-96be-8b7f7fa1b5c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:04.565845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-39a42081-2f73-429d-96be-8b7f7fa1b5c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:04.572909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a42081-2f73-429d-96be-8b7f7fa1b5c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:04.573388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a42081-2f73-429d-96be-8b7f7fa1b5c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:04.573820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a42081-2f73-429d-96be-8b7f7fa1b5c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:04.574499 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a42081-2f73-429d-96be-8b7f7fa1b5c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:04.574948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a42081-2f73-429d-96be-8b7f7fa1b5c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:04.575367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a42081-2f73-429d-96be-8b7f7fa1b5c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:04.700990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-39a42081-2f73-429d-96be-8b7f7fa1b5c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:04.708715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-39a42081-2f73-429d-96be-8b7f7fa1b5c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.147274 Aug 24 06:20:04.709286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 249/494] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:04 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:05.729494 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-52aa4a55-5481-402f-af1c-049f392da76b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:05.730102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-52aa4a55-5481-402f-af1c-049f392da76b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:05.736686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52aa4a55-5481-402f-af1c-049f392da76b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:05.737173 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52aa4a55-5481-402f-af1c-049f392da76b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:05.739366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52aa4a55-5481-402f-af1c-049f392da76b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:05.739366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52aa4a55-5481-402f-af1c-049f392da76b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:05.739366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52aa4a55-5481-402f-af1c-049f392da76b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:05.739366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52aa4a55-5481-402f-af1c-049f392da76b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:05.877516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-52aa4a55-5481-402f-af1c-049f392da76b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:05.883797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-536362399", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "networks": [{"uuid": "6a07a291-cd78-41f4-aedf-e2cf1b834915"}]}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:05.884352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-52aa4a55-5481-402f-af1c-049f392da76b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.158410 Aug 24 06:20:05.884668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 246/495] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:05 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:05.936946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.network.neutron [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] validate_networks() for [('6a07a291-cd78-41f4-aedf-e2cf1b834915', None, None, None, None, None)] {{(pid=121150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:20:06.284192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Flavor limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:20:06.284690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Image limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:20:06.285163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Flavor pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:20:06.285575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Image pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:20:06.285984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:20:06.294994 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:06.295468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:06.295947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:06.296661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:06.297114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:06.297534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:06.315076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Getting quotas for project 7315c7714a7f40ed852dde74d497d231. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:20:06.319729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Getting quotas for user 4cb18bdb6d404cd5b303ce0a29212e4f and project 7315c7714a7f40ed852dde74d497d231. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:20:06.330744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Going to run 1 instances... {{(pid=121150) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:20:06.333065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:20:06.486599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1f261235-bbfb-4f6b-b2c2-f0123a211902 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607210 Aug 24 06:20:06.487246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 250/496] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:20:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:20:06.498490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cdbba38e-07ce-4c04-a64c-58b439912b58 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:06.499111 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cdbba38e-07ce-4c04-a64c-58b439912b58 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:06.553439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cdbba38e-07ce-4c04-a64c-58b439912b58 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:06.561201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cdbba38e-07ce-4c04-a64c-58b439912b58 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1218 microversion: 2.1 time: 0.066453 Aug 24 06:20:06.562029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 247/497] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:06 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:06.906981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4b7405df-ddae-4f4f-a6f2-c4b87d9f549e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:06.907591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4b7405df-ddae-4f4f-a6f2-c4b87d9f549e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:06.914341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7405df-ddae-4f4f-a6f2-c4b87d9f549e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:06.914830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7405df-ddae-4f4f-a6f2-c4b87d9f549e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:06.915260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7405df-ddae-4f4f-a6f2-c4b87d9f549e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:06.916114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7405df-ddae-4f4f-a6f2-c4b87d9f549e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:06.916532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7405df-ddae-4f4f-a6f2-c4b87d9f549e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:06.916963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7405df-ddae-4f4f-a6f2-c4b87d9f549e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:06.921984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:07.055375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4b7405df-ddae-4f4f-a6f2-c4b87d9f549e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:07.063803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4b7405df-ddae-4f4f-a6f2-c4b87d9f549e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.161028 Aug 24 06:20:07.064135 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 251/498] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:06 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:07.582718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-725f67f3-2e07-4407-98de-377fa60f89e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:07.583264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-725f67f3-2e07-4407-98de-377fa60f89e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:07.589671 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-725f67f3-2e07-4407-98de-377fa60f89e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:07.590147 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-725f67f3-2e07-4407-98de-377fa60f89e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:07.590574 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-725f67f3-2e07-4407-98de-377fa60f89e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:07.591262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-725f67f3-2e07-4407-98de-377fa60f89e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:07.591711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-725f67f3-2e07-4407-98de-377fa60f89e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:07.592129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-725f67f3-2e07-4407-98de-377fa60f89e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:07.654272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-725f67f3-2e07-4407-98de-377fa60f89e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:07.662089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-725f67f3-2e07-4407-98de-377fa60f89e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1222 microversion: 2.1 time: 0.083362 Aug 24 06:20:07.662650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 248/499] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:07 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:08.085264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a62bd1c9-243a-47cc-b853-09e906b992f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:08.085873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a62bd1c9-243a-47cc-b853-09e906b992f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:08.092651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a62bd1c9-243a-47cc-b853-09e906b992f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:08.093302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a62bd1c9-243a-47cc-b853-09e906b992f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:08.093734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a62bd1c9-243a-47cc-b853-09e906b992f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:08.094414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a62bd1c9-243a-47cc-b853-09e906b992f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:08.094893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a62bd1c9-243a-47cc-b853-09e906b992f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:08.095312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a62bd1c9-243a-47cc-b853-09e906b992f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:08.223083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a62bd1c9-243a-47cc-b853-09e906b992f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:08.231286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a62bd1c9-243a-47cc-b853-09e906b992f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.150278 Aug 24 06:20:08.231849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 252/500] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:08 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:08.683120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-db0e553c-25d3-492b-856b-e3ecc2a7a9c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:08.683753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-db0e553c-25d3-492b-856b-e3ecc2a7a9c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:08.691158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db0e553c-25d3-492b-856b-e3ecc2a7a9c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:08.691637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db0e553c-25d3-492b-856b-e3ecc2a7a9c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:08.692066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db0e553c-25d3-492b-856b-e3ecc2a7a9c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:08.693273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db0e553c-25d3-492b-856b-e3ecc2a7a9c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:08.693719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db0e553c-25d3-492b-856b-e3ecc2a7a9c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:08.694140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db0e553c-25d3-492b-856b-e3ecc2a7a9c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:08.714368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:08.759235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-db0e553c-25d3-492b-856b-e3ecc2a7a9c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:08.767017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-db0e553c-25d3-492b-856b-e3ecc2a7a9c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1270 microversion: 2.1 time: 0.087967 Aug 24 06:20:08.767633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 249/501] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:08 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:09.253118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d1bc0940-5c4c-4380-a815-e82ada2818cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:09.253827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d1bc0940-5c4c-4380-a815-e82ada2818cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:09.260969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1bc0940-5c4c-4380-a815-e82ada2818cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:09.261439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1bc0940-5c4c-4380-a815-e82ada2818cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:09.261859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1bc0940-5c4c-4380-a815-e82ada2818cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:09.262550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1bc0940-5c4c-4380-a815-e82ada2818cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:09.262991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1bc0940-5c4c-4380-a815-e82ada2818cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:09.263400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1bc0940-5c4c-4380-a815-e82ada2818cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:09.402670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d1bc0940-5c4c-4380-a815-e82ada2818cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:09.411713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d1bc0940-5c4c-4380-a815-e82ada2818cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1502 microversion: 2.1 time: 0.161906 Aug 24 06:20:09.412629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 253/502] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:09 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:09.444414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b6a850d-9e80-4839-ba78-06603f42ff6f"}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:09.446840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:09.453255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:09.453958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:09.454384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:09.455080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:09.455532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:09.455959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:09.480586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] HTTP exception thrown: Cannot 'attach_volume' instance ce39956a-712f-48bb-83fd-c0f2efe66f83 while it is in vm_state rescued Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Request method failure captured: Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: POST /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83/os-volume_attachments HTTP/1.1 Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 74 Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcKrWIVODpGKYwuAjadGNhY4NWvtqpqnx0Eqk2Jv476klt3FCknTTgC7Lp6zVuEV3Qss59XKRLhUuiBtlrv4Rdl7sk5an2zO6A3FeeJFSXBQEGT4B0QnxI4EIo4TLtLFqknF7HyQ1uF165HUtypVjOsoC_avY3WmBTaXarybT-MPPC4 Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: c467d980c962456c9fa0e28364efd2a3 Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714652183 Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:20:09.482185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c467d980c962456c9fa0e28364efd2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c467d980c962456c9fa0e28364efd2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c467d980c962456c9fa0e28364efd2a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c467d980c962456c9fa0e28364efd2a3", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714652183 Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: c467d980c962456c9fa0e28364efd2a3 Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714652183 Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-ServerRescueNegativeTestJSON-714652183-project Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 069dc6f771a74dd4ab22d9d5e68e3cc9 Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714652183-project Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {"volumeAttachment": {"volumeId": "5b6a850d-9e80-4839-ba78-06603f42ff6f"}} Aug 24 06:20:09.483744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Cannot 'attach_volume' instance ce39956a-712f-48bb-83fd-c0f2efe66f83 while it is in vm_state rescued Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'server_id': 'ce39956a-712f-48bb-83fd-c0f2efe66f83', 'body': {'volumeAttachment': {'volumeId': '5b6a850d-9e80-4839-ba78-06603f42ff6f'}}} Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ce39956a-712f-48bb-83fd-c0f2efe66f83 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:20:09.484641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ce39956a-712f-48bb-83fd-c0f2efe66f83 while it is in vm_state rescued Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:20:09.485940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:20:09.487302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:20:09.487302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:20:09.487302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ce39956a-712f-48bb-83fd-c0f2efe66f83 while it is in vm_state rescued Aug 24 06:20:09.487302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:09.487302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Returning 409 to user: Cannot 'attach_volume' instance ce39956a-712f-48bb-83fd-c0f2efe66f83 while it is in vm_state rescued {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:20:09.487302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bb7beb7d-a7cc-48e3-966a-542c2b3ad50d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "POST /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044077 Aug 24 06:20:09.487302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 250/503] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 24 06:20:09 2022] POST /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 06:20:09.494451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7b77ce3e-04d7-4591-b5a2-561fb2203783 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:09.494975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7b77ce3e-04d7-4591-b5a2-561fb2203783 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:09.501292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b77ce3e-04d7-4591-b5a2-561fb2203783 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:09.501781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b77ce3e-04d7-4591-b5a2-561fb2203783 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:09.502210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b77ce3e-04d7-4591-b5a2-561fb2203783 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:09.502908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b77ce3e-04d7-4591-b5a2-561fb2203783 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:09.503414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b77ce3e-04d7-4591-b5a2-561fb2203783 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:09.503782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b77ce3e-04d7-4591-b5a2-561fb2203783 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:09.740255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7b77ce3e-04d7-4591-b5a2-561fb2203783 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "POST /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83/action" status: 202 len: 0 microversion: 2.1 time: 0.248942 Aug 24 06:20:09.741054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 254/504] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 24 06:20:09 2022] POST /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:20:09.749592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8c8b3cf3-4f95-4988-8e58-b6c84a94680c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:09.750866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8c8b3cf3-4f95-4988-8e58-b6c84a94680c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:09.759372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8b3cf3-4f95-4988-8e58-b6c84a94680c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:09.759832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8b3cf3-4f95-4988-8e58-b6c84a94680c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:09.760260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8b3cf3-4f95-4988-8e58-b6c84a94680c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:09.760998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8b3cf3-4f95-4988-8e58-b6c84a94680c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:09.761449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8b3cf3-4f95-4988-8e58-b6c84a94680c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:09.768654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8b3cf3-4f95-4988-8e58-b6c84a94680c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:09.790073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-111b5e3a-1fb6-4f16-b003-4af93ab31e5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:09.791133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-111b5e3a-1fb6-4f16-b003-4af93ab31e5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:09.793486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:09.798875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-111b5e3a-1fb6-4f16-b003-4af93ab31e5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:09.802861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-111b5e3a-1fb6-4f16-b003-4af93ab31e5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:09.802861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-111b5e3a-1fb6-4f16-b003-4af93ab31e5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:09.802861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-111b5e3a-1fb6-4f16-b003-4af93ab31e5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:09.802861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-111b5e3a-1fb6-4f16-b003-4af93ab31e5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:09.803299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-111b5e3a-1fb6-4f16-b003-4af93ab31e5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:09.878821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-111b5e3a-1fb6-4f16-b003-4af93ab31e5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:09.887205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-111b5e3a-1fb6-4f16-b003-4af93ab31e5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1276 microversion: 2.1 time: 0.102016 Aug 24 06:20:09.888015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 255/505] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:09 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1276 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:09.969314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8c8b3cf3-4f95-4988-8e58-b6c84a94680c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:09.977774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8c8b3cf3-4f95-4988-8e58-b6c84a94680c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1510 microversion: 2.1 time: 0.232312 Aug 24 06:20:09.978583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 251/506] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:09 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:10.908881 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1b5f1ef5-69ed-465b-94ea-502a05f3fc02 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:10.909494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1b5f1ef5-69ed-465b-94ea-502a05f3fc02 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:10.918255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1b5f1ef5-69ed-465b-94ea-502a05f3fc02 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:10.918255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1b5f1ef5-69ed-465b-94ea-502a05f3fc02 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:10.918255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1b5f1ef5-69ed-465b-94ea-502a05f3fc02 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:10.918626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1b5f1ef5-69ed-465b-94ea-502a05f3fc02 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:10.918898 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1b5f1ef5-69ed-465b-94ea-502a05f3fc02 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:10.919321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1b5f1ef5-69ed-465b-94ea-502a05f3fc02 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:11.000203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ee3b3f7e-c169-491e-ac64-4c6ad44ec478 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:11.001658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ee3b3f7e-c169-491e-ac64-4c6ad44ec478 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:11.011022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee3b3f7e-c169-491e-ac64-4c6ad44ec478 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:11.012119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee3b3f7e-c169-491e-ac64-4c6ad44ec478 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:11.012763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee3b3f7e-c169-491e-ac64-4c6ad44ec478 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:11.016059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee3b3f7e-c169-491e-ac64-4c6ad44ec478 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:11.016059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee3b3f7e-c169-491e-ac64-4c6ad44ec478 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:11.016059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee3b3f7e-c169-491e-ac64-4c6ad44ec478 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:11.056461 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1b5f1ef5-69ed-465b-94ea-502a05f3fc02 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:11.064859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1b5f1ef5-69ed-465b-94ea-502a05f3fc02 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1318 microversion: 2.1 time: 0.159909 Aug 24 06:20:11.065705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 256/507] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:10 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:11.071344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-4516cf70-08a0-4eac-ac20-db5bf3fb337a req-ff10731f-cf9f-4e4e-8bd4-298fb9d4d57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f57e168-0ea9-4010-ac53-24c1da2474d7", "tag": "eac62d9b-9d4a-455c-a18c-d1a1aa1b3a1b"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:11.082200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-4516cf70-08a0-4eac-ac20-db5bf3fb337a req-ff10731f-cf9f-4e4e-8bd4-298fb9d4d57a service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:11.082677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-4516cf70-08a0-4eac-ac20-db5bf3fb337a req-ff10731f-cf9f-4e4e-8bd4-298fb9d4d57a service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:11.083718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-4516cf70-08a0-4eac-ac20-db5bf3fb337a req-ff10731f-cf9f-4e4e-8bd4-298fb9d4d57a service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:11.096054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-4516cf70-08a0-4eac-ac20-db5bf3fb337a req-ff10731f-cf9f-4e4e-8bd4-298fb9d4d57a service nova] Creating event network-changed:eac62d9b-9d4a-455c-a18c-d1a1aa1b3a1b for instance 6f57e168-0ea9-4010-ac53-24c1da2474d7 on hv-cinder-85426 Aug 24 06:20:11.101301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-4516cf70-08a0-4eac-ac20-db5bf3fb337a req-ff10731f-cf9f-4e4e-8bd4-298fb9d4d57a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034082 Aug 24 06:20:11.101920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 257/508] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:11.393431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ee3b3f7e-c169-491e-ac64-4c6ad44ec478 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:11.401096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ee3b3f7e-c169-491e-ac64-4c6ad44ec478 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1510 microversion: 2.1 time: 0.405602 Aug 24 06:20:11.401658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 252/509] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:10 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1510 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:12.087848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9d60f20c-1144-4124-8616-352c7aa96e9c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:12.088458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9d60f20c-1144-4124-8616-352c7aa96e9c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:12.094577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d60f20c-1144-4124-8616-352c7aa96e9c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:12.095048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d60f20c-1144-4124-8616-352c7aa96e9c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:12.095473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d60f20c-1144-4124-8616-352c7aa96e9c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:12.096142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d60f20c-1144-4124-8616-352c7aa96e9c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:12.096615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d60f20c-1144-4124-8616-352c7aa96e9c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:12.097028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d60f20c-1144-4124-8616-352c7aa96e9c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:12.227618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9d60f20c-1144-4124-8616-352c7aa96e9c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:12.235170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9d60f20c-1144-4124-8616-352c7aa96e9c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1318 microversion: 2.1 time: 0.152493 Aug 24 06:20:12.235722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 258/510] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:12 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:12.422724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-58d5164d-89f2-4b7e-91fe-ab687388ed2d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:12.423416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-58d5164d-89f2-4b7e-91fe-ab687388ed2d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:12.430382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-58d5164d-89f2-4b7e-91fe-ab687388ed2d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:12.430865 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-58d5164d-89f2-4b7e-91fe-ab687388ed2d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:12.431296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-58d5164d-89f2-4b7e-91fe-ab687388ed2d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:12.431990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-58d5164d-89f2-4b7e-91fe-ab687388ed2d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:12.432436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-58d5164d-89f2-4b7e-91fe-ab687388ed2d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:12.432878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-58d5164d-89f2-4b7e-91fe-ab687388ed2d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:12.633970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-58d5164d-89f2-4b7e-91fe-ab687388ed2d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:12.641625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-58d5164d-89f2-4b7e-91fe-ab687388ed2d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1510 microversion: 2.1 time: 0.222852 Aug 24 06:20:12.642186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 253/511] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:12 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:13.255195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e3ddcaf0-ca5d-4d32-af17-60a1713776c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:13.255816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e3ddcaf0-ca5d-4d32-af17-60a1713776c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:13.262501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3ddcaf0-ca5d-4d32-af17-60a1713776c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:13.262983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3ddcaf0-ca5d-4d32-af17-60a1713776c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:13.263414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3ddcaf0-ca5d-4d32-af17-60a1713776c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:13.264111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3ddcaf0-ca5d-4d32-af17-60a1713776c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:13.264599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3ddcaf0-ca5d-4d32-af17-60a1713776c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:13.265016 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e3ddcaf0-ca5d-4d32-af17-60a1713776c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:13.394592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e3ddcaf0-ca5d-4d32-af17-60a1713776c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:13.402686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e3ddcaf0-ca5d-4d32-af17-60a1713776c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1318 microversion: 2.1 time: 0.151316 Aug 24 06:20:13.403256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 259/512] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:13 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:13.663760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ff06a2c8-0eb4-496a-8948-957c5e64d3db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:13.664392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ff06a2c8-0eb4-496a-8948-957c5e64d3db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:13.671237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff06a2c8-0eb4-496a-8948-957c5e64d3db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:13.671709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff06a2c8-0eb4-496a-8948-957c5e64d3db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:13.672138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff06a2c8-0eb4-496a-8948-957c5e64d3db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:13.672928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff06a2c8-0eb4-496a-8948-957c5e64d3db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:13.673377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff06a2c8-0eb4-496a-8948-957c5e64d3db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:13.673793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff06a2c8-0eb4-496a-8948-957c5e64d3db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:13.806278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ff06a2c8-0eb4-496a-8948-957c5e64d3db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:13.814224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ff06a2c8-0eb4-496a-8948-957c5e64d3db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1516 microversion: 2.1 time: 0.155113 Aug 24 06:20:13.814804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 254/513] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:13 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:14.424000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-565765d0-bfa0-40f1-9f4c-d2d6272e57bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:14.424678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-565765d0-bfa0-40f1-9f4c-d2d6272e57bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:14.431959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-565765d0-bfa0-40f1-9f4c-d2d6272e57bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:14.432551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-565765d0-bfa0-40f1-9f4c-d2d6272e57bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:14.433059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-565765d0-bfa0-40f1-9f4c-d2d6272e57bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:14.434029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-565765d0-bfa0-40f1-9f4c-d2d6272e57bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:14.434346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-565765d0-bfa0-40f1-9f4c-d2d6272e57bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:14.434853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-565765d0-bfa0-40f1-9f4c-d2d6272e57bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:14.575420 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-565765d0-bfa0-40f1-9f4c-d2d6272e57bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:14.582922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-565765d0-bfa0-40f1-9f4c-d2d6272e57bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1318 microversion: 2.1 time: 0.162962 Aug 24 06:20:14.583485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 260/514] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:14 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:15.377221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5171d3a5-b197-44dd-8040-2a3ecbb345e6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Action: 'create', calling method: .version_select at 0x7fcddc03bc10>, body: {"keypair": {"name": "tempest-keypair-1989175033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJckn+IP75xVtPzuBVsHsPbiW3xQZoKhmj4iU9ZAb6KRBKwwNOL29fzMPMfsmYQzh2JEJ9XRLTeDpswrWXpN/h32XgIvnNzHJxk60TbOBIKlJaEtT6P1ybEDPBpG+SCh9w=="}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:15.393223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-5171d3a5-b197-44dd-8040-2a3ecbb345e6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Getting quotas for project c467d980c962456c9fa0e28364efd2a3. Resources: {'key_pairs'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:20:15.397724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-5171d3a5-b197-44dd-8040-2a3ecbb345e6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Getting quotas for user 069dc6f771a74dd4ab22d9d5e68e3cc9 and project c467d980c962456c9fa0e28364efd2a3. Resources: {'key_pairs'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:20:15.463227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5171d3a5-b197-44dd-8040-2a3ecbb345e6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089704 Aug 24 06:20:15.463825 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 255/515] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 24 06:20:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:15.603151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fc30bce0-520a-4b0b-8e32-74886ba91673 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:15.603733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fc30bce0-520a-4b0b-8e32-74886ba91673 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:15.610520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc30bce0-520a-4b0b-8e32-74886ba91673 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:15.610997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc30bce0-520a-4b0b-8e32-74886ba91673 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:15.611430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc30bce0-520a-4b0b-8e32-74886ba91673 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:15.612126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc30bce0-520a-4b0b-8e32-74886ba91673 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:15.612606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc30bce0-520a-4b0b-8e32-74886ba91673 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:15.613046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc30bce0-520a-4b0b-8e32-74886ba91673 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:15.750203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fc30bce0-520a-4b0b-8e32-74886ba91673 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:15.776802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fc30bce0-520a-4b0b-8e32-74886ba91673 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1318 microversion: 2.1 time: 0.161559 Aug 24 06:20:15.776802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 261/516] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:15 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:16.788469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-064085c2-d94e-4b86-ad2c-6b5179431b00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:16.789227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-064085c2-d94e-4b86-ad2c-6b5179431b00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:16.796218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-064085c2-d94e-4b86-ad2c-6b5179431b00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:16.796792 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-064085c2-d94e-4b86-ad2c-6b5179431b00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:16.797189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-064085c2-d94e-4b86-ad2c-6b5179431b00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:16.797889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-064085c2-d94e-4b86-ad2c-6b5179431b00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:16.798339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-064085c2-d94e-4b86-ad2c-6b5179431b00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:16.798791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-064085c2-d94e-4b86-ad2c-6b5179431b00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:16.945914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-064085c2-d94e-4b86-ad2c-6b5179431b00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:16.953643 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-064085c2-d94e-4b86-ad2c-6b5179431b00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1318 microversion: 2.1 time: 0.170305 Aug 24 06:20:16.954202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 256/517] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:16 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:17.645021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2093875847", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ee7126af-d800-4d07-9c4c-d1b903e93663"}], "security_groups": [{"name": "tempest-securitygroup--1994319245"}], "key_name": "tempest-keypair-1989175033", "user_data": "}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:17.653349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:17.654280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=6 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:17.761791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.network.neutron [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] validate_networks() for [('ee7126af-d800-4d07-9c4c-d1b903e93663', None, None, None, None, None)] {{(pid=121150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:20:17.975513 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-11995135-e670-4a75-87bf-64714397550d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:17.976203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-11995135-e670-4a75-87bf-64714397550d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:17.982945 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11995135-e670-4a75-87bf-64714397550d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:17.983430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11995135-e670-4a75-87bf-64714397550d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:17.983861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11995135-e670-4a75-87bf-64714397550d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:17.984580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11995135-e670-4a75-87bf-64714397550d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:17.985029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11995135-e670-4a75-87bf-64714397550d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:17.985449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11995135-e670-4a75-87bf-64714397550d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:18.119509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-11995135-e670-4a75-87bf-64714397550d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:18.127824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-11995135-e670-4a75-87bf-64714397550d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1318 microversion: 2.1 time: 0.156626 Aug 24 06:20:18.128742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 257/518] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:17 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:18.133368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Flavor limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:20:18.133789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Image limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:20:18.134261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Flavor pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:20:18.134723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Image pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:20:18.135127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:20:18.144072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:18.144662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:18.145204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:18.146493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:18.146944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:18.147476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:18.165380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Getting quotas for project c467d980c962456c9fa0e28364efd2a3. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:20:18.169360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Getting quotas for user 069dc6f771a74dd4ab22d9d5e68e3cc9 and project c467d980c962456c9fa0e28364efd2a3. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:20:18.180686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Going to run 1 instances... {{(pid=121150) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:20:18.184823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:20:18.343883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ddb55d54-54ab-457b-bf1f-5ae9be39d237 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.703223 Aug 24 06:20:18.344802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 262/519] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:20:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:20:18.356385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8eaa8e2d-6a49-4269-bbf0-632d9a13ac0b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:18.357052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8eaa8e2d-6a49-4269-bbf0-632d9a13ac0b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:18.410395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8eaa8e2d-6a49-4269-bbf0-632d9a13ac0b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:18.417282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8eaa8e2d-6a49-4269-bbf0-632d9a13ac0b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1246 microversion: 2.1 time: 0.064903 Aug 24 06:20:18.417843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 258/520] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:18 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1246 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:18.496087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5b7d8267-c6d1-4ea9-8a0f-8e06b700290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:18.496600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5b7d8267-c6d1-4ea9-8a0f-8e06b700290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:18.504479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b7d8267-c6d1-4ea9-8a0f-8e06b700290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:18.505625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b7d8267-c6d1-4ea9-8a0f-8e06b700290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:18.506062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b7d8267-c6d1-4ea9-8a0f-8e06b700290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:18.506778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b7d8267-c6d1-4ea9-8a0f-8e06b700290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:18.507226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b7d8267-c6d1-4ea9-8a0f-8e06b700290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:18.507673 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b7d8267-c6d1-4ea9-8a0f-8e06b700290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:18.632132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-5b7d8267-c6d1-4ea9-8a0f-8e06b700290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lazy-loading 'services' on Instance uuid 5950cfdd-41b3-4842-81ab-e6507515a4a2 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:20:18.833024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5b7d8267-c6d1-4ea9-8a0f-8e06b700290d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/os-volume_attachments/13e77017-3da9-462f-805a-6313da538ca5" status: 202 len: 0 microversion: 2.1 time: 0.340508 Aug 24 06:20:18.833735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 263/521] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 24 06:20:18 2022] DELETE /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/os-volume_attachments/13e77017-3da9-462f-805a-6313da538ca5 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:20:19.148917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-01954aad-228f-45b8-a6f5-3722c857ac93 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:19.149556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-01954aad-228f-45b8-a6f5-3722c857ac93 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:19.155855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01954aad-228f-45b8-a6f5-3722c857ac93 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:19.156438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01954aad-228f-45b8-a6f5-3722c857ac93 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:19.157436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01954aad-228f-45b8-a6f5-3722c857ac93 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:19.158133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01954aad-228f-45b8-a6f5-3722c857ac93 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:19.158582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01954aad-228f-45b8-a6f5-3722c857ac93 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:19.159005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01954aad-228f-45b8-a6f5-3722c857ac93 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:19.293675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-01954aad-228f-45b8-a6f5-3722c857ac93 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:19.301334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-01954aad-228f-45b8-a6f5-3722c857ac93 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1318 microversion: 2.1 time: 0.156423 Aug 24 06:20:19.302561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 259/522] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:19 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:19.438896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4ecde811-b16a-4c8a-9480-ca3db43c4533 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:19.439589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4ecde811-b16a-4c8a-9480-ca3db43c4533 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:19.445862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ecde811-b16a-4c8a-9480-ca3db43c4533 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:19.452904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ecde811-b16a-4c8a-9480-ca3db43c4533 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:19.452904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ecde811-b16a-4c8a-9480-ca3db43c4533 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:19.452904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ecde811-b16a-4c8a-9480-ca3db43c4533 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:19.452904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ecde811-b16a-4c8a-9480-ca3db43c4533 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:19.453384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ecde811-b16a-4c8a-9480-ca3db43c4533 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:19.510681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4ecde811-b16a-4c8a-9480-ca3db43c4533 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:19.518672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4ecde811-b16a-4c8a-9480-ca3db43c4533 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1250 microversion: 2.1 time: 0.083998 Aug 24 06:20:19.519255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 264/523] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:19 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:19.774609 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-8a320bee-e855-46cd-9216-e792aa31652d req-072b09e6-23c6-4d00-8b5a-cdd2284c140f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f57e168-0ea9-4010-ac53-24c1da2474d7", "name": "network-vif-plugged", "status": "completed", "tag": "eac62d9b-9d4a-455c-a18c-d1a1aa1b3a1b"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:19.784225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-8a320bee-e855-46cd-9216-e792aa31652d req-072b09e6-23c6-4d00-8b5a-cdd2284c140f service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:19.784814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-8a320bee-e855-46cd-9216-e792aa31652d req-072b09e6-23c6-4d00-8b5a-cdd2284c140f service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:19.785267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-8a320bee-e855-46cd-9216-e792aa31652d req-072b09e6-23c6-4d00-8b5a-cdd2284c140f service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:19.796887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-8a320bee-e855-46cd-9216-e792aa31652d req-072b09e6-23c6-4d00-8b5a-cdd2284c140f service nova] Creating event network-vif-plugged:eac62d9b-9d4a-455c-a18c-d1a1aa1b3a1b for instance 6f57e168-0ea9-4010-ac53-24c1da2474d7 on hv-cinder-85426 Aug 24 06:20:19.802346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-8a320bee-e855-46cd-9216-e792aa31652d req-072b09e6-23c6-4d00-8b5a-cdd2284c140f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031612 Aug 24 06:20:19.802949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 260/524] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:20.323383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c1f6e703-a60d-4102-b1e3-5cb3404aea5a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:20.323889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c1f6e703-a60d-4102-b1e3-5cb3404aea5a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:20.330398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1f6e703-a60d-4102-b1e3-5cb3404aea5a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:20.330873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1f6e703-a60d-4102-b1e3-5cb3404aea5a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:20.331293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1f6e703-a60d-4102-b1e3-5cb3404aea5a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:20.332030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1f6e703-a60d-4102-b1e3-5cb3404aea5a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:20.332474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1f6e703-a60d-4102-b1e3-5cb3404aea5a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:20.333084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1f6e703-a60d-4102-b1e3-5cb3404aea5a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:20.467072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c1f6e703-a60d-4102-b1e3-5cb3404aea5a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:20.474777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c1f6e703-a60d-4102-b1e3-5cb3404aea5a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1318 microversion: 2.1 time: 0.155476 Aug 24 06:20:20.475338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 265/525] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:20 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:20.541115 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-172b55a8-75e7-4b49-b9f2-44b947683c11 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:20.541951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-172b55a8-75e7-4b49-b9f2-44b947683c11 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:20.547902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-172b55a8-75e7-4b49-b9f2-44b947683c11 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:20.548375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-172b55a8-75e7-4b49-b9f2-44b947683c11 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:20.548850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-172b55a8-75e7-4b49-b9f2-44b947683c11 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:20.549562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-172b55a8-75e7-4b49-b9f2-44b947683c11 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:20.550005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-172b55a8-75e7-4b49-b9f2-44b947683c11 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:20.550422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-172b55a8-75e7-4b49-b9f2-44b947683c11 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:20.615268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-172b55a8-75e7-4b49-b9f2-44b947683c11 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:20.622963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-172b55a8-75e7-4b49-b9f2-44b947683c11 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1298 microversion: 2.1 time: 0.086536 Aug 24 06:20:20.623532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 261/526] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:20 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1298 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:21.044833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8ee4787f-0dfc-476e-9984-730a75f3b34c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:21.052104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ee4787f-0dfc-476e-9984-730a75f3b34c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:21.052641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ee4787f-0dfc-476e-9984-730a75f3b34c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:21.053078 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ee4787f-0dfc-476e-9984-730a75f3b34c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:21.116326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8ee4787f-0dfc-476e-9984-730a75f3b34c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Going to try to stop instance {{(pid=121150) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 06:20:21.142173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:21.495549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b013eb82-0046-4c13-bab2-307f905f7042 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:21.496194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b013eb82-0046-4c13-bab2-307f905f7042 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:21.503361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b013eb82-0046-4c13-bab2-307f905f7042 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:21.504204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b013eb82-0046-4c13-bab2-307f905f7042 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:21.506153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b013eb82-0046-4c13-bab2-307f905f7042 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:21.506153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b013eb82-0046-4c13-bab2-307f905f7042 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:21.506553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b013eb82-0046-4c13-bab2-307f905f7042 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:21.507027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b013eb82-0046-4c13-bab2-307f905f7042 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:21.567918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8ee4787f-0dfc-476e-9984-730a75f3b34c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "POST /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/action" status: 202 len: 0 microversion: 2.1 time: 0.526270 Aug 24 06:20:21.568853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 266/527] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 24 06:20:21 2022] POST /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:20:21.577147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-65964ab2-c7ec-4040-9abb-224eaec25a08 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:21.587481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-65964ab2-c7ec-4040-9abb-224eaec25a08 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:21.587481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65964ab2-c7ec-4040-9abb-224eaec25a08 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:21.587481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65964ab2-c7ec-4040-9abb-224eaec25a08 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:21.587481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65964ab2-c7ec-4040-9abb-224eaec25a08 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:21.587900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65964ab2-c7ec-4040-9abb-224eaec25a08 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:21.587900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65964ab2-c7ec-4040-9abb-224eaec25a08 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:21.587900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65964ab2-c7ec-4040-9abb-224eaec25a08 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:21.650680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b013eb82-0046-4c13-bab2-307f905f7042 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:21.657110 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b013eb82-0046-4c13-bab2-307f905f7042 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1318 microversion: 2.1 time: 0.165391 Aug 24 06:20:21.670522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 262/528] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:21 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:21.670522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-88d62bca-c920-48c4-9fd3-20a0bf52db75 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:21.670522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-88d62bca-c920-48c4-9fd3-20a0bf52db75 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:21.670522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88d62bca-c920-48c4-9fd3-20a0bf52db75 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:21.672253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88d62bca-c920-48c4-9fd3-20a0bf52db75 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:21.672253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88d62bca-c920-48c4-9fd3-20a0bf52db75 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:21.672253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88d62bca-c920-48c4-9fd3-20a0bf52db75 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:21.672253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88d62bca-c920-48c4-9fd3-20a0bf52db75 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:21.672648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88d62bca-c920-48c4-9fd3-20a0bf52db75 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:21.747623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-65964ab2-c7ec-4040-9abb-224eaec25a08 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:21.762722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-65964ab2-c7ec-4040-9abb-224eaec25a08 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.187413 Aug 24 06:20:21.762722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 267/529] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:21 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:21.886642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-88d62bca-c920-48c4-9fd3-20a0bf52db75 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:21.894496 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-88d62bca-c920-48c4-9fd3-20a0bf52db75 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1372 microversion: 2.1 time: 0.235666 Aug 24 06:20:21.897568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 263/530] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:21 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1372 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:22.680689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f6c563f8-e48f-49f1-8e8f-02d6e8cc7261 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:22.680689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f6c563f8-e48f-49f1-8e8f-02d6e8cc7261 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:22.684884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6c563f8-e48f-49f1-8e8f-02d6e8cc7261 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:22.685368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6c563f8-e48f-49f1-8e8f-02d6e8cc7261 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:22.685792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6c563f8-e48f-49f1-8e8f-02d6e8cc7261 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:22.686496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6c563f8-e48f-49f1-8e8f-02d6e8cc7261 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:22.686941 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6c563f8-e48f-49f1-8e8f-02d6e8cc7261 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:22.687359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6c563f8-e48f-49f1-8e8f-02d6e8cc7261 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:22.781423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-234068f2-432a-48bd-b393-969dbdb489e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:22.782022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-234068f2-432a-48bd-b393-969dbdb489e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:22.789410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-234068f2-432a-48bd-b393-969dbdb489e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:22.789892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-234068f2-432a-48bd-b393-969dbdb489e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:22.790326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-234068f2-432a-48bd-b393-969dbdb489e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:22.791020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-234068f2-432a-48bd-b393-969dbdb489e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:22.791463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-234068f2-432a-48bd-b393-969dbdb489e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:22.791879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-234068f2-432a-48bd-b393-969dbdb489e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:22.826900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f6c563f8-e48f-49f1-8e8f-02d6e8cc7261 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:22.835668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f6c563f8-e48f-49f1-8e8f-02d6e8cc7261 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1507 microversion: 2.1 time: 0.161946 Aug 24 06:20:22.836310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 268/531] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:22 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:22.857252 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2958daec-b93a-4272-8991-0625488b3a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b28f644-bc25-456f-8bf3-d6690ff62f1c", "device": "/dev/sdb"}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:22.860170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2958daec-b93a-4272-8991-0625488b3a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:22.867213 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2958daec-b93a-4272-8991-0625488b3a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:22.867778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2958daec-b93a-4272-8991-0625488b3a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:22.869298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2958daec-b93a-4272-8991-0625488b3a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:22.870235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2958daec-b93a-4272-8991-0625488b3a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:22.870761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2958daec-b93a-4272-8991-0625488b3a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:22.871182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2958daec-b93a-4272-8991-0625488b3a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:22.982878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-234068f2-432a-48bd-b393-969dbdb489e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:22.992140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-234068f2-432a-48bd-b393-969dbdb489e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.214413 Aug 24 06:20:23.005034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 264/532] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:22 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:23.005034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-c7399a55-da78-4a45-b927-84fb082d6894 req-1f4ada10-4bcd-452c-92cb-7c275c9e37ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e12ed7-0b6e-4995-a3c0-221ce6c18041", "tag": "19c5b9e4-2438-4dd5-ba21-d02e604b373c"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:23.009100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c7399a55-da78-4a45-b927-84fb082d6894 req-1f4ada10-4bcd-452c-92cb-7c275c9e37ea service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:23.009706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c7399a55-da78-4a45-b927-84fb082d6894 req-1f4ada10-4bcd-452c-92cb-7c275c9e37ea service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:23.010194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c7399a55-da78-4a45-b927-84fb082d6894 req-1f4ada10-4bcd-452c-92cb-7c275c9e37ea service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:23.022398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-c7399a55-da78-4a45-b927-84fb082d6894 req-1f4ada10-4bcd-452c-92cb-7c275c9e37ea service nova] Creating event network-changed:19c5b9e4-2438-4dd5-ba21-d02e604b373c for instance d8e12ed7-0b6e-4995-a3c0-221ce6c18041 on hv-cinder-85426 Aug 24 06:20:23.027559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-c7399a55-da78-4a45-b927-84fb082d6894 req-1f4ada10-4bcd-452c-92cb-7c275c9e37ea service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032374 Aug 24 06:20:23.028627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 265/533] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:23.033923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-baddef76-2b78-4c01-b85c-6bd8886650a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:23.034617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-baddef76-2b78-4c01-b85c-6bd8886650a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:23.041108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-baddef76-2b78-4c01-b85c-6bd8886650a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:23.041585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-baddef76-2b78-4c01-b85c-6bd8886650a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:23.042017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-baddef76-2b78-4c01-b85c-6bd8886650a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:23.042717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-baddef76-2b78-4c01-b85c-6bd8886650a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:23.043165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-baddef76-2b78-4c01-b85c-6bd8886650a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:23.043578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-baddef76-2b78-4c01-b85c-6bd8886650a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:23.253116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-baddef76-2b78-4c01-b85c-6bd8886650a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:23.261620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-baddef76-2b78-4c01-b85c-6bd8886650a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1372 microversion: 2.1 time: 0.231925 Aug 24 06:20:23.262202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 266/534] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:23 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:23.414376 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7bf3bd21-fd48-4f5b-b64a-2e850d9f4f80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:23.414867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7bf3bd21-fd48-4f5b-b64a-2e850d9f4f80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:23.420851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bf3bd21-fd48-4f5b-b64a-2e850d9f4f80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:23.421339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bf3bd21-fd48-4f5b-b64a-2e850d9f4f80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:23.421773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bf3bd21-fd48-4f5b-b64a-2e850d9f4f80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:23.422473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bf3bd21-fd48-4f5b-b64a-2e850d9f4f80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:23.422937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bf3bd21-fd48-4f5b-b64a-2e850d9f4f80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:23.423481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bf3bd21-fd48-4f5b-b64a-2e850d9f4f80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:23.448109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7bf3bd21-fd48-4f5b-b64a-2e850d9f4f80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532/ips" status: 200 len: 148 microversion: 2.1 time: 0.037519 Aug 24 06:20:23.448745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 267/535] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 24 06:20:23 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:20:23.460103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a52e4de-4601-40cd-a5de-8b6be047a0d5"}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:23.462396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:23.468406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:23.468927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:23.469361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:23.470066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:23.470520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:23.470946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:23.553303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Invalid volume: volume 5a52e4de-4601-40cd-a5de-8b6be047a0d5 is already attached to instances: 90ff1952-1000-4510-ac80-d18576f044cb Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: POST /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532/os-volume_attachments HTTP/1.1 Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 74 Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:20:23.555001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {"volumeAttachment": {"volumeId": "5a52e4de-4601-40cd-a5de-8b6be047a0d5"}} Aug 24 06:20:23.556642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Invalid volume: volume 5a52e4de-4601-40cd-a5de-8b6be047a0d5 is already attached to instances: 90ff1952-1000-4510-ac80-d18576f044cb Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'server_id': '183454a1-0335-4121-8d9f-c6599b8f2532', 'body': {'volumeAttachment': {'volumeId': '5a52e4de-4601-40cd-a5de-8b6be047a0d5'}}} Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5a52e4de-4601-40cd-a5de-8b6be047a0d5 is already attached to instances: 90ff1952-1000-4510-ac80-d18576f044cb Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:23.568116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5a52e4de-4601-40cd-a5de-8b6be047a0d5 is already attached to instances: 90ff1952-1000-4510-ac80-d18576f044cb Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:23.569575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:20:23.571049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:20:23.571049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:20:23.571049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:20:23.571049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5a52e4de-4601-40cd-a5de-8b6be047a0d5 is already attached to instances: 90ff1952-1000-4510-ac80-d18576f044cb Aug 24 06:20:23.571049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:23.571049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 400 to user: Invalid volume: volume 5a52e4de-4601-40cd-a5de-8b6be047a0d5 is already attached to instances: 90ff1952-1000-4510-ac80-d18576f044cb {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:20:23.571049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4abbd9f6-0fb4-4b81-8078-5a69c45b5e2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "POST /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100283 Aug 24 06:20:23.571049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 268/536] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 24 06:20:23 2022] POST /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 06:20:23.571668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c15fde98-f09f-4fd7-aa7b-8d8a525d6dfa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:23.571668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c15fde98-f09f-4fd7-aa7b-8d8a525d6dfa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:23.572435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c15fde98-f09f-4fd7-aa7b-8d8a525d6dfa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:23.572988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c15fde98-f09f-4fd7-aa7b-8d8a525d6dfa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:23.573429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c15fde98-f09f-4fd7-aa7b-8d8a525d6dfa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:23.574117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c15fde98-f09f-4fd7-aa7b-8d8a525d6dfa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:23.574566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c15fde98-f09f-4fd7-aa7b-8d8a525d6dfa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:23.574983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c15fde98-f09f-4fd7-aa7b-8d8a525d6dfa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:23.601063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c15fde98-f09f-4fd7-aa7b-8d8a525d6dfa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:20:23.615813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:23.654245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2958daec-b93a-4272-8991-0625488b3a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "POST /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800913 Aug 24 06:20:23.654882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 269/537] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 24 06:20:22 2022] POST /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7/os-volume_attachments => generated 194 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:20:23.860145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c15fde98-f09f-4fd7-aa7b-8d8a525d6dfa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 204 len: 0 microversion: 2.1 time: 0.298161 Aug 24 06:20:23.860742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 269/538] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:20:23 2022] DELETE /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:20:23.870088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ee753f31-8762-4999-a4b8-c3871ba16395 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:23.870779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ee753f31-8762-4999-a4b8-c3871ba16395 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:23.877121 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee753f31-8762-4999-a4b8-c3871ba16395 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:23.877599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee753f31-8762-4999-a4b8-c3871ba16395 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:23.878023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee753f31-8762-4999-a4b8-c3871ba16395 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:23.878715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee753f31-8762-4999-a4b8-c3871ba16395 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:23.879161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee753f31-8762-4999-a4b8-c3871ba16395 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:23.879607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee753f31-8762-4999-a4b8-c3871ba16395 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:24.009579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ee753f31-8762-4999-a4b8-c3871ba16395 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:24.015467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f7519e51-9f15-4e57-b670-d7702e1b8692 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:24.016159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f7519e51-9f15-4e57-b670-d7702e1b8692 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:24.017492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ee753f31-8762-4999-a4b8-c3871ba16395 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1681 microversion: 2.1 time: 0.151507 Aug 24 06:20:24.018073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 270/539] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:23 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:24.022900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f7519e51-9f15-4e57-b670-d7702e1b8692 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:24.023379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f7519e51-9f15-4e57-b670-d7702e1b8692 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:24.023807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f7519e51-9f15-4e57-b670-d7702e1b8692 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:24.024516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f7519e51-9f15-4e57-b670-d7702e1b8692 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:24.024961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f7519e51-9f15-4e57-b670-d7702e1b8692 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:24.025378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f7519e51-9f15-4e57-b670-d7702e1b8692 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:24.158107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f7519e51-9f15-4e57-b670-d7702e1b8692 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:24.166542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f7519e51-9f15-4e57-b670-d7702e1b8692 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.155416 Aug 24 06:20:24.167101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 270/540] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:24 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:24.282406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d713b2bb-2f26-4d37-8a6e-a51582eae733 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:24.283003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d713b2bb-2f26-4d37-8a6e-a51582eae733 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:24.289986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d713b2bb-2f26-4d37-8a6e-a51582eae733 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:24.290514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d713b2bb-2f26-4d37-8a6e-a51582eae733 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:24.290935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d713b2bb-2f26-4d37-8a6e-a51582eae733 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:24.291613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d713b2bb-2f26-4d37-8a6e-a51582eae733 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:24.292058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d713b2bb-2f26-4d37-8a6e-a51582eae733 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:24.292471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d713b2bb-2f26-4d37-8a6e-a51582eae733 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:24.420989 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d713b2bb-2f26-4d37-8a6e-a51582eae733 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:24.428921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d713b2bb-2f26-4d37-8a6e-a51582eae733 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1372 microversion: 2.1 time: 0.150407 Aug 24 06:20:24.429487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 271/541] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:24 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:25.039303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a14c6250-d22f-434b-af7b-937f861142e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:25.039890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a14c6250-d22f-434b-af7b-937f861142e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:25.046591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a14c6250-d22f-434b-af7b-937f861142e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:25.047276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a14c6250-d22f-434b-af7b-937f861142e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:25.047671 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a14c6250-d22f-434b-af7b-937f861142e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:25.048366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a14c6250-d22f-434b-af7b-937f861142e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:25.048845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a14c6250-d22f-434b-af7b-937f861142e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:25.049261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a14c6250-d22f-434b-af7b-937f861142e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:25.183328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a14c6250-d22f-434b-af7b-937f861142e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:25.188174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-42205a07-aa77-4ef8-ae60-317bb2aa712f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:25.191653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-42205a07-aa77-4ef8-ae60-317bb2aa712f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:25.191779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a14c6250-d22f-434b-af7b-937f861142e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1681 microversion: 2.1 time: 0.156031 Aug 24 06:20:25.191779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 271/542] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:25 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:25.195097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42205a07-aa77-4ef8-ae60-317bb2aa712f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:25.195575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42205a07-aa77-4ef8-ae60-317bb2aa712f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:25.196052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42205a07-aa77-4ef8-ae60-317bb2aa712f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:25.196781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42205a07-aa77-4ef8-ae60-317bb2aa712f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:25.197231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42205a07-aa77-4ef8-ae60-317bb2aa712f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:25.197647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42205a07-aa77-4ef8-ae60-317bb2aa712f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:25.326707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-42205a07-aa77-4ef8-ae60-317bb2aa712f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:25.334389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-42205a07-aa77-4ef8-ae60-317bb2aa712f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.150087 Aug 24 06:20:25.334962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 272/543] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:25 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:25.449474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4f255c71-2368-4990-8514-f0f03771d629 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:25.450083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4f255c71-2368-4990-8514-f0f03771d629 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:25.456097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f255c71-2368-4990-8514-f0f03771d629 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:25.456623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f255c71-2368-4990-8514-f0f03771d629 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:25.457059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f255c71-2368-4990-8514-f0f03771d629 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:25.457747 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f255c71-2368-4990-8514-f0f03771d629 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:25.458216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f255c71-2368-4990-8514-f0f03771d629 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:25.458640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f255c71-2368-4990-8514-f0f03771d629 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:25.584943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4f255c71-2368-4990-8514-f0f03771d629 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:25.592575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4f255c71-2368-4990-8514-f0f03771d629 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1372 microversion: 2.1 time: 0.146985 Aug 24 06:20:25.593140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 272/544] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:25 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:26.212593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3edb36ba-703f-4c62-8032-32ec6b26b38e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:26.213208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3edb36ba-703f-4c62-8032-32ec6b26b38e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:26.219833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edb36ba-703f-4c62-8032-32ec6b26b38e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:26.220327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edb36ba-703f-4c62-8032-32ec6b26b38e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:26.220790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edb36ba-703f-4c62-8032-32ec6b26b38e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:26.221503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edb36ba-703f-4c62-8032-32ec6b26b38e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:26.221958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edb36ba-703f-4c62-8032-32ec6b26b38e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:26.222379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edb36ba-703f-4c62-8032-32ec6b26b38e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:26.352802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3edb36ba-703f-4c62-8032-32ec6b26b38e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:26.354969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ce3208ca-e353-43b8-91e4-0cd525c6038f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:26.355657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ce3208ca-e353-43b8-91e4-0cd525c6038f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:26.360768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3edb36ba-703f-4c62-8032-32ec6b26b38e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1681 microversion: 2.1 time: 0.151958 Aug 24 06:20:26.361369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 273/545] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:26 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:26.362317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce3208ca-e353-43b8-91e4-0cd525c6038f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:26.362809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce3208ca-e353-43b8-91e4-0cd525c6038f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:26.363240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce3208ca-e353-43b8-91e4-0cd525c6038f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:26.364447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce3208ca-e353-43b8-91e4-0cd525c6038f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:26.364921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce3208ca-e353-43b8-91e4-0cd525c6038f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:26.365336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce3208ca-e353-43b8-91e4-0cd525c6038f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:26.555399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ce3208ca-e353-43b8-91e4-0cd525c6038f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:26.563753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ce3208ca-e353-43b8-91e4-0cd525c6038f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.212499 Aug 24 06:20:26.564336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 273/546] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:26 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:26.613637 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8a0660c6-18a5-4eea-a90e-9eddb9175787 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:26.615283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8a0660c6-18a5-4eea-a90e-9eddb9175787 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:26.621835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0660c6-18a5-4eea-a90e-9eddb9175787 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:26.622407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0660c6-18a5-4eea-a90e-9eddb9175787 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:26.623036 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0660c6-18a5-4eea-a90e-9eddb9175787 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:26.623906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0660c6-18a5-4eea-a90e-9eddb9175787 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:26.624429 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0660c6-18a5-4eea-a90e-9eddb9175787 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:26.625237 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a0660c6-18a5-4eea-a90e-9eddb9175787 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:26.776270 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8a0660c6-18a5-4eea-a90e-9eddb9175787 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:26.777009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8a0660c6-18a5-4eea-a90e-9eddb9175787 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1372 microversion: 2.1 time: 0.167481 Aug 24 06:20:26.777606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 274/547] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:26 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:27.382890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ada822f7-1e74-4126-8a51-87357fbd0044 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:27.383535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ada822f7-1e74-4126-8a51-87357fbd0044 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:27.386064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:27.390723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ada822f7-1e74-4126-8a51-87357fbd0044 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:27.391206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ada822f7-1e74-4126-8a51-87357fbd0044 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:27.391716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ada822f7-1e74-4126-8a51-87357fbd0044 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:27.392423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ada822f7-1e74-4126-8a51-87357fbd0044 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:27.392900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ada822f7-1e74-4126-8a51-87357fbd0044 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:27.393322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ada822f7-1e74-4126-8a51-87357fbd0044 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:27.470052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-340863ef-38f2-4100-86df-92ce6cf0b856 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-997578580"}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:27.470744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-340863ef-38f2-4100-86df-92ce6cf0b856 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:27.477799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-340863ef-38f2-4100-86df-92ce6cf0b856 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:27.478286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-340863ef-38f2-4100-86df-92ce6cf0b856 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:27.478709 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-340863ef-38f2-4100-86df-92ce6cf0b856 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:27.479405 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-340863ef-38f2-4100-86df-92ce6cf0b856 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:27.479848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-340863ef-38f2-4100-86df-92ce6cf0b856 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:27.480262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-340863ef-38f2-4100-86df-92ce6cf0b856 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:27.615468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.network.security_group_api [None req-340863ef-38f2-4100-86df-92ce6cf0b856 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Removing security group cd508345-8094-4d58-b6aa-919baa797c88 from port 284c413d-f37f-41e3-a049-9aeaaa40a0c8 Aug 24 06:20:27.858363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ada822f7-1e74-4126-8a51-87357fbd0044 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:27.867205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ada822f7-1e74-4126-8a51-87357fbd0044 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1681 microversion: 2.1 time: 0.488517 Aug 24 06:20:27.867713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 274/548] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:27 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1681 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:27.872872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-efadf79f-3de3-4419-bb7f-176cfae7e579 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:27.873561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-efadf79f-3de3-4419-bb7f-176cfae7e579 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:27.880233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efadf79f-3de3-4419-bb7f-176cfae7e579 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:27.880827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efadf79f-3de3-4419-bb7f-176cfae7e579 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:27.881973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efadf79f-3de3-4419-bb7f-176cfae7e579 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:27.882899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efadf79f-3de3-4419-bb7f-176cfae7e579 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:27.883364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efadf79f-3de3-4419-bb7f-176cfae7e579 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:27.883788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efadf79f-3de3-4419-bb7f-176cfae7e579 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:28.028663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-340863ef-38f2-4100-86df-92ce6cf0b856 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "POST /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/action" status: 202 len: 0 microversion: 2.1 time: 0.562554 Aug 24 06:20:28.032575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 275/549] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 24 06:20:27 2022] POST /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:20:28.037889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a7612f34-0dad-4223-b9ee-675538d66f7b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:28.038552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a7612f34-0dad-4223-b9ee-675538d66f7b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:28.044961 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7612f34-0dad-4223-b9ee-675538d66f7b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:28.045782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7612f34-0dad-4223-b9ee-675538d66f7b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:28.046280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7612f34-0dad-4223-b9ee-675538d66f7b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:28.047080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7612f34-0dad-4223-b9ee-675538d66f7b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:28.047652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7612f34-0dad-4223-b9ee-675538d66f7b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:28.048076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7612f34-0dad-4223-b9ee-675538d66f7b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:28.113697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-efadf79f-3de3-4419-bb7f-176cfae7e579 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:28.123228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-efadf79f-3de3-4419-bb7f-176cfae7e579 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.253962 Aug 24 06:20:28.124071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 275/550] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:27 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:28.129060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-83234507-cbc2-4aa6-9268-bcd0b5c52243 req-f0ed7359-91df-4f4b-8c25-aaf21a8313fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967afe19-8139-4888-ae38-b682c1188c8f", "tag": "284c413d-f37f-41e3-a049-9aeaaa40a0c8"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:28.152126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-83234507-cbc2-4aa6-9268-bcd0b5c52243 req-f0ed7359-91df-4f4b-8c25-aaf21a8313fb service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:28.152760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-83234507-cbc2-4aa6-9268-bcd0b5c52243 req-f0ed7359-91df-4f4b-8c25-aaf21a8313fb service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:28.153261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-83234507-cbc2-4aa6-9268-bcd0b5c52243 req-f0ed7359-91df-4f4b-8c25-aaf21a8313fb service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:28.155345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:28.167017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-83234507-cbc2-4aa6-9268-bcd0b5c52243 req-f0ed7359-91df-4f4b-8c25-aaf21a8313fb service nova] Creating event network-changed:284c413d-f37f-41e3-a049-9aeaaa40a0c8 for instance 967afe19-8139-4888-ae38-b682c1188c8f on hv-cinder-85426 Aug 24 06:20:28.172852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-83234507-cbc2-4aa6-9268-bcd0b5c52243 req-f0ed7359-91df-4f4b-8c25-aaf21a8313fb service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047200 Aug 24 06:20:28.174988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 276/551] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:28.176120 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=6 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:28.279922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a7612f34-0dad-4223-b9ee-675538d66f7b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:28.296253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a7612f34-0dad-4223-b9ee-675538d66f7b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1372 microversion: 2.1 time: 0.260959 Aug 24 06:20:28.300097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 276/552] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:28 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:28.578256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-0fa8ff68-3f3a-4601-b86a-bd01a8e1d1ab req-0d09b0b2-5f2d-46f7-8ca2-ae65ce1e6cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "183454a1-0335-4121-8d9f-c6599b8f2532", "name": "network-vif-deleted", "tag": "8f28ca28-dd97-4a09-8e4f-a05e462a5fa6"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:28.587109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=8 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:28.592889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-0fa8ff68-3f3a-4601-b86a-bd01a8e1d1ab req-0d09b0b2-5f2d-46f7-8ca2-ae65ce1e6cf3 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:28.593737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-0fa8ff68-3f3a-4601-b86a-bd01a8e1d1ab req-0d09b0b2-5f2d-46f7-8ca2-ae65ce1e6cf3 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:28.594236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-0fa8ff68-3f3a-4601-b86a-bd01a8e1d1ab req-0d09b0b2-5f2d-46f7-8ca2-ae65ce1e6cf3 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:28.608449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-0fa8ff68-3f3a-4601-b86a-bd01a8e1d1ab req-0d09b0b2-5f2d-46f7-8ca2-ae65ce1e6cf3 service nova] Creating event network-vif-deleted:8f28ca28-dd97-4a09-8e4f-a05e462a5fa6 for instance 183454a1-0335-4121-8d9f-c6599b8f2532 on hv-cinder-85426 Aug 24 06:20:28.613558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-0fa8ff68-3f3a-4601-b86a-bd01a8e1d1ab req-0d09b0b2-5f2d-46f7-8ca2-ae65ce1e6cf3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039490 Aug 24 06:20:28.615963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 277/553] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:28.895476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:28.900010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:28.915820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:28.916885 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:28.917428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:28.918404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:28.918968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:28.919628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:28.962855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:28.964185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:28.964649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:28.971445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lazy-loading 'fault' on Instance uuid 183454a1-0335-4121-8d9f-c6599b8f2532 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:20:29.089179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:29.102655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-88cb2227-3bba-4e68-8abf-527514d47f2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 200 len: 1332 microversion: 2.1 time: 0.216454 Aug 24 06:20:29.118720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 277/554] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:28 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 1332 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:29.154752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4dc1d192-f699-4f53-8f58-46ae92843c1e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:29.155898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4dc1d192-f699-4f53-8f58-46ae92843c1e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:29.162865 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc1d192-f699-4f53-8f58-46ae92843c1e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:29.163664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc1d192-f699-4f53-8f58-46ae92843c1e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:29.164407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc1d192-f699-4f53-8f58-46ae92843c1e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:29.165381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc1d192-f699-4f53-8f58-46ae92843c1e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:29.166182 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc1d192-f699-4f53-8f58-46ae92843c1e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:29.166811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc1d192-f699-4f53-8f58-46ae92843c1e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:29.322325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8c2363f7-77a3-403e-a26f-229b8899fb2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:29.324867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8c2363f7-77a3-403e-a26f-229b8899fb2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:29.335784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4dc1d192-f699-4f53-8f58-46ae92843c1e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:29.340881 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c2363f7-77a3-403e-a26f-229b8899fb2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:29.344841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4dc1d192-f699-4f53-8f58-46ae92843c1e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.194053 Aug 24 06:20:29.355912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c2363f7-77a3-403e-a26f-229b8899fb2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:29.355912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c2363f7-77a3-403e-a26f-229b8899fb2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:29.355912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c2363f7-77a3-403e-a26f-229b8899fb2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:29.355912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c2363f7-77a3-403e-a26f-229b8899fb2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:29.356369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c2363f7-77a3-403e-a26f-229b8899fb2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:29.356456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 278/555] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:29 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:29.665167 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8c2363f7-77a3-403e-a26f-229b8899fb2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:29.669694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8c2363f7-77a3-403e-a26f-229b8899fb2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1372 microversion: 2.1 time: 0.351250 Aug 24 06:20:29.680917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 278/556] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:29 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:30.127167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:30.134901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:30.142780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.146877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.146877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.146877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.146877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.147490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.168091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-767a0d25-f6af-435d-b448-b0acb9c546d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:30.169890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-767a0d25-f6af-435d-b448-b0acb9c546d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:30.177256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-767a0d25-f6af-435d-b448-b0acb9c546d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.177763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-767a0d25-f6af-435d-b448-b0acb9c546d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.178177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-767a0d25-f6af-435d-b448-b0acb9c546d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.178877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-767a0d25-f6af-435d-b448-b0acb9c546d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.179329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-767a0d25-f6af-435d-b448-b0acb9c546d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.179744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-767a0d25-f6af-435d-b448-b0acb9c546d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.185099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 HTTP/1.1 Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:20:30.188860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:20:30.190487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '183454a1-0335-4121-8d9f-c6599b8f2532'} Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:20:30.191389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:20:30.192971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:20:30.194270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 404 to user: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:20:30.195288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7f55017a-6b78-4db9-b453-691a3b5df7ba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 404 len: 111 microversion: 2.1 time: 0.070581 Aug 24 06:20:30.195861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 279/557] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:30 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:20:30.203725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-5f97d5e9-009c-4d0e-8101-9c27b5c840d9 req-004cd399-3f18-4765-969d-b372c5991ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e12ed7-0b6e-4995-a3c0-221ce6c18041", "name": "network-vif-plugged", "status": "completed", "tag": "19c5b9e4-2438-4dd5-ba21-d02e604b373c"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:30.214481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-5f97d5e9-009c-4d0e-8101-9c27b5c840d9 req-004cd399-3f18-4765-969d-b372c5991ef7 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.214953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-5f97d5e9-009c-4d0e-8101-9c27b5c840d9 req-004cd399-3f18-4765-969d-b372c5991ef7 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.215743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-5f97d5e9-009c-4d0e-8101-9c27b5c840d9 req-004cd399-3f18-4765-969d-b372c5991ef7 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.229006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-5f97d5e9-009c-4d0e-8101-9c27b5c840d9 req-004cd399-3f18-4765-969d-b372c5991ef7 service nova] Creating event network-vif-plugged:19c5b9e4-2438-4dd5-ba21-d02e604b373c for instance d8e12ed7-0b6e-4995-a3c0-221ce6c18041 on hv-cinder-85426 Aug 24 06:20:30.235049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-5f97d5e9-009c-4d0e-8101-9c27b5c840d9 req-004cd399-3f18-4765-969d-b372c5991ef7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036732 Aug 24 06:20:30.235804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 280/558] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:30.241649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-af3571b1-3603-4595-a6b4-6dd81ce54d89 req-e8dc812d-a10e-433d-83a0-8b0b0a71b60e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967afe19-8139-4888-ae38-b682c1188c8f", "tag": "284c413d-f37f-41e3-a049-9aeaaa40a0c8"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:30.251552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-af3571b1-3603-4595-a6b4-6dd81ce54d89 req-e8dc812d-a10e-433d-83a0-8b0b0a71b60e service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.252113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-af3571b1-3603-4595-a6b4-6dd81ce54d89 req-e8dc812d-a10e-433d-83a0-8b0b0a71b60e service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.252652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-af3571b1-3603-4595-a6b4-6dd81ce54d89 req-e8dc812d-a10e-433d-83a0-8b0b0a71b60e service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.271029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-af3571b1-3603-4595-a6b4-6dd81ce54d89 req-e8dc812d-a10e-433d-83a0-8b0b0a71b60e service nova] Creating event network-changed:284c413d-f37f-41e3-a049-9aeaaa40a0c8 for instance 967afe19-8139-4888-ae38-b682c1188c8f on hv-cinder-85426 Aug 24 06:20:30.287420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-af3571b1-3603-4595-a6b4-6dd81ce54d89 req-e8dc812d-a10e-433d-83a0-8b0b0a71b60e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050202 Aug 24 06:20:30.289371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 281/559] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:30.294222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-767a0d25-f6af-435d-b448-b0acb9c546d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lazy-loading 'services' on Instance uuid 967afe19-8139-4888-ae38-b682c1188c8f {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:20:30.295989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-06978b6a-221a-4643-8186-f054a8c2641b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '.version_select at 0x7fcddc1164c0>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:30.423084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-06978b6a-221a-4643-8186-f054a8c2641b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291965879" status: 202 len: 0 microversion: 2.1 time: 0.132242 Aug 24 06:20:30.423787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 282/560] 10.222.0.62 () {58 vars in 1221 bytes} [Wed Aug 24 06:20:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291965879 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:20:30.433138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-669b6908-f90a-4387-ba80-63d73c43a71f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:30.434152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-669b6908-f90a-4387-ba80-63d73c43a71f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:30.450266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-669b6908-f90a-4387-ba80-63d73c43a71f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.450572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-669b6908-f90a-4387-ba80-63d73c43a71f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.451017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-669b6908-f90a-4387-ba80-63d73c43a71f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.451763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-669b6908-f90a-4387-ba80-63d73c43a71f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.452217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-669b6908-f90a-4387-ba80-63d73c43a71f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.458970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-669b6908-f90a-4387-ba80-63d73c43a71f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.541822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-767a0d25-f6af-435d-b448-b0acb9c546d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "DELETE /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments/37d02100-2d5b-47c5-bcf9-8a8858aac1be" status: 202 len: 0 microversion: 2.1 time: 0.368105 Aug 24 06:20:30.543211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 279/561] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 24 06:20:30 2022] DELETE /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments/37d02100-2d5b-47c5-bcf9-8a8858aac1be => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:20:30.555669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d444316f-2d9c-4c36-af3c-e02ca0a03ea8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:30.565110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d444316f-2d9c-4c36-af3c-e02ca0a03ea8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:30.579832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d444316f-2d9c-4c36-af3c-e02ca0a03ea8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.580316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d444316f-2d9c-4c36-af3c-e02ca0a03ea8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.580781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d444316f-2d9c-4c36-af3c-e02ca0a03ea8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.581502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d444316f-2d9c-4c36-af3c-e02ca0a03ea8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.581947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d444316f-2d9c-4c36-af3c-e02ca0a03ea8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.582361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d444316f-2d9c-4c36-af3c-e02ca0a03ea8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.642580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d444316f-2d9c-4c36-af3c-e02ca0a03ea8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095094 Aug 24 06:20:30.650898 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 280/562] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:30 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:30.691492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-875f2e93-0d9d-4f23-b829-46f2738bdca0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:30.693166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-875f2e93-0d9d-4f23-b829-46f2738bdca0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:30.711971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-875f2e93-0d9d-4f23-b829-46f2738bdca0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.712690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-875f2e93-0d9d-4f23-b829-46f2738bdca0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.713282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-875f2e93-0d9d-4f23-b829-46f2738bdca0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.714624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-875f2e93-0d9d-4f23-b829-46f2738bdca0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:30.715272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-875f2e93-0d9d-4f23-b829-46f2738bdca0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:30.716930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-875f2e93-0d9d-4f23-b829-46f2738bdca0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:30.744022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:30.877639 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-669b6908-f90a-4387-ba80-63d73c43a71f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:30.889438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-669b6908-f90a-4387-ba80-63d73c43a71f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.460207 Aug 24 06:20:30.907394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 283/563] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:30 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:30.980925 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-875f2e93-0d9d-4f23-b829-46f2738bdca0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:30.989895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-875f2e93-0d9d-4f23-b829-46f2738bdca0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1372 microversion: 2.1 time: 0.303537 Aug 24 06:20:30.990774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 281/564] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:30 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1372 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:31.656954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6b89483f-4212-42e1-b355-ba5655cff3c9 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:31.659338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6b89483f-4212-42e1-b355-ba5655cff3c9 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:31.666928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b89483f-4212-42e1-b355-ba5655cff3c9 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:31.667339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b89483f-4212-42e1-b355-ba5655cff3c9 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:31.667818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b89483f-4212-42e1-b355-ba5655cff3c9 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:31.668667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b89483f-4212-42e1-b355-ba5655cff3c9 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:31.669198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b89483f-4212-42e1-b355-ba5655cff3c9 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:31.669680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b89483f-4212-42e1-b355-ba5655cff3c9 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:31.705783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6b89483f-4212-42e1-b355-ba5655cff3c9 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052769 Aug 24 06:20:31.710801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 284/565] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:31 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:31.719341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2fa85a44-4ec3-4b3d-bd3a-3be34c2d3de5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:31.719828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2fa85a44-4ec3-4b3d-bd3a-3be34c2d3de5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:31.727335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fa85a44-4ec3-4b3d-bd3a-3be34c2d3de5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:31.727871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fa85a44-4ec3-4b3d-bd3a-3be34c2d3de5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:31.728537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fa85a44-4ec3-4b3d-bd3a-3be34c2d3de5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:31.729033 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fa85a44-4ec3-4b3d-bd3a-3be34c2d3de5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:31.729530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fa85a44-4ec3-4b3d-bd3a-3be34c2d3de5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:31.729984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fa85a44-4ec3-4b3d-bd3a-3be34c2d3de5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:31.814551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-2fa85a44-4ec3-4b3d-bd3a-3be34c2d3de5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lazy-loading 'services' on Instance uuid 90ff1952-1000-4510-ac80-d18576f044cb {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:20:31.915525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e01a69c0-5f43-45fa-9be1-9567eec80d94 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:31.916220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e01a69c0-5f43-45fa-9be1-9567eec80d94 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:31.922367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e01a69c0-5f43-45fa-9be1-9567eec80d94 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:31.922795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e01a69c0-5f43-45fa-9be1-9567eec80d94 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:31.923234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e01a69c0-5f43-45fa-9be1-9567eec80d94 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:31.923923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e01a69c0-5f43-45fa-9be1-9567eec80d94 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:31.924374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e01a69c0-5f43-45fa-9be1-9567eec80d94 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:31.924827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e01a69c0-5f43-45fa-9be1-9567eec80d94 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:32.043589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2fa85a44-4ec3-4b3d-bd3a-3be34c2d3de5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments/5a52e4de-4601-40cd-a5de-8b6be047a0d5" status: 202 len: 0 microversion: 2.1 time: 0.327982 Aug 24 06:20:32.044300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 282/566] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 24 06:20:31 2022] DELETE /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments/5a52e4de-4601-40cd-a5de-8b6be047a0d5 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:20:32.049817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-def1ee88-bb46-4e54-9548-a4366bc22e16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:32.050664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-def1ee88-bb46-4e54-9548-a4366bc22e16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:32.062570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e01a69c0-5f43-45fa-9be1-9567eec80d94 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:32.067692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def1ee88-bb46-4e54-9548-a4366bc22e16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:32.068211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def1ee88-bb46-4e54-9548-a4366bc22e16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:32.068655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def1ee88-bb46-4e54-9548-a4366bc22e16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:32.069349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def1ee88-bb46-4e54-9548-a4366bc22e16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:32.069796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def1ee88-bb46-4e54-9548-a4366bc22e16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:32.070211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def1ee88-bb46-4e54-9548-a4366bc22e16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:32.070956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e01a69c0-5f43-45fa-9be1-9567eec80d94 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.160157 Aug 24 06:20:32.071524 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 285/567] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:31 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:20:32.076202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-00a3af7f-cac2-42f3-b91c-7887337fec2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:32.078302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-00a3af7f-cac2-42f3-b91c-7887337fec2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:32.084719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00a3af7f-cac2-42f3-b91c-7887337fec2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:32.085760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00a3af7f-cac2-42f3-b91c-7887337fec2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:32.085760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00a3af7f-cac2-42f3-b91c-7887337fec2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:32.095265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00a3af7f-cac2-42f3-b91c-7887337fec2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:32.095265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00a3af7f-cac2-42f3-b91c-7887337fec2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:32.095265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00a3af7f-cac2-42f3-b91c-7887337fec2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:32.118491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-00a3af7f-cac2-42f3-b91c-7887337fec2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045831 Aug 24 06:20:32.119172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 286/568] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:32.210668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-def1ee88-bb46-4e54-9548-a4366bc22e16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:32.218264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-def1ee88-bb46-4e54-9548-a4366bc22e16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1372 microversion: 2.1 time: 0.172713 Aug 24 06:20:32.218831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 283/569] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:32 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:32.719140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e3078094-a41f-492b-ae7c-dbc2c7480057 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:32.721366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e3078094-a41f-492b-ae7c-dbc2c7480057 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:32.728552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3078094-a41f-492b-ae7c-dbc2c7480057 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:32.729049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3078094-a41f-492b-ae7c-dbc2c7480057 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:32.729480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3078094-a41f-492b-ae7c-dbc2c7480057 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:32.730178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3078094-a41f-492b-ae7c-dbc2c7480057 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:32.730626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3078094-a41f-492b-ae7c-dbc2c7480057 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:32.731044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3078094-a41f-492b-ae7c-dbc2c7480057 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:32.760729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e3078094-a41f-492b-ae7c-dbc2c7480057 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047255 Aug 24 06:20:32.761291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 287/570] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:32 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:33.092921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3e98c66c-1f6e-4f80-a32a-8b86b37aef6e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:33.093589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3e98c66c-1f6e-4f80-a32a-8b86b37aef6e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:33.100683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e98c66c-1f6e-4f80-a32a-8b86b37aef6e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:33.101161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e98c66c-1f6e-4f80-a32a-8b86b37aef6e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:33.101593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e98c66c-1f6e-4f80-a32a-8b86b37aef6e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:33.102274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e98c66c-1f6e-4f80-a32a-8b86b37aef6e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:33.102716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e98c66c-1f6e-4f80-a32a-8b86b37aef6e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:33.103125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e98c66c-1f6e-4f80-a32a-8b86b37aef6e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:33.130672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2b7edf0b-23f7-4ab7-85d4-a8d9fd99afff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:33.132797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2b7edf0b-23f7-4ab7-85d4-a8d9fd99afff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:33.139046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7edf0b-23f7-4ab7-85d4-a8d9fd99afff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:33.139557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7edf0b-23f7-4ab7-85d4-a8d9fd99afff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:33.139985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7edf0b-23f7-4ab7-85d4-a8d9fd99afff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:33.140971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7edf0b-23f7-4ab7-85d4-a8d9fd99afff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:33.146025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7edf0b-23f7-4ab7-85d4-a8d9fd99afff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:33.146025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7edf0b-23f7-4ab7-85d4-a8d9fd99afff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:33.173886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2b7edf0b-23f7-4ab7-85d4-a8d9fd99afff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047292 Aug 24 06:20:33.174687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 288/571] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:20:33.234346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3e98c66c-1f6e-4f80-a32a-8b86b37aef6e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:33.239564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7a0003bc-f55d-4df8-99a1-749af4ac07f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:33.240254 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7a0003bc-f55d-4df8-99a1-749af4ac07f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:33.242301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3e98c66c-1f6e-4f80-a32a-8b86b37aef6e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.153192 Aug 24 06:20:33.242876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 284/572] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:33 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:33.246444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0003bc-f55d-4df8-99a1-749af4ac07f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:33.246921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0003bc-f55d-4df8-99a1-749af4ac07f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:33.249325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0003bc-f55d-4df8-99a1-749af4ac07f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:33.249325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0003bc-f55d-4df8-99a1-749af4ac07f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:33.249325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0003bc-f55d-4df8-99a1-749af4ac07f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:33.249325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a0003bc-f55d-4df8-99a1-749af4ac07f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:33.268804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:33.384351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7a0003bc-f55d-4df8-99a1-749af4ac07f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:33.391992 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7a0003bc-f55d-4df8-99a1-749af4ac07f0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1567 microversion: 2.1 time: 0.156230 Aug 24 06:20:33.392579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 289/573] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:33 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:33.412821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f91fa885-b42c-4712-a0b2-8232253a2063 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:33.413315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f91fa885-b42c-4712-a0b2-8232253a2063 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:33.419364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f91fa885-b42c-4712-a0b2-8232253a2063 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:33.419842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f91fa885-b42c-4712-a0b2-8232253a2063 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:33.420274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f91fa885-b42c-4712-a0b2-8232253a2063 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:33.421022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f91fa885-b42c-4712-a0b2-8232253a2063 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:33.421478 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f91fa885-b42c-4712-a0b2-8232253a2063 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:33.421897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f91fa885-b42c-4712-a0b2-8232253a2063 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:33.497201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f91fa885-b42c-4712-a0b2-8232253a2063 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088239 Aug 24 06:20:33.497791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 285/574] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 24 06:20:33 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:33.773248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bbb246fc-bc4f-4c93-beef-c0d46eb18400 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:33.775396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bbb246fc-bc4f-4c93-beef-c0d46eb18400 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:33.782007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bbb246fc-bc4f-4c93-beef-c0d46eb18400 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:33.782483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bbb246fc-bc4f-4c93-beef-c0d46eb18400 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:33.782912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bbb246fc-bc4f-4c93-beef-c0d46eb18400 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:33.783598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bbb246fc-bc4f-4c93-beef-c0d46eb18400 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:33.784037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bbb246fc-bc4f-4c93-beef-c0d46eb18400 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:33.784446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bbb246fc-bc4f-4c93-beef-c0d46eb18400 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:33.815537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bbb246fc-bc4f-4c93-beef-c0d46eb18400 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046334 Aug 24 06:20:33.816119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 290/575] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:33 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:34.187617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-be0e6f69-3d6a-475d-9d0e-bca8634bb7cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:34.189849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-be0e6f69-3d6a-475d-9d0e-bca8634bb7cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:34.196588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be0e6f69-3d6a-475d-9d0e-bca8634bb7cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:34.197262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be0e6f69-3d6a-475d-9d0e-bca8634bb7cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:34.197698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be0e6f69-3d6a-475d-9d0e-bca8634bb7cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:34.200661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be0e6f69-3d6a-475d-9d0e-bca8634bb7cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:34.200661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be0e6f69-3d6a-475d-9d0e-bca8634bb7cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:34.200661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be0e6f69-3d6a-475d-9d0e-bca8634bb7cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:34.229515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-be0e6f69-3d6a-475d-9d0e-bca8634bb7cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046562 Aug 24 06:20:34.229998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 286/576] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:34 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:34.263204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-053e43a1-572b-4829-8682-648463bf9b1b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:34.264009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-053e43a1-572b-4829-8682-648463bf9b1b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:34.270561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-053e43a1-572b-4829-8682-648463bf9b1b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:34.271042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-053e43a1-572b-4829-8682-648463bf9b1b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:34.271474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-053e43a1-572b-4829-8682-648463bf9b1b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:34.272170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-053e43a1-572b-4829-8682-648463bf9b1b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:34.272649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-053e43a1-572b-4829-8682-648463bf9b1b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:34.273071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-053e43a1-572b-4829-8682-648463bf9b1b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:34.412901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-053e43a1-572b-4829-8682-648463bf9b1b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:34.421037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-053e43a1-572b-4829-8682-648463bf9b1b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.161586 Aug 24 06:20:34.421619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 291/577] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:34 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:34.542360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-02c855bb-a0d4-48d2-bbe2-e2d50a85e210 req-6fadaf7f-19b1-4943-99b7-d75223dbcb5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e12ed7-0b6e-4995-a3c0-221ce6c18041", "tag": "19c5b9e4-2438-4dd5-ba21-d02e604b373c"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:34.556479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-02c855bb-a0d4-48d2-bbe2-e2d50a85e210 req-6fadaf7f-19b1-4943-99b7-d75223dbcb5e service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:34.556978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-02c855bb-a0d4-48d2-bbe2-e2d50a85e210 req-6fadaf7f-19b1-4943-99b7-d75223dbcb5e service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:34.557430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-02c855bb-a0d4-48d2-bbe2-e2d50a85e210 req-6fadaf7f-19b1-4943-99b7-d75223dbcb5e service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:34.570355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-02c855bb-a0d4-48d2-bbe2-e2d50a85e210 req-6fadaf7f-19b1-4943-99b7-d75223dbcb5e service nova] Creating event network-changed:19c5b9e4-2438-4dd5-ba21-d02e604b373c for instance d8e12ed7-0b6e-4995-a3c0-221ce6c18041 on hv-cinder-85426 Aug 24 06:20:34.576952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-02c855bb-a0d4-48d2-bbe2-e2d50a85e210 req-6fadaf7f-19b1-4943-99b7-d75223dbcb5e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037560 Aug 24 06:20:34.577850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 287/578] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:34.828201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-021ae04f-2983-49fd-825c-1bec7a9a95d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:34.830386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-021ae04f-2983-49fd-825c-1bec7a9a95d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:34.837405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-021ae04f-2983-49fd-825c-1bec7a9a95d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:34.838051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-021ae04f-2983-49fd-825c-1bec7a9a95d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:34.838496 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-021ae04f-2983-49fd-825c-1bec7a9a95d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:34.839194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-021ae04f-2983-49fd-825c-1bec7a9a95d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:34.839642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-021ae04f-2983-49fd-825c-1bec7a9a95d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:34.840062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-021ae04f-2983-49fd-825c-1bec7a9a95d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:34.870238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-021ae04f-2983-49fd-825c-1bec7a9a95d0 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046046 Aug 24 06:20:34.871098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 292/579] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:34 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:35.243339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9da882b2-0b0f-420d-8f48-e444eed65b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:35.245869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9da882b2-0b0f-420d-8f48-e444eed65b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:35.253514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9da882b2-0b0f-420d-8f48-e444eed65b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:35.254947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9da882b2-0b0f-420d-8f48-e444eed65b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:35.255539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9da882b2-0b0f-420d-8f48-e444eed65b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:35.256516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9da882b2-0b0f-420d-8f48-e444eed65b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:35.257130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9da882b2-0b0f-420d-8f48-e444eed65b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:35.257730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9da882b2-0b0f-420d-8f48-e444eed65b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:35.290695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9da882b2-0b0f-420d-8f48-e444eed65b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052221 Aug 24 06:20:35.294937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 288/580] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:35.447340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3ec9dc2c-21f3-43e5-9191-227ce9714c79 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:35.447340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3ec9dc2c-21f3-43e5-9191-227ce9714c79 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:35.459174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ec9dc2c-21f3-43e5-9191-227ce9714c79 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:35.460396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ec9dc2c-21f3-43e5-9191-227ce9714c79 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:35.460875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ec9dc2c-21f3-43e5-9191-227ce9714c79 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:35.461599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ec9dc2c-21f3-43e5-9191-227ce9714c79 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:35.462050 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ec9dc2c-21f3-43e5-9191-227ce9714c79 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:35.462470 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ec9dc2c-21f3-43e5-9191-227ce9714c79 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:35.717863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3ec9dc2c-21f3-43e5-9191-227ce9714c79 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:35.727378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3ec9dc2c-21f3-43e5-9191-227ce9714c79 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.287938 Aug 24 06:20:35.741605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 293/581] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:35 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:35.882969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ab6d3e36-29e3-4b37-9f15-dbb176a4dc4c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:35.885097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ab6d3e36-29e3-4b37-9f15-dbb176a4dc4c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:35.892024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab6d3e36-29e3-4b37-9f15-dbb176a4dc4c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:35.892524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab6d3e36-29e3-4b37-9f15-dbb176a4dc4c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:35.892960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab6d3e36-29e3-4b37-9f15-dbb176a4dc4c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:35.893657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab6d3e36-29e3-4b37-9f15-dbb176a4dc4c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:35.894103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab6d3e36-29e3-4b37-9f15-dbb176a4dc4c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:35.894528 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab6d3e36-29e3-4b37-9f15-dbb176a4dc4c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:35.927629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ab6d3e36-29e3-4b37-9f15-dbb176a4dc4c tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048862 Aug 24 06:20:35.928249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 289/582] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:35 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:36.302815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cfa89829-d246-41d0-aa16-09bcb42a5895 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:36.305044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cfa89829-d246-41d0-aa16-09bcb42a5895 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:36.311414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cfa89829-d246-41d0-aa16-09bcb42a5895 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:36.311888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cfa89829-d246-41d0-aa16-09bcb42a5895 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:36.312313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cfa89829-d246-41d0-aa16-09bcb42a5895 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:36.313031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cfa89829-d246-41d0-aa16-09bcb42a5895 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:36.313471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cfa89829-d246-41d0-aa16-09bcb42a5895 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:36.313885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cfa89829-d246-41d0-aa16-09bcb42a5895 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:36.343541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cfa89829-d246-41d0-aa16-09bcb42a5895 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Aug 24 06:20:36.344097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 294/583] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:36 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:36.748245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dabf4edf-520f-4e3e-93b5-dba18eb28fc7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:36.748894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dabf4edf-520f-4e3e-93b5-dba18eb28fc7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:36.756003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dabf4edf-520f-4e3e-93b5-dba18eb28fc7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:36.756472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dabf4edf-520f-4e3e-93b5-dba18eb28fc7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:36.756928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dabf4edf-520f-4e3e-93b5-dba18eb28fc7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:36.757637 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dabf4edf-520f-4e3e-93b5-dba18eb28fc7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:36.758081 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dabf4edf-520f-4e3e-93b5-dba18eb28fc7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:36.758491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dabf4edf-520f-4e3e-93b5-dba18eb28fc7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:36.892706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dabf4edf-520f-4e3e-93b5-dba18eb28fc7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:36.900425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dabf4edf-520f-4e3e-93b5-dba18eb28fc7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1675 microversion: 2.1 time: 0.156057 Aug 24 06:20:36.901027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 290/584] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:36 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:36.939428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c2e83e2f-8031-45b3-aa3f-f9340a0ebb7e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:36.941573 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c2e83e2f-8031-45b3-aa3f-f9340a0ebb7e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:36.948126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2e83e2f-8031-45b3-aa3f-f9340a0ebb7e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:36.948648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2e83e2f-8031-45b3-aa3f-f9340a0ebb7e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:36.949079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2e83e2f-8031-45b3-aa3f-f9340a0ebb7e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:36.949767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2e83e2f-8031-45b3-aa3f-f9340a0ebb7e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:36.950212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2e83e2f-8031-45b3-aa3f-f9340a0ebb7e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:36.950632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2e83e2f-8031-45b3-aa3f-f9340a0ebb7e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:36.979141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c2e83e2f-8031-45b3-aa3f-f9340a0ebb7e tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043587 Aug 24 06:20:36.979629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 295/585] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:36 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:20:36.990427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:36.990921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:36.996839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:36.997314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:36.997737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:36.998413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:36.998862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:36.999276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:37.074606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] HTTP exception thrown: Instance 967afe19-8139-4888-ae38-b682c1188c8f is not attached to volume 37d02100-2d5b-47c5-bcf9-8a8858aac1be Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Request method failure captured: Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: DELETE /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments/37d02100-2d5b-47c5-bcf9-8a8858aac1be HTTP/1.1 Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJuAYQ-1FOq5bxlBZ-B8fw4zdntumALmpmWAfW6Mh16IT9C-wOzUUAx-vEe1v5AqeSluLJPAEfhjqhdQZlI0oGIcqrS4EFbZ43a9AvEg22yulmVDHrGlfqg8VueTi5bCJAfKpVXl5RN8EqkS_kXmvzpT_foMj-6_6DwKkq6WlYyrfw Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: e2adcef70b1f41d19ddee6811b47be41 Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-TestMinimumBasicScenario-171285182 Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:20:37.077026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:20:37.078609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e2adcef70b1f41d19ddee6811b47be41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e2adcef70b1f41d19ddee6811b47be41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e2adcef70b1f41d19ddee6811b47be41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e2adcef70b1f41d19ddee6811b47be41", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:20:37.078609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-TestMinimumBasicScenario-171285182 Aug 24 06:20:37.078609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: e2adcef70b1f41d19ddee6811b47be41 Aug 24 06:20:37.078609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-TestMinimumBasicScenario-171285182 Aug 24 06:20:37.078609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-TestMinimumBasicScenario-171285182-project Aug 24 06:20:37.078609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:20:37.078609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:20:37.078609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: d3a03b5f82724f37a2134554d42b2925 Aug 24 06:20:37.078609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-TestMinimumBasicScenario-171285182-project Aug 24 06:20:37.078609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:20:37.078609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 967afe19-8139-4888-ae38-b682c1188c8f is not attached to volume 37d02100-2d5b-47c5-bcf9-8a8858aac1be Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'server_id': '967afe19-8139-4888-ae38-b682c1188c8f', 'id': '37d02100-2d5b-47c5-bcf9-8a8858aac1be'} Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 37d02100-2d5b-47c5-bcf9-8a8858aac1be. Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:20:37.082890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967afe19-8139-4888-ae38-b682c1188c8f is not attached to volume 37d02100-2d5b-47c5-bcf9-8a8858aac1be Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967afe19-8139-4888-ae38-b682c1188c8f is not attached to volume 37d02100-2d5b-47c5-bcf9-8a8858aac1be Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:20:37.084233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Returning 404 to user: Instance 967afe19-8139-4888-ae38-b682c1188c8f is not attached to volume 37d02100-2d5b-47c5-bcf9-8a8858aac1be {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:20:37.085358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8233794c-1c32-475d-93d5-5765e61e7100 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "DELETE /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments/37d02100-2d5b-47c5-bcf9-8a8858aac1be" status: 404 len: 154 microversion: 2.1 time: 0.092631 Aug 24 06:20:37.085358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 291/586] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 24 06:20:36 2022] DELETE /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f/os-volume_attachments/37d02100-2d5b-47c5-bcf9-8a8858aac1be => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:20:37.359012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ea6b257d-e023-4650-b6dd-556bef2f0dac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:37.361175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ea6b257d-e023-4650-b6dd-556bef2f0dac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:37.368249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea6b257d-e023-4650-b6dd-556bef2f0dac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:37.368750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea6b257d-e023-4650-b6dd-556bef2f0dac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:37.369180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea6b257d-e023-4650-b6dd-556bef2f0dac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:37.369863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea6b257d-e023-4650-b6dd-556bef2f0dac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:37.370308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea6b257d-e023-4650-b6dd-556bef2f0dac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:37.370738 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea6b257d-e023-4650-b6dd-556bef2f0dac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:37.402471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ea6b257d-e023-4650-b6dd-556bef2f0dac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047434 Aug 24 06:20:37.403066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 296/587] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:20:37.921364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c27904e5-c97d-4046-a31e-42d20e21276d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:37.921969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c27904e5-c97d-4046-a31e-42d20e21276d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:37.928918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c27904e5-c97d-4046-a31e-42d20e21276d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:37.929405 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c27904e5-c97d-4046-a31e-42d20e21276d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:37.929835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c27904e5-c97d-4046-a31e-42d20e21276d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:37.930526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c27904e5-c97d-4046-a31e-42d20e21276d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:37.930978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c27904e5-c97d-4046-a31e-42d20e21276d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:37.931402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c27904e5-c97d-4046-a31e-42d20e21276d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:38.060417 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c27904e5-c97d-4046-a31e-42d20e21276d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:38.068724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c27904e5-c97d-4046-a31e-42d20e21276d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1652 microversion: 2.1 time: 0.151196 Aug 24 06:20:38.069280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 292/588] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:37 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1652 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:38.089255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-93f19d6e-ee8f-4578-b912-fd96d8bf8ad2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:20:38.095261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93f19d6e-ee8f-4578-b912-fd96d8bf8ad2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:38.095734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93f19d6e-ee8f-4578-b912-fd96d8bf8ad2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:38.096162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93f19d6e-ee8f-4578-b912-fd96d8bf8ad2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:38.117575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-93f19d6e-ee8f-4578-b912-fd96d8bf8ad2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Going to try to start instance {{(pid=121151) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 06:20:38.305277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-93f19d6e-ee8f-4578-b912-fd96d8bf8ad2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "POST /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/action" status: 202 len: 0 microversion: 2.1 time: 0.219595 Aug 24 06:20:38.305823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 297/589] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 24 06:20:38 2022] POST /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:20:38.314219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-83903887-b3d4-4709-b697-914ec78c6db7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:38.319937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-83903887-b3d4-4709-b697-914ec78c6db7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:38.321660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83903887-b3d4-4709-b697-914ec78c6db7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:38.322142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83903887-b3d4-4709-b697-914ec78c6db7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:38.322568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83903887-b3d4-4709-b697-914ec78c6db7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:38.323255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83903887-b3d4-4709-b697-914ec78c6db7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:38.323698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83903887-b3d4-4709-b697-914ec78c6db7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:38.324111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83903887-b3d4-4709-b697-914ec78c6db7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:38.415216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ee8d5b8b-c969-464f-b26e-65710b3f4525 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:38.418559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ee8d5b8b-c969-464f-b26e-65710b3f4525 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:38.423876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee8d5b8b-c969-464f-b26e-65710b3f4525 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:38.424546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee8d5b8b-c969-464f-b26e-65710b3f4525 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:38.424866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee8d5b8b-c969-464f-b26e-65710b3f4525 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:38.425574 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee8d5b8b-c969-464f-b26e-65710b3f4525 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:38.426585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee8d5b8b-c969-464f-b26e-65710b3f4525 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:38.427657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee8d5b8b-c969-464f-b26e-65710b3f4525 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:38.459205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-83903887-b3d4-4709-b697-914ec78c6db7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:38.467379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-83903887-b3d4-4709-b697-914ec78c6db7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1661 microversion: 2.1 time: 0.157084 Aug 24 06:20:38.469137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 293/590] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:38 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:38.469255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ee8d5b8b-c969-464f-b26e-65710b3f4525 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058734 Aug 24 06:20:38.469843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 298/591] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:38 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:20:39.481447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e7fa53fc-90df-4782-affc-193b7625cb53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:39.483677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e7fa53fc-90df-4782-affc-193b7625cb53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:39.490096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-08198256-42b2-4a7c-b319-3babf412689d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:39.490721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-08198256-42b2-4a7c-b319-3babf412689d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:39.491108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7fa53fc-90df-4782-affc-193b7625cb53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:39.491588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7fa53fc-90df-4782-affc-193b7625cb53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:39.492030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7fa53fc-90df-4782-affc-193b7625cb53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:39.492828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7fa53fc-90df-4782-affc-193b7625cb53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:39.493191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7fa53fc-90df-4782-affc-193b7625cb53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:39.493773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7fa53fc-90df-4782-affc-193b7625cb53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:39.497606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08198256-42b2-4a7c-b319-3babf412689d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:39.498293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08198256-42b2-4a7c-b319-3babf412689d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:39.498760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08198256-42b2-4a7c-b319-3babf412689d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:39.499491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08198256-42b2-4a7c-b319-3babf412689d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:39.499946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08198256-42b2-4a7c-b319-3babf412689d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:39.500369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08198256-42b2-4a7c-b319-3babf412689d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:39.524998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e7fa53fc-90df-4782-affc-193b7625cb53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047449 Aug 24 06:20:39.525775 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 294/592] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:39 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:39.635898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-08198256-42b2-4a7c-b319-3babf412689d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:39.643803 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-08198256-42b2-4a7c-b319-3babf412689d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1661 microversion: 2.1 time: 0.158129 Aug 24 06:20:39.646218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 299/593] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:39 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1661 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:40.536933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0aa753d0-9f6d-4f72-94f9-16f2eabc14da tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:40.539179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0aa753d0-9f6d-4f72-94f9-16f2eabc14da tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:40.545761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa753d0-9f6d-4f72-94f9-16f2eabc14da tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:40.546228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa753d0-9f6d-4f72-94f9-16f2eabc14da tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:40.546698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa753d0-9f6d-4f72-94f9-16f2eabc14da tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:40.547348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa753d0-9f6d-4f72-94f9-16f2eabc14da tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:40.547804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa753d0-9f6d-4f72-94f9-16f2eabc14da tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:40.548221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa753d0-9f6d-4f72-94f9-16f2eabc14da tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:40.576929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0aa753d0-9f6d-4f72-94f9-16f2eabc14da tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044567 Aug 24 06:20:40.577486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 295/594] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:40 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:40.665519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-49176238-9bff-43d0-8999-c7439d156391 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:40.666098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-49176238-9bff-43d0-8999-c7439d156391 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:40.672575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49176238-9bff-43d0-8999-c7439d156391 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:40.673053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49176238-9bff-43d0-8999-c7439d156391 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:40.673479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49176238-9bff-43d0-8999-c7439d156391 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:40.674159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49176238-9bff-43d0-8999-c7439d156391 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:40.674604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49176238-9bff-43d0-8999-c7439d156391 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:40.675043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49176238-9bff-43d0-8999-c7439d156391 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:40.804015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-49176238-9bff-43d0-8999-c7439d156391 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:20:40.811774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-49176238-9bff-43d0-8999-c7439d156391 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1665 microversion: 2.1 time: 0.150121 Aug 24 06:20:40.812342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 300/595] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:20:40 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1665 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:20:41.589296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5424cc70-46c6-4541-9335-a1a69dac1ac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:41.591428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5424cc70-46c6-4541-9335-a1a69dac1ac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:41.593854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:41.599138 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5424cc70-46c6-4541-9335-a1a69dac1ac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:41.599609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5424cc70-46c6-4541-9335-a1a69dac1ac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:41.600036 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5424cc70-46c6-4541-9335-a1a69dac1ac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:41.600744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5424cc70-46c6-4541-9335-a1a69dac1ac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:41.601194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5424cc70-46c6-4541-9335-a1a69dac1ac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:41.601603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5424cc70-46c6-4541-9335-a1a69dac1ac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:41.632755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5424cc70-46c6-4541-9335-a1a69dac1ac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047298 Aug 24 06:20:41.633318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 296/596] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:41 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:42.089918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-86cab5b6-ba0e-4d50-bc8e-d7da885337d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:42.090444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-86cab5b6-ba0e-4d50-bc8e-d7da885337d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:42.096561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-86cab5b6-ba0e-4d50-bc8e-d7da885337d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:42.097038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-86cab5b6-ba0e-4d50-bc8e-d7da885337d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:42.097463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-86cab5b6-ba0e-4d50-bc8e-d7da885337d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:42.098222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-86cab5b6-ba0e-4d50-bc8e-d7da885337d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:42.098667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-86cab5b6-ba0e-4d50-bc8e-d7da885337d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:42.099081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-86cab5b6-ba0e-4d50-bc8e-d7da885337d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:42.127690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-86cab5b6-ba0e-4d50-bc8e-d7da885337d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments/a01f5e3e-39bb-4b44-a27c-72b28f97b3ea" status: 200 len: 194 microversion: 2.20 time: 0.042196 Aug 24 06:20:42.128267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 301/597] 10.222.0.62 () {60 vars in 1454 bytes} [Wed Aug 24 06:20:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments/a01f5e3e-39bb-4b44-a27c-72b28f97b3ea => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:42.194490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5ea9503d-a2f2-4f81-a48d-abb6d3d0d9c8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:42.194985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5ea9503d-a2f2-4f81-a48d-abb6d3d0d9c8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:42.201459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ea9503d-a2f2-4f81-a48d-abb6d3d0d9c8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:42.201939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ea9503d-a2f2-4f81-a48d-abb6d3d0d9c8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:42.202368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ea9503d-a2f2-4f81-a48d-abb6d3d0d9c8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:42.204464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ea9503d-a2f2-4f81-a48d-abb6d3d0d9c8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:42.204464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ea9503d-a2f2-4f81-a48d-abb6d3d0d9c8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:42.204464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ea9503d-a2f2-4f81-a48d-abb6d3d0d9c8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:42.282802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-5ea9503d-a2f2-4f81-a48d-abb6d3d0d9c8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lazy-loading 'services' on Instance uuid 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:20:42.286441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:42.517455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5ea9503d-a2f2-4f81-a48d-abb6d3d0d9c8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "DELETE /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments/a01f5e3e-39bb-4b44-a27c-72b28f97b3ea" status: 202 len: 0 microversion: 2.20 time: 0.327444 Aug 24 06:20:42.518166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 297/598] 10.222.0.62 () {60 vars in 1457 bytes} [Wed Aug 24 06:20:42 2022] DELETE /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments/a01f5e3e-39bb-4b44-a27c-72b28f97b3ea => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:20:42.526690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7d4d3d8b-e67f-436c-8ede-697965e90b80 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:42.528983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7d4d3d8b-e67f-436c-8ede-697965e90b80 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:42.535056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d4d3d8b-e67f-436c-8ede-697965e90b80 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:42.536076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d4d3d8b-e67f-436c-8ede-697965e90b80 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:42.536527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d4d3d8b-e67f-436c-8ede-697965e90b80 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:42.537262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d4d3d8b-e67f-436c-8ede-697965e90b80 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:42.537717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d4d3d8b-e67f-436c-8ede-697965e90b80 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:42.538140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d4d3d8b-e67f-436c-8ede-697965e90b80 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:42.568104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7d4d3d8b-e67f-436c-8ede-697965e90b80 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045377 Aug 24 06:20:42.568698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 302/599] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:42.647359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5547f2c6-8bf3-4732-b129-c716d0fc136e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:42.649601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5547f2c6-8bf3-4732-b129-c716d0fc136e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:42.657877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5547f2c6-8bf3-4732-b129-c716d0fc136e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:42.658373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5547f2c6-8bf3-4732-b129-c716d0fc136e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:42.664776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5547f2c6-8bf3-4732-b129-c716d0fc136e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:42.664776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5547f2c6-8bf3-4732-b129-c716d0fc136e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:42.664776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5547f2c6-8bf3-4732-b129-c716d0fc136e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:42.664776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5547f2c6-8bf3-4732-b129-c716d0fc136e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:42.696606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5547f2c6-8bf3-4732-b129-c716d0fc136e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055279 Aug 24 06:20:42.697175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 298/600] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:42 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:20:43.580808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d7ce53c8-e5b3-443d-99be-e9fcaddf8311 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:43.582961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d7ce53c8-e5b3-443d-99be-e9fcaddf8311 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:43.589471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7ce53c8-e5b3-443d-99be-e9fcaddf8311 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:43.589953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7ce53c8-e5b3-443d-99be-e9fcaddf8311 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:43.590395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7ce53c8-e5b3-443d-99be-e9fcaddf8311 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:43.591090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7ce53c8-e5b3-443d-99be-e9fcaddf8311 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:43.591542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7ce53c8-e5b3-443d-99be-e9fcaddf8311 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:43.591968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d7ce53c8-e5b3-443d-99be-e9fcaddf8311 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:43.622298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d7ce53c8-e5b3-443d-99be-e9fcaddf8311 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045459 Aug 24 06:20:43.622862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 303/601] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:43.709368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fa9dea0c-cd0b-428c-808a-f18958caccfc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:43.711132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fa9dea0c-cd0b-428c-808a-f18958caccfc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:43.717599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9dea0c-cd0b-428c-808a-f18958caccfc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:43.718079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9dea0c-cd0b-428c-808a-f18958caccfc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:43.718507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9dea0c-cd0b-428c-808a-f18958caccfc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:43.719197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9dea0c-cd0b-428c-808a-f18958caccfc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:43.719651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9dea0c-cd0b-428c-808a-f18958caccfc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:43.720074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa9dea0c-cd0b-428c-808a-f18958caccfc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:43.750091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fa9dea0c-cd0b-428c-808a-f18958caccfc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Aug 24 06:20:43.750669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 299/602] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:43 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:44.635283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e96f95a2-f6dd-4898-bc0c-7b707062f145 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:44.637430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e96f95a2-f6dd-4898-bc0c-7b707062f145 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:44.643826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96f95a2-f6dd-4898-bc0c-7b707062f145 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:44.644294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96f95a2-f6dd-4898-bc0c-7b707062f145 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:44.645379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96f95a2-f6dd-4898-bc0c-7b707062f145 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:44.646060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96f95a2-f6dd-4898-bc0c-7b707062f145 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:44.646502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96f95a2-f6dd-4898-bc0c-7b707062f145 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:44.646915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96f95a2-f6dd-4898-bc0c-7b707062f145 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:44.678256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e96f95a2-f6dd-4898-bc0c-7b707062f145 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046904 Aug 24 06:20:44.678829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 304/603] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:44.763023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2bdce4be-e725-440a-b038-55f227620303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:44.765251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2bdce4be-e725-440a-b038-55f227620303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:44.772424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2bdce4be-e725-440a-b038-55f227620303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:44.772932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2bdce4be-e725-440a-b038-55f227620303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:44.773361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2bdce4be-e725-440a-b038-55f227620303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:44.774053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2bdce4be-e725-440a-b038-55f227620303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:44.774501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2bdce4be-e725-440a-b038-55f227620303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:44.774916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2bdce4be-e725-440a-b038-55f227620303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:44.807942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2bdce4be-e725-440a-b038-55f227620303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048782 Aug 24 06:20:44.808415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 300/604] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:44 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:45.690812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-36373247-1954-495c-9757-c513f58849f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:45.693063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-36373247-1954-495c-9757-c513f58849f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:45.699393 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36373247-1954-495c-9757-c513f58849f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:45.699867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36373247-1954-495c-9757-c513f58849f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:45.700298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36373247-1954-495c-9757-c513f58849f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:45.701016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36373247-1954-495c-9757-c513f58849f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:45.701459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36373247-1954-495c-9757-c513f58849f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:45.701889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36373247-1954-495c-9757-c513f58849f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:45.706515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:45.734194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-36373247-1954-495c-9757-c513f58849f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046634 Aug 24 06:20:45.734419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 305/605] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:45.819292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-400288b6-67db-4b5c-98d8-c9e34b6965b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:45.821434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-400288b6-67db-4b5c-98d8-c9e34b6965b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:45.827978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400288b6-67db-4b5c-98d8-c9e34b6965b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:45.828457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400288b6-67db-4b5c-98d8-c9e34b6965b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:45.828921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400288b6-67db-4b5c-98d8-c9e34b6965b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:45.829610 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400288b6-67db-4b5c-98d8-c9e34b6965b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:45.830063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400288b6-67db-4b5c-98d8-c9e34b6965b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:45.830483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-400288b6-67db-4b5c-98d8-c9e34b6965b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:45.862880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-400288b6-67db-4b5c-98d8-c9e34b6965b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047487 Aug 24 06:20:45.863686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 301/606] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:45 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:46.747176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0c7a2451-7c95-4363-8c1f-55d71d4b3724 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:46.749324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0c7a2451-7c95-4363-8c1f-55d71d4b3724 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:46.757056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c7a2451-7c95-4363-8c1f-55d71d4b3724 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:46.757514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c7a2451-7c95-4363-8c1f-55d71d4b3724 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:46.757945 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c7a2451-7c95-4363-8c1f-55d71d4b3724 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:46.758630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c7a2451-7c95-4363-8c1f-55d71d4b3724 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:46.759113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c7a2451-7c95-4363-8c1f-55d71d4b3724 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:46.759525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c7a2451-7c95-4363-8c1f-55d71d4b3724 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:46.789548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0c7a2451-7c95-4363-8c1f-55d71d4b3724 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046476 Aug 24 06:20:46.794787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 306/607] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:46.877470 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a41abe7b-bc51-4f11-af67-cfa23d0603f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:46.880900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a41abe7b-bc51-4f11-af67-cfa23d0603f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:46.888179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a41abe7b-bc51-4f11-af67-cfa23d0603f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:46.888689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a41abe7b-bc51-4f11-af67-cfa23d0603f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:46.889123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a41abe7b-bc51-4f11-af67-cfa23d0603f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:46.889809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a41abe7b-bc51-4f11-af67-cfa23d0603f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:46.890251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a41abe7b-bc51-4f11-af67-cfa23d0603f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:46.890667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a41abe7b-bc51-4f11-af67-cfa23d0603f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:46.920772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a41abe7b-bc51-4f11-af67-cfa23d0603f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049567 Aug 24 06:20:46.921327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 302/608] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:47.803291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4cdb7444-91c5-4c4a-84c2-5bdf6f23ab99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:47.805437 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4cdb7444-91c5-4c4a-84c2-5bdf6f23ab99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:47.811844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdb7444-91c5-4c4a-84c2-5bdf6f23ab99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:47.812356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdb7444-91c5-4c4a-84c2-5bdf6f23ab99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:47.812812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdb7444-91c5-4c4a-84c2-5bdf6f23ab99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:47.813498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdb7444-91c5-4c4a-84c2-5bdf6f23ab99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:47.813943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdb7444-91c5-4c4a-84c2-5bdf6f23ab99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:47.814358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdb7444-91c5-4c4a-84c2-5bdf6f23ab99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:47.845171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4cdb7444-91c5-4c4a-84c2-5bdf6f23ab99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046686 Aug 24 06:20:47.845743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 307/609] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:47.933479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6f38142b-3125-4c9c-b12b-32e7d6411d2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:47.935601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6f38142b-3125-4c9c-b12b-32e7d6411d2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:47.942904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f38142b-3125-4c9c-b12b-32e7d6411d2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:47.943385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f38142b-3125-4c9c-b12b-32e7d6411d2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:47.943818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f38142b-3125-4c9c-b12b-32e7d6411d2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:47.948065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f38142b-3125-4c9c-b12b-32e7d6411d2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:47.948065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f38142b-3125-4c9c-b12b-32e7d6411d2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:47.948065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f38142b-3125-4c9c-b12b-32e7d6411d2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:47.976036 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6f38142b-3125-4c9c-b12b-32e7d6411d2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046413 Aug 24 06:20:47.976549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 303/610] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:48.857555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d9e476fd-ccfa-4a2f-9ffe-214aa54af205 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:48.859652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d9e476fd-ccfa-4a2f-9ffe-214aa54af205 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:48.866841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9e476fd-ccfa-4a2f-9ffe-214aa54af205 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:48.867333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9e476fd-ccfa-4a2f-9ffe-214aa54af205 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:48.867756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9e476fd-ccfa-4a2f-9ffe-214aa54af205 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:48.868446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9e476fd-ccfa-4a2f-9ffe-214aa54af205 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:48.869024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9e476fd-ccfa-4a2f-9ffe-214aa54af205 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:48.869450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9e476fd-ccfa-4a2f-9ffe-214aa54af205 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:48.901059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d9e476fd-ccfa-4a2f-9ffe-214aa54af205 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047407 Aug 24 06:20:48.901640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 308/611] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:48.989028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-54ec4aaf-57c9-4b14-a487-d196b1a5e2f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:48.991146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-54ec4aaf-57c9-4b14-a487-d196b1a5e2f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:48.997653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-54ec4aaf-57c9-4b14-a487-d196b1a5e2f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:48.998126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-54ec4aaf-57c9-4b14-a487-d196b1a5e2f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:48.998549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-54ec4aaf-57c9-4b14-a487-d196b1a5e2f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:48.999233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-54ec4aaf-57c9-4b14-a487-d196b1a5e2f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:48.999677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-54ec4aaf-57c9-4b14-a487-d196b1a5e2f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:49.000086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-54ec4aaf-57c9-4b14-a487-d196b1a5e2f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:49.030159 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-54ec4aaf-57c9-4b14-a487-d196b1a5e2f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Aug 24 06:20:49.030726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 304/612] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:49.913625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6728684a-3f90-4c01-8e47-a1c4fce9537a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:49.915820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6728684a-3f90-4c01-8e47-a1c4fce9537a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:49.922297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6728684a-3f90-4c01-8e47-a1c4fce9537a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:49.922778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6728684a-3f90-4c01-8e47-a1c4fce9537a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:49.923208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6728684a-3f90-4c01-8e47-a1c4fce9537a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:49.923892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6728684a-3f90-4c01-8e47-a1c4fce9537a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:49.924340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6728684a-3f90-4c01-8e47-a1c4fce9537a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:49.924783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6728684a-3f90-4c01-8e47-a1c4fce9537a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:49.954877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6728684a-3f90-4c01-8e47-a1c4fce9537a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045229 Aug 24 06:20:49.955386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 309/613] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:50.042674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c558b43b-e817-4f3e-939e-bae205a27de4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:50.044820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c558b43b-e817-4f3e-939e-bae205a27de4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:50.051294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c558b43b-e817-4f3e-939e-bae205a27de4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:50.051777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c558b43b-e817-4f3e-939e-bae205a27de4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:50.052216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c558b43b-e817-4f3e-939e-bae205a27de4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:50.053186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c558b43b-e817-4f3e-939e-bae205a27de4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:50.053658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c558b43b-e817-4f3e-939e-bae205a27de4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:50.054080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c558b43b-e817-4f3e-939e-bae205a27de4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:50.084699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c558b43b-e817-4f3e-939e-bae205a27de4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046012 Aug 24 06:20:50.085288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 305/614] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:50.967640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-210f93f9-c3ed-434f-b918-1a47609f1431 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:50.969700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-210f93f9-c3ed-434f-b918-1a47609f1431 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:50.976885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210f93f9-c3ed-434f-b918-1a47609f1431 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:50.977368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210f93f9-c3ed-434f-b918-1a47609f1431 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:50.977800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210f93f9-c3ed-434f-b918-1a47609f1431 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:50.978500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210f93f9-c3ed-434f-b918-1a47609f1431 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:50.978947 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210f93f9-c3ed-434f-b918-1a47609f1431 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:50.979368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-210f93f9-c3ed-434f-b918-1a47609f1431 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:51.009870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-210f93f9-c3ed-434f-b918-1a47609f1431 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046198 Aug 24 06:20:51.010459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 310/615] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:51.097490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6a060119-fa2a-4215-acbe-e6d36aa52355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:51.100309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6a060119-fa2a-4215-acbe-e6d36aa52355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:51.107114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a060119-fa2a-4215-acbe-e6d36aa52355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:51.107630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a060119-fa2a-4215-acbe-e6d36aa52355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:51.108097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a060119-fa2a-4215-acbe-e6d36aa52355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:51.108921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a060119-fa2a-4215-acbe-e6d36aa52355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:51.109409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a060119-fa2a-4215-acbe-e6d36aa52355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:51.109835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a060119-fa2a-4215-acbe-e6d36aa52355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:51.139229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6a060119-fa2a-4215-acbe-e6d36aa52355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045923 Aug 24 06:20:51.139794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 306/616] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:52.022597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bc8b8ac8-6df3-4cb9-8ab9-84e36bc925fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:52.024668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bc8b8ac8-6df3-4cb9-8ab9-84e36bc925fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:52.031127 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8b8ac8-6df3-4cb9-8ab9-84e36bc925fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:52.031595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8b8ac8-6df3-4cb9-8ab9-84e36bc925fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:52.032019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8b8ac8-6df3-4cb9-8ab9-84e36bc925fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:52.032726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8b8ac8-6df3-4cb9-8ab9-84e36bc925fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:52.033172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8b8ac8-6df3-4cb9-8ab9-84e36bc925fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:52.033586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc8b8ac8-6df3-4cb9-8ab9-84e36bc925fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:52.064904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bc8b8ac8-6df3-4cb9-8ab9-84e36bc925fb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046469 Aug 24 06:20:52.065475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 311/617] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:52.151793 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3edd8bac-9010-476d-9ba4-6a315ac7c2fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:52.154035 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3edd8bac-9010-476d-9ba4-6a315ac7c2fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:52.162085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edd8bac-9010-476d-9ba4-6a315ac7c2fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:52.162565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edd8bac-9010-476d-9ba4-6a315ac7c2fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:52.162995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edd8bac-9010-476d-9ba4-6a315ac7c2fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:52.163747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edd8bac-9010-476d-9ba4-6a315ac7c2fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:52.164233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edd8bac-9010-476d-9ba4-6a315ac7c2fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:52.164697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3edd8bac-9010-476d-9ba4-6a315ac7c2fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:52.196721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3edd8bac-9010-476d-9ba4-6a315ac7c2fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048938 Aug 24 06:20:52.197289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 307/618] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:52 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:53.078254 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-15f1a0c0-1a99-46a0-930e-dbb7f07ab598 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:53.080270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-15f1a0c0-1a99-46a0-930e-dbb7f07ab598 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:53.087585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15f1a0c0-1a99-46a0-930e-dbb7f07ab598 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:53.088056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15f1a0c0-1a99-46a0-930e-dbb7f07ab598 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:53.088717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15f1a0c0-1a99-46a0-930e-dbb7f07ab598 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:53.101193 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15f1a0c0-1a99-46a0-930e-dbb7f07ab598 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:53.101193 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15f1a0c0-1a99-46a0-930e-dbb7f07ab598 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:53.101193 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15f1a0c0-1a99-46a0-930e-dbb7f07ab598 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:53.120584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-15f1a0c0-1a99-46a0-930e-dbb7f07ab598 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046581 Aug 24 06:20:53.121160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 312/619] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:20:53.209734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-26783191-d792-47a6-8533-9c37a9a005f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:53.211853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-26783191-d792-47a6-8533-9c37a9a005f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:53.218275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26783191-d792-47a6-8533-9c37a9a005f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:53.218760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26783191-d792-47a6-8533-9c37a9a005f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:53.219186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26783191-d792-47a6-8533-9c37a9a005f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:53.219868 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26783191-d792-47a6-8533-9c37a9a005f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:53.220318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26783191-d792-47a6-8533-9c37a9a005f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:53.220761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26783191-d792-47a6-8533-9c37a9a005f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:53.249430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-26783191-d792-47a6-8533-9c37a9a005f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 Aug 24 06:20:53.249982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 308/620] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:54.133465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6c4a112a-da9a-4a54-a5de-ae510cac3114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:54.135622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6c4a112a-da9a-4a54-a5de-ae510cac3114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:54.142326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c4a112a-da9a-4a54-a5de-ae510cac3114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:54.142807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c4a112a-da9a-4a54-a5de-ae510cac3114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:54.143239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c4a112a-da9a-4a54-a5de-ae510cac3114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:54.143928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c4a112a-da9a-4a54-a5de-ae510cac3114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:54.144372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c4a112a-da9a-4a54-a5de-ae510cac3114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:54.144823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c4a112a-da9a-4a54-a5de-ae510cac3114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:54.175649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6c4a112a-da9a-4a54-a5de-ae510cac3114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046235 Aug 24 06:20:54.176214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 313/621] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:54 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:54.261259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3d5f2e8e-1da4-4428-a871-2a8499551ac2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:54.263373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3d5f2e8e-1da4-4428-a871-2a8499551ac2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:54.269770 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d5f2e8e-1da4-4428-a871-2a8499551ac2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:54.270746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d5f2e8e-1da4-4428-a871-2a8499551ac2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:54.271177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d5f2e8e-1da4-4428-a871-2a8499551ac2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:54.271859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d5f2e8e-1da4-4428-a871-2a8499551ac2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:54.272309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d5f2e8e-1da4-4428-a871-2a8499551ac2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:54.272761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d5f2e8e-1da4-4428-a871-2a8499551ac2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:54.301513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3d5f2e8e-1da4-4428-a871-2a8499551ac2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044167 Aug 24 06:20:54.302060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 309/622] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:55.188520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-19e20e79-e3fc-4fc8-aa42-0fef264e1a5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:55.190691 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-19e20e79-e3fc-4fc8-aa42-0fef264e1a5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:55.197340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e20e79-e3fc-4fc8-aa42-0fef264e1a5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:55.197817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e20e79-e3fc-4fc8-aa42-0fef264e1a5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:55.198258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e20e79-e3fc-4fc8-aa42-0fef264e1a5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:55.198951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e20e79-e3fc-4fc8-aa42-0fef264e1a5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:55.199402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e20e79-e3fc-4fc8-aa42-0fef264e1a5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:55.199825 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e20e79-e3fc-4fc8-aa42-0fef264e1a5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:55.229333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-19e20e79-e3fc-4fc8-aa42-0fef264e1a5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044833 Aug 24 06:20:55.229902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 314/623] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:20:55.313804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b115ad68-bf49-4bef-b797-b76e5d1b42a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:55.315949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b115ad68-bf49-4bef-b797-b76e5d1b42a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:55.322357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b115ad68-bf49-4bef-b797-b76e5d1b42a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:55.322837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b115ad68-bf49-4bef-b797-b76e5d1b42a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:55.323270 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b115ad68-bf49-4bef-b797-b76e5d1b42a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:55.323957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b115ad68-bf49-4bef-b797-b76e5d1b42a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:55.324407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b115ad68-bf49-4bef-b797-b76e5d1b42a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:55.324849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b115ad68-bf49-4bef-b797-b76e5d1b42a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:55.353539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b115ad68-bf49-4bef-b797-b76e5d1b42a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043657 Aug 24 06:20:55.354088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 310/624] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:55 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:56.242151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-609820de-4ce1-4915-8aef-bf4000bfdaed tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:56.244313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-609820de-4ce1-4915-8aef-bf4000bfdaed tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:56.250898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-609820de-4ce1-4915-8aef-bf4000bfdaed tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:56.251384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-609820de-4ce1-4915-8aef-bf4000bfdaed tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:56.251818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-609820de-4ce1-4915-8aef-bf4000bfdaed tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:56.252535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-609820de-4ce1-4915-8aef-bf4000bfdaed tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:56.253001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-609820de-4ce1-4915-8aef-bf4000bfdaed tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:56.253429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-609820de-4ce1-4915-8aef-bf4000bfdaed tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:56.282778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-609820de-4ce1-4915-8aef-bf4000bfdaed tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045087 Aug 24 06:20:56.283337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 315/625] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:56.366120 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b5966c92-c31f-4130-8356-32b57734b368 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:56.368652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b5966c92-c31f-4130-8356-32b57734b368 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:56.375063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5966c92-c31f-4130-8356-32b57734b368 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:56.375536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5966c92-c31f-4130-8356-32b57734b368 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:56.375959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5966c92-c31f-4130-8356-32b57734b368 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:56.376667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5966c92-c31f-4130-8356-32b57734b368 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:56.377112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5966c92-c31f-4130-8356-32b57734b368 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:56.377525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5966c92-c31f-4130-8356-32b57734b368 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:56.407523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b5966c92-c31f-4130-8356-32b57734b368 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045760 Aug 24 06:20:56.408241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 311/626] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:57.295092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a219044d-1154-42c2-81f1-ebfd11a8e532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:57.298746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a219044d-1154-42c2-81f1-ebfd11a8e532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:57.308681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a219044d-1154-42c2-81f1-ebfd11a8e532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:57.308681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a219044d-1154-42c2-81f1-ebfd11a8e532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:57.308681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a219044d-1154-42c2-81f1-ebfd11a8e532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:57.308681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a219044d-1154-42c2-81f1-ebfd11a8e532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:57.309131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a219044d-1154-42c2-81f1-ebfd11a8e532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:57.309416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a219044d-1154-42c2-81f1-ebfd11a8e532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:57.341786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a219044d-1154-42c2-81f1-ebfd11a8e532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050632 Aug 24 06:20:57.342369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 316/627] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:57 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:57.419433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-84f5d6e6-3878-4022-8bee-7ed20fb1d3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:57.421593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-84f5d6e6-3878-4022-8bee-7ed20fb1d3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:57.428250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84f5d6e6-3878-4022-8bee-7ed20fb1d3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:57.428764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84f5d6e6-3878-4022-8bee-7ed20fb1d3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:57.429201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84f5d6e6-3878-4022-8bee-7ed20fb1d3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:57.430082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84f5d6e6-3878-4022-8bee-7ed20fb1d3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:57.430336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84f5d6e6-3878-4022-8bee-7ed20fb1d3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:57.430754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84f5d6e6-3878-4022-8bee-7ed20fb1d3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:57.461547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-84f5d6e6-3878-4022-8bee-7ed20fb1d3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046090 Aug 24 06:20:57.462117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 312/628] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:57 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:58.354373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-06ee745b-fca6-47fe-9250-bcaad9a8c114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:58.356515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-06ee745b-fca6-47fe-9250-bcaad9a8c114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:58.358802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:58.363433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06ee745b-fca6-47fe-9250-bcaad9a8c114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:58.364616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06ee745b-fca6-47fe-9250-bcaad9a8c114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:58.369105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06ee745b-fca6-47fe-9250-bcaad9a8c114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:58.369105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06ee745b-fca6-47fe-9250-bcaad9a8c114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:58.369105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06ee745b-fca6-47fe-9250-bcaad9a8c114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:58.369105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06ee745b-fca6-47fe-9250-bcaad9a8c114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:58.397160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-06ee745b-fca6-47fe-9250-bcaad9a8c114 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046702 Aug 24 06:20:58.398060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 317/629] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:58 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:20:58.473992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fdf76dad-19ee-40c1-8609-08ece3bc6286 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:58.476208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fdf76dad-19ee-40c1-8609-08ece3bc6286 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:58.482796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fdf76dad-19ee-40c1-8609-08ece3bc6286 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:58.483291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fdf76dad-19ee-40c1-8609-08ece3bc6286 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:58.483722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fdf76dad-19ee-40c1-8609-08ece3bc6286 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:58.484411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fdf76dad-19ee-40c1-8609-08ece3bc6286 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:58.484909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fdf76dad-19ee-40c1-8609-08ece3bc6286 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:58.491160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fdf76dad-19ee-40c1-8609-08ece3bc6286 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:58.514330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fdf76dad-19ee-40c1-8609-08ece3bc6286 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044931 Aug 24 06:20:58.514898 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 313/630] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:20:59.414352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-09934602-31e0-4bc9-898c-61b6cb54ffab tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:59.417284 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-09934602-31e0-4bc9-898c-61b6cb54ffab tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:59.427704 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09934602-31e0-4bc9-898c-61b6cb54ffab tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:59.428462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09934602-31e0-4bc9-898c-61b6cb54ffab tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:59.429186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09934602-31e0-4bc9-898c-61b6cb54ffab tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:59.430330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09934602-31e0-4bc9-898c-61b6cb54ffab tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:59.431074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09934602-31e0-4bc9-898c-61b6cb54ffab tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:59.431785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09934602-31e0-4bc9-898c-61b6cb54ffab tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:59.471823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-09934602-31e0-4bc9-898c-61b6cb54ffab tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064823 Aug 24 06:20:59.472802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 318/631] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:20:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:20:59.527195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d107f9d6-828e-49fa-860f-8fdc702796e0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:20:59.529491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d107f9d6-828e-49fa-860f-8fdc702796e0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:20:59.536299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d107f9d6-828e-49fa-860f-8fdc702796e0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:59.536821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d107f9d6-828e-49fa-860f-8fdc702796e0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:59.537257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d107f9d6-828e-49fa-860f-8fdc702796e0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:59.537995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d107f9d6-828e-49fa-860f-8fdc702796e0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:20:59.538449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d107f9d6-828e-49fa-860f-8fdc702796e0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:20:59.538875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d107f9d6-828e-49fa-860f-8fdc702796e0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:20:59.543019 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:20:59.570000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d107f9d6-828e-49fa-860f-8fdc702796e0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047026 Aug 24 06:20:59.570566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 314/632] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:20:59 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:00.484156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7acd82ca-469a-4638-9585-b39e3aa90cc7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:00.486345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7acd82ca-469a-4638-9585-b39e3aa90cc7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:00.492923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7acd82ca-469a-4638-9585-b39e3aa90cc7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:00.493403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7acd82ca-469a-4638-9585-b39e3aa90cc7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:00.493832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7acd82ca-469a-4638-9585-b39e3aa90cc7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:00.494531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7acd82ca-469a-4638-9585-b39e3aa90cc7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:00.494976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7acd82ca-469a-4638-9585-b39e3aa90cc7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:00.495397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7acd82ca-469a-4638-9585-b39e3aa90cc7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:00.531283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7acd82ca-469a-4638-9585-b39e3aa90cc7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051095 Aug 24 06:21:00.531904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 319/633] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:00 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:00.581950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a63cf1ad-7e16-4dc6-a984-731d2e39f4fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:00.584686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a63cf1ad-7e16-4dc6-a984-731d2e39f4fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:00.591848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63cf1ad-7e16-4dc6-a984-731d2e39f4fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:00.592323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63cf1ad-7e16-4dc6-a984-731d2e39f4fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:00.592776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63cf1ad-7e16-4dc6-a984-731d2e39f4fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:00.593468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63cf1ad-7e16-4dc6-a984-731d2e39f4fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:00.593903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63cf1ad-7e16-4dc6-a984-731d2e39f4fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:00.594315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63cf1ad-7e16-4dc6-a984-731d2e39f4fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:00.624957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a63cf1ad-7e16-4dc6-a984-731d2e39f4fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047400 Aug 24 06:21:00.625511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 315/634] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:01.543371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cca234fa-1b57-4a9b-a93b-d600dcb56116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:01.545896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cca234fa-1b57-4a9b-a93b-d600dcb56116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:01.553339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cca234fa-1b57-4a9b-a93b-d600dcb56116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:01.553860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cca234fa-1b57-4a9b-a93b-d600dcb56116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:01.554294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cca234fa-1b57-4a9b-a93b-d600dcb56116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:01.555020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cca234fa-1b57-4a9b-a93b-d600dcb56116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:01.555642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cca234fa-1b57-4a9b-a93b-d600dcb56116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:01.556069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cca234fa-1b57-4a9b-a93b-d600dcb56116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:01.589258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cca234fa-1b57-4a9b-a93b-d600dcb56116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049874 Aug 24 06:21:01.589826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 320/635] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:01.637852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-114abe70-a533-4b68-8df0-75897c054fa0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:01.640004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-114abe70-a533-4b68-8df0-75897c054fa0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:01.647027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-114abe70-a533-4b68-8df0-75897c054fa0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:01.647498 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-114abe70-a533-4b68-8df0-75897c054fa0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:01.647926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-114abe70-a533-4b68-8df0-75897c054fa0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:01.648643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-114abe70-a533-4b68-8df0-75897c054fa0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:01.649097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-114abe70-a533-4b68-8df0-75897c054fa0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:01.649513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-114abe70-a533-4b68-8df0-75897c054fa0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:01.680622 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-114abe70-a533-4b68-8df0-75897c054fa0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046684 Aug 24 06:21:01.681218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 316/636] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:02.604956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8fe3667a-cfa0-433c-8cc0-0c258bf1d1a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:02.607834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8fe3667a-cfa0-433c-8cc0-0c258bf1d1a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:02.615161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8fe3667a-cfa0-433c-8cc0-0c258bf1d1a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:02.615653 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8fe3667a-cfa0-433c-8cc0-0c258bf1d1a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:02.616094 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8fe3667a-cfa0-433c-8cc0-0c258bf1d1a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:02.617039 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8fe3667a-cfa0-433c-8cc0-0c258bf1d1a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:02.617258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8fe3667a-cfa0-433c-8cc0-0c258bf1d1a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:02.617684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8fe3667a-cfa0-433c-8cc0-0c258bf1d1a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:02.643670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:02.648632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8fe3667a-cfa0-433c-8cc0-0c258bf1d1a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050540 Aug 24 06:21:02.649219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 321/637] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:02.693164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-084de354-46f6-478e-80a4-9f1289aa3217 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:02.695301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-084de354-46f6-478e-80a4-9f1289aa3217 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:02.701512 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-084de354-46f6-478e-80a4-9f1289aa3217 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:02.701985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-084de354-46f6-478e-80a4-9f1289aa3217 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:02.702415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-084de354-46f6-478e-80a4-9f1289aa3217 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:02.703106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-084de354-46f6-478e-80a4-9f1289aa3217 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:02.703560 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-084de354-46f6-478e-80a4-9f1289aa3217 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:02.703976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-084de354-46f6-478e-80a4-9f1289aa3217 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:02.734302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-084de354-46f6-478e-80a4-9f1289aa3217 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044584 Aug 24 06:21:02.734302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 317/638] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:02 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:03.661554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-04e16fef-1d5e-4441-932e-1aaba1bdceca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:03.663776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-04e16fef-1d5e-4441-932e-1aaba1bdceca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:03.670511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04e16fef-1d5e-4441-932e-1aaba1bdceca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:03.670994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04e16fef-1d5e-4441-932e-1aaba1bdceca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:03.671429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04e16fef-1d5e-4441-932e-1aaba1bdceca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:03.672124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04e16fef-1d5e-4441-932e-1aaba1bdceca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:03.672602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04e16fef-1d5e-4441-932e-1aaba1bdceca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:03.673022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04e16fef-1d5e-4441-932e-1aaba1bdceca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:03.705719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-04e16fef-1d5e-4441-932e-1aaba1bdceca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048469 Aug 24 06:21:03.706534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 322/639] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:03.746000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f6a9a523-f2c3-47ac-ba31-06a300ed2586 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:03.748106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f6a9a523-f2c3-47ac-ba31-06a300ed2586 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:03.754492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6a9a523-f2c3-47ac-ba31-06a300ed2586 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:03.754967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6a9a523-f2c3-47ac-ba31-06a300ed2586 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:03.755980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6a9a523-f2c3-47ac-ba31-06a300ed2586 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:03.756674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6a9a523-f2c3-47ac-ba31-06a300ed2586 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:03.757123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6a9a523-f2c3-47ac-ba31-06a300ed2586 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:03.757538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6a9a523-f2c3-47ac-ba31-06a300ed2586 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:03.785912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f6a9a523-f2c3-47ac-ba31-06a300ed2586 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 Aug 24 06:21:03.789957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 318/640] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:03 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:04.720644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-edc11105-02ce-42a8-be64-add68d54f7c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:04.722937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-edc11105-02ce-42a8-be64-add68d54f7c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:04.730181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-edc11105-02ce-42a8-be64-add68d54f7c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:04.730656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-edc11105-02ce-42a8-be64-add68d54f7c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:04.731077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-edc11105-02ce-42a8-be64-add68d54f7c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:04.731796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-edc11105-02ce-42a8-be64-add68d54f7c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:04.732238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-edc11105-02ce-42a8-be64-add68d54f7c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:04.732707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-edc11105-02ce-42a8-be64-add68d54f7c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:04.762907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-edc11105-02ce-42a8-be64-add68d54f7c3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046314 Aug 24 06:21:04.763472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 323/641] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:04 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:04.799950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0542d466-e76a-4ceb-990d-216506841ec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:04.802165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0542d466-e76a-4ceb-990d-216506841ec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:04.808970 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0542d466-e76a-4ceb-990d-216506841ec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:04.809476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0542d466-e76a-4ceb-990d-216506841ec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:04.809903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0542d466-e76a-4ceb-990d-216506841ec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:04.810590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0542d466-e76a-4ceb-990d-216506841ec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:04.811037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0542d466-e76a-4ceb-990d-216506841ec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:04.811452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0542d466-e76a-4ceb-990d-216506841ec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:04.844260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0542d466-e76a-4ceb-990d-216506841ec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048233 Aug 24 06:21:04.844870 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 319/642] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:05.775462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ea333228-a725-41fa-b138-9f6238581b59 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:05.777586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ea333228-a725-41fa-b138-9f6238581b59 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:05.783915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea333228-a725-41fa-b138-9f6238581b59 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:05.784391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea333228-a725-41fa-b138-9f6238581b59 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:05.784856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea333228-a725-41fa-b138-9f6238581b59 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:05.785543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea333228-a725-41fa-b138-9f6238581b59 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:05.785986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea333228-a725-41fa-b138-9f6238581b59 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:05.786898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea333228-a725-41fa-b138-9f6238581b59 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:05.819015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ea333228-a725-41fa-b138-9f6238581b59 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047520 Aug 24 06:21:05.819572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 324/643] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:05.856023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ae1b623d-ed8b-43a8-8f64-06bab016b4b2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:05.858264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ae1b623d-ed8b-43a8-8f64-06bab016b4b2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:05.865364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae1b623d-ed8b-43a8-8f64-06bab016b4b2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:05.865834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae1b623d-ed8b-43a8-8f64-06bab016b4b2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:05.866254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae1b623d-ed8b-43a8-8f64-06bab016b4b2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:05.866934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae1b623d-ed8b-43a8-8f64-06bab016b4b2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:05.867378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae1b623d-ed8b-43a8-8f64-06bab016b4b2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:05.867788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae1b623d-ed8b-43a8-8f64-06bab016b4b2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:05.896930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ae1b623d-ed8b-43a8-8f64-06bab016b4b2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Aug 24 06:21:05.897499 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 320/644] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:06.831396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c29cb31d-ee33-4705-9660-9e524e5d3290 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:06.833664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c29cb31d-ee33-4705-9660-9e524e5d3290 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:06.839940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c29cb31d-ee33-4705-9660-9e524e5d3290 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:06.840415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c29cb31d-ee33-4705-9660-9e524e5d3290 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:06.840867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c29cb31d-ee33-4705-9660-9e524e5d3290 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:06.841552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c29cb31d-ee33-4705-9660-9e524e5d3290 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:06.841994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c29cb31d-ee33-4705-9660-9e524e5d3290 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:06.842404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c29cb31d-ee33-4705-9660-9e524e5d3290 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:06.872893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c29cb31d-ee33-4705-9660-9e524e5d3290 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045409 Aug 24 06:21:06.873455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 325/645] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:06.909325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9f455a0d-644e-45db-a14e-ac1ed9efd13a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:06.911543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9f455a0d-644e-45db-a14e-ac1ed9efd13a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:06.918124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f455a0d-644e-45db-a14e-ac1ed9efd13a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:06.918124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f455a0d-644e-45db-a14e-ac1ed9efd13a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:06.919017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f455a0d-644e-45db-a14e-ac1ed9efd13a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:06.919705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f455a0d-644e-45db-a14e-ac1ed9efd13a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:06.920147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f455a0d-644e-45db-a14e-ac1ed9efd13a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:06.920586 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f455a0d-644e-45db-a14e-ac1ed9efd13a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:06.952897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9f455a0d-644e-45db-a14e-ac1ed9efd13a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047270 Aug 24 06:21:06.953383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 321/646] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:07.886357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-daa9d24e-1fc7-4128-bb80-5379eadbf85b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:07.888449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-daa9d24e-1fc7-4128-bb80-5379eadbf85b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:07.895047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-daa9d24e-1fc7-4128-bb80-5379eadbf85b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:07.895528 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-daa9d24e-1fc7-4128-bb80-5379eadbf85b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:07.895958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-daa9d24e-1fc7-4128-bb80-5379eadbf85b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:07.897296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-daa9d24e-1fc7-4128-bb80-5379eadbf85b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:07.897755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-daa9d24e-1fc7-4128-bb80-5379eadbf85b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:07.898184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-daa9d24e-1fc7-4128-bb80-5379eadbf85b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:07.932372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-daa9d24e-1fc7-4128-bb80-5379eadbf85b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050052 Aug 24 06:21:07.932975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 326/647] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:07 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:07.966271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7b5ed362-51ac-47f1-89b9-2fccf98f01fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:07.968299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7b5ed362-51ac-47f1-89b9-2fccf98f01fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:07.974680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b5ed362-51ac-47f1-89b9-2fccf98f01fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:07.975150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b5ed362-51ac-47f1-89b9-2fccf98f01fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:07.975574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b5ed362-51ac-47f1-89b9-2fccf98f01fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:07.976278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b5ed362-51ac-47f1-89b9-2fccf98f01fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:07.976753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b5ed362-51ac-47f1-89b9-2fccf98f01fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:07.977165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b5ed362-51ac-47f1-89b9-2fccf98f01fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:08.007012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7b5ed362-51ac-47f1-89b9-2fccf98f01fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Aug 24 06:21:08.007571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 322/648] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:08.946674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-37b40dc2-c616-4e1b-94fc-6bf1affcf209 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:08.948849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-37b40dc2-c616-4e1b-94fc-6bf1affcf209 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:08.955448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-37b40dc2-c616-4e1b-94fc-6bf1affcf209 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:08.955761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-37b40dc2-c616-4e1b-94fc-6bf1affcf209 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:08.956195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-37b40dc2-c616-4e1b-94fc-6bf1affcf209 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:08.956918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-37b40dc2-c616-4e1b-94fc-6bf1affcf209 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:08.957369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-37b40dc2-c616-4e1b-94fc-6bf1affcf209 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:08.957788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-37b40dc2-c616-4e1b-94fc-6bf1affcf209 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:08.988652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-37b40dc2-c616-4e1b-94fc-6bf1affcf209 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046149 Aug 24 06:21:08.989212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 327/649] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:09.019544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bb0fca1f-d7b6-41a7-8d04-1a09325b63f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:09.022336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bb0fca1f-d7b6-41a7-8d04-1a09325b63f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:09.028916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb0fca1f-d7b6-41a7-8d04-1a09325b63f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:09.029391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb0fca1f-d7b6-41a7-8d04-1a09325b63f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:09.029816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb0fca1f-d7b6-41a7-8d04-1a09325b63f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:09.030539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb0fca1f-d7b6-41a7-8d04-1a09325b63f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:09.030983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb0fca1f-d7b6-41a7-8d04-1a09325b63f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:09.031392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb0fca1f-d7b6-41a7-8d04-1a09325b63f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:09.063318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bb0fca1f-d7b6-41a7-8d04-1a09325b63f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047711 Aug 24 06:21:09.063882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 323/650] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:09 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:10.001535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-797dc434-6e99-4b24-a8e3-d80da280f6bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:10.003769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-797dc434-6e99-4b24-a8e3-d80da280f6bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:10.010871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-797dc434-6e99-4b24-a8e3-d80da280f6bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:10.011348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-797dc434-6e99-4b24-a8e3-d80da280f6bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:10.011778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-797dc434-6e99-4b24-a8e3-d80da280f6bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:10.012472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-797dc434-6e99-4b24-a8e3-d80da280f6bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:10.013138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-797dc434-6e99-4b24-a8e3-d80da280f6bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:10.013353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-797dc434-6e99-4b24-a8e3-d80da280f6bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:10.044329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-797dc434-6e99-4b24-a8e3-d80da280f6bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046739 Aug 24 06:21:10.044927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 328/651] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:10.075237 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3cb0ad3e-cfc8-436c-a8a7-e1f2958284d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:10.077403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3cb0ad3e-cfc8-436c-a8a7-e1f2958284d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:10.083846 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3cb0ad3e-cfc8-436c-a8a7-e1f2958284d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:10.084353 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3cb0ad3e-cfc8-436c-a8a7-e1f2958284d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:10.084816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3cb0ad3e-cfc8-436c-a8a7-e1f2958284d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:10.085492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3cb0ad3e-cfc8-436c-a8a7-e1f2958284d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:10.085934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3cb0ad3e-cfc8-436c-a8a7-e1f2958284d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:10.086345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3cb0ad3e-cfc8-436c-a8a7-e1f2958284d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:10.118125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3cb0ad3e-cfc8-436c-a8a7-e1f2958284d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046768 Aug 24 06:21:10.118696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 324/652] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:10 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:10.743970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e57b83fc-3bbe-4b3e-97f4-8f844f806c9c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec3de077-a3da-4607-9bbe-0c585f3afcad"}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:21:10.746340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e57b83fc-3bbe-4b3e-97f4-8f844f806c9c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:10.752347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e57b83fc-3bbe-4b3e-97f4-8f844f806c9c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:10.752862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e57b83fc-3bbe-4b3e-97f4-8f844f806c9c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:10.753282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e57b83fc-3bbe-4b3e-97f4-8f844f806c9c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:10.753963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e57b83fc-3bbe-4b3e-97f4-8f844f806c9c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:10.754432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e57b83fc-3bbe-4b3e-97f4-8f844f806c9c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:10.754849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e57b83fc-3bbe-4b3e-97f4-8f844f806c9c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:11.056575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-58a71f8d-42ff-48cc-aefa-41c97818c398 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:11.059131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-58a71f8d-42ff-48cc-aefa-41c97818c398 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:11.064702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58a71f8d-42ff-48cc-aefa-41c97818c398 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:11.065182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58a71f8d-42ff-48cc-aefa-41c97818c398 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:11.065610 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58a71f8d-42ff-48cc-aefa-41c97818c398 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:11.066300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58a71f8d-42ff-48cc-aefa-41c97818c398 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:11.066749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58a71f8d-42ff-48cc-aefa-41c97818c398 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:11.067170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58a71f8d-42ff-48cc-aefa-41c97818c398 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:11.098083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-58a71f8d-42ff-48cc-aefa-41c97818c398 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045628 Aug 24 06:21:11.098795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 325/653] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:11.131470 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4a6ae758-98d6-402e-8fd5-8bde6c3463a7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:11.133720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4a6ae758-98d6-402e-8fd5-8bde6c3463a7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:11.139796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ae758-98d6-402e-8fd5-8bde6c3463a7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:11.140272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ae758-98d6-402e-8fd5-8bde6c3463a7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:11.140734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ae758-98d6-402e-8fd5-8bde6c3463a7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:11.141426 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ae758-98d6-402e-8fd5-8bde6c3463a7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:11.141876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ae758-98d6-402e-8fd5-8bde6c3463a7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:11.142296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a6ae758-98d6-402e-8fd5-8bde6c3463a7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:11.172351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4a6ae758-98d6-402e-8fd5-8bde6c3463a7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045321 Aug 24 06:21:11.172951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 326/654] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:11.413449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e57b83fc-3bbe-4b3e-97f4-8f844f806c9c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "POST /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673302 Aug 24 06:21:11.414067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 329/655] 10.222.0.62 () {60 vars in 1323 bytes} [Wed Aug 24 06:21:10 2022] POST /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:12.112458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-869b61c3-0ab9-478c-82eb-9feabf403c95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:12.114599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-869b61c3-0ab9-478c-82eb-9feabf403c95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:12.121198 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-869b61c3-0ab9-478c-82eb-9feabf403c95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:12.121679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-869b61c3-0ab9-478c-82eb-9feabf403c95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:12.122112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-869b61c3-0ab9-478c-82eb-9feabf403c95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:12.122805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-869b61c3-0ab9-478c-82eb-9feabf403c95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:12.123248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-869b61c3-0ab9-478c-82eb-9feabf403c95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:12.123662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-869b61c3-0ab9-478c-82eb-9feabf403c95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:12.154819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-869b61c3-0ab9-478c-82eb-9feabf403c95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046237 Aug 24 06:21:12.155383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 327/656] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:12.185681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-57dd9cf5-201c-4c48-91b4-c8d48b736150 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:12.187950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-57dd9cf5-201c-4c48-91b4-c8d48b736150 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:12.194174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57dd9cf5-201c-4c48-91b4-c8d48b736150 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:12.194651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57dd9cf5-201c-4c48-91b4-c8d48b736150 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:12.195083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57dd9cf5-201c-4c48-91b4-c8d48b736150 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:12.195773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57dd9cf5-201c-4c48-91b4-c8d48b736150 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:12.196219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57dd9cf5-201c-4c48-91b4-c8d48b736150 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:12.196671 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57dd9cf5-201c-4c48-91b4-c8d48b736150 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:12.226664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-57dd9cf5-201c-4c48-91b4-c8d48b736150 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Aug 24 06:21:12.227226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 330/657] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:13.167769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-571af8bb-caf0-4e74-ae3b-90bc227eb921 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:13.170020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-571af8bb-caf0-4e74-ae3b-90bc227eb921 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:13.172562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=64 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:13.177283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-571af8bb-caf0-4e74-ae3b-90bc227eb921 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:13.178355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-571af8bb-caf0-4e74-ae3b-90bc227eb921 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:13.178787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-571af8bb-caf0-4e74-ae3b-90bc227eb921 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:13.179590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-571af8bb-caf0-4e74-ae3b-90bc227eb921 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:13.180047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-571af8bb-caf0-4e74-ae3b-90bc227eb921 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:13.180463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-571af8bb-caf0-4e74-ae3b-90bc227eb921 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:13.225678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-571af8bb-caf0-4e74-ae3b-90bc227eb921 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061819 Aug 24 06:21:13.226233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 328/658] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:13 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:13.238280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2fdffa0c-1962-4cb4-949a-b356a291a16d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:13.241114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2fdffa0c-1962-4cb4-949a-b356a291a16d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:13.247571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2fdffa0c-1962-4cb4-949a-b356a291a16d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:13.248049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2fdffa0c-1962-4cb4-949a-b356a291a16d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:13.248480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2fdffa0c-1962-4cb4-949a-b356a291a16d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:13.249194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2fdffa0c-1962-4cb4-949a-b356a291a16d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:13.249641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2fdffa0c-1962-4cb4-949a-b356a291a16d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:13.250068 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2fdffa0c-1962-4cb4-949a-b356a291a16d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:13.279413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2fdffa0c-1962-4cb4-949a-b356a291a16d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Aug 24 06:21:13.279978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 331/659] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:14.238137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2c2ea7a0-9750-4341-9cf6-d88ba3eb200f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:14.241970 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2c2ea7a0-9750-4341-9cf6-d88ba3eb200f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:14.247911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c2ea7a0-9750-4341-9cf6-d88ba3eb200f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:14.248396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c2ea7a0-9750-4341-9cf6-d88ba3eb200f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:14.248859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c2ea7a0-9750-4341-9cf6-d88ba3eb200f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:14.249570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c2ea7a0-9750-4341-9cf6-d88ba3eb200f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:14.250023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c2ea7a0-9750-4341-9cf6-d88ba3eb200f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:14.250436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c2ea7a0-9750-4341-9cf6-d88ba3eb200f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:14.282403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2c2ea7a0-9750-4341-9cf6-d88ba3eb200f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048158 Aug 24 06:21:14.282965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 329/660] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:14.292433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-89d7c544-cf3b-4b98-85a2-2c5c290ba1db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:14.294656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-89d7c544-cf3b-4b98-85a2-2c5c290ba1db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:14.300827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-89d7c544-cf3b-4b98-85a2-2c5c290ba1db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:14.301315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-89d7c544-cf3b-4b98-85a2-2c5c290ba1db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:14.301750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-89d7c544-cf3b-4b98-85a2-2c5c290ba1db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:14.303196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-89d7c544-cf3b-4b98-85a2-2c5c290ba1db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:14.303654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-89d7c544-cf3b-4b98-85a2-2c5c290ba1db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:14.304082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-89d7c544-cf3b-4b98-85a2-2c5c290ba1db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:14.334529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-89d7c544-cf3b-4b98-85a2-2c5c290ba1db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046848 Aug 24 06:21:14.335090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 332/661] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:15.294618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2fc74f8e-c283-4101-885d-5c6c1299b5fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:15.296885 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2fc74f8e-c283-4101-885d-5c6c1299b5fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:15.303530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fc74f8e-c283-4101-885d-5c6c1299b5fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:15.304001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fc74f8e-c283-4101-885d-5c6c1299b5fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:15.304427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fc74f8e-c283-4101-885d-5c6c1299b5fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:15.305152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fc74f8e-c283-4101-885d-5c6c1299b5fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:15.305603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fc74f8e-c283-4101-885d-5c6c1299b5fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:15.306019 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fc74f8e-c283-4101-885d-5c6c1299b5fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:15.330322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:15.335627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2fc74f8e-c283-4101-885d-5c6c1299b5fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044995 Aug 24 06:21:15.336180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 330/662] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:15.346830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-dc8e4c7c-5d5a-4e17-9755-eb8e02a3912d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:15.348973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-dc8e4c7c-5d5a-4e17-9755-eb8e02a3912d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:15.355273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc8e4c7c-5d5a-4e17-9755-eb8e02a3912d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:15.355746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc8e4c7c-5d5a-4e17-9755-eb8e02a3912d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:15.356176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc8e4c7c-5d5a-4e17-9755-eb8e02a3912d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:15.356886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc8e4c7c-5d5a-4e17-9755-eb8e02a3912d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:15.357336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc8e4c7c-5d5a-4e17-9755-eb8e02a3912d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:15.357755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc8e4c7c-5d5a-4e17-9755-eb8e02a3912d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:15.386588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-dc8e4c7c-5d5a-4e17-9755-eb8e02a3912d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043639 Aug 24 06:21:15.387136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 333/663] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:15 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:16.351840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-82683abe-c428-4833-927b-c8c893da63d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:16.353953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-82683abe-c428-4833-927b-c8c893da63d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:16.360338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82683abe-c428-4833-927b-c8c893da63d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:16.360830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82683abe-c428-4833-927b-c8c893da63d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:16.361253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82683abe-c428-4833-927b-c8c893da63d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:16.361933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82683abe-c428-4833-927b-c8c893da63d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:16.362378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82683abe-c428-4833-927b-c8c893da63d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:16.362787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82683abe-c428-4833-927b-c8c893da63d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:16.391936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-82683abe-c428-4833-927b-c8c893da63d3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044843 Aug 24 06:21:16.392507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 331/664] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:16 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:16.399204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f4c65685-d250-4c1b-938a-c1b9fc63bc12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:16.401345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f4c65685-d250-4c1b-938a-c1b9fc63bc12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:16.408017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4c65685-d250-4c1b-938a-c1b9fc63bc12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:16.408584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4c65685-d250-4c1b-938a-c1b9fc63bc12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:16.409061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4c65685-d250-4c1b-938a-c1b9fc63bc12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:16.409820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4c65685-d250-4c1b-938a-c1b9fc63bc12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:16.410309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4c65685-d250-4c1b-938a-c1b9fc63bc12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:16.410773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4c65685-d250-4c1b-938a-c1b9fc63bc12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:16.442773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f4c65685-d250-4c1b-938a-c1b9fc63bc12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047675 Aug 24 06:21:16.443373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 334/665] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:17.404286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-01c8bf1a-c371-4f60-b0bd-fddc0e257702 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:17.406471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-01c8bf1a-c371-4f60-b0bd-fddc0e257702 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:17.412957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-01c8bf1a-c371-4f60-b0bd-fddc0e257702 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:17.413434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-01c8bf1a-c371-4f60-b0bd-fddc0e257702 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:17.413865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-01c8bf1a-c371-4f60-b0bd-fddc0e257702 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:17.414573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-01c8bf1a-c371-4f60-b0bd-fddc0e257702 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:17.415021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-01c8bf1a-c371-4f60-b0bd-fddc0e257702 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:17.415435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-01c8bf1a-c371-4f60-b0bd-fddc0e257702 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:17.445706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-01c8bf1a-c371-4f60-b0bd-fddc0e257702 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045335 Aug 24 06:21:17.446322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 332/666] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:17.455279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c24a1984-7ccf-4f1f-bc0a-5fe7c380e6ff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:17.457482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c24a1984-7ccf-4f1f-bc0a-5fe7c380e6ff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:17.463785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c24a1984-7ccf-4f1f-bc0a-5fe7c380e6ff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:17.464256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c24a1984-7ccf-4f1f-bc0a-5fe7c380e6ff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:17.464724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c24a1984-7ccf-4f1f-bc0a-5fe7c380e6ff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:17.465406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c24a1984-7ccf-4f1f-bc0a-5fe7c380e6ff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:17.465846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c24a1984-7ccf-4f1f-bc0a-5fe7c380e6ff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:17.466258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c24a1984-7ccf-4f1f-bc0a-5fe7c380e6ff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:17.495062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c24a1984-7ccf-4f1f-bc0a-5fe7c380e6ff tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043884 Aug 24 06:21:17.495611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 335/667] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:17 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:18.458418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fa671ddf-9a62-4e2d-8ddd-ce947d38c820 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:18.461234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fa671ddf-9a62-4e2d-8ddd-ce947d38c820 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:18.467625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa671ddf-9a62-4e2d-8ddd-ce947d38c820 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:18.472382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa671ddf-9a62-4e2d-8ddd-ce947d38c820 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:18.472382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa671ddf-9a62-4e2d-8ddd-ce947d38c820 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:18.472382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa671ddf-9a62-4e2d-8ddd-ce947d38c820 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:18.472382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa671ddf-9a62-4e2d-8ddd-ce947d38c820 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:18.472820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa671ddf-9a62-4e2d-8ddd-ce947d38c820 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:18.498991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fa671ddf-9a62-4e2d-8ddd-ce947d38c820 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044470 Aug 24 06:21:18.499556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 333/668] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:18.507922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0a1b5bab-fd34-48ed-b2b4-a733c41669e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:18.510112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0a1b5bab-fd34-48ed-b2b4-a733c41669e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:18.516757 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a1b5bab-fd34-48ed-b2b4-a733c41669e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:18.518719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a1b5bab-fd34-48ed-b2b4-a733c41669e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:18.518719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a1b5bab-fd34-48ed-b2b4-a733c41669e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:18.518719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a1b5bab-fd34-48ed-b2b4-a733c41669e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:18.519066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a1b5bab-fd34-48ed-b2b4-a733c41669e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:18.519274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a1b5bab-fd34-48ed-b2b4-a733c41669e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:18.548705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0a1b5bab-fd34-48ed-b2b4-a733c41669e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045301 Aug 24 06:21:18.549265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 336/669] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:18.884069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-44165c10-47ac-4d50-a491-ac35ca9d4b4c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:18.886199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-44165c10-47ac-4d50-a491-ac35ca9d4b4c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:18.892370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44165c10-47ac-4d50-a491-ac35ca9d4b4c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:18.892874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44165c10-47ac-4d50-a491-ac35ca9d4b4c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:18.893298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44165c10-47ac-4d50-a491-ac35ca9d4b4c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:18.893972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44165c10-47ac-4d50-a491-ac35ca9d4b4c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:18.894414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44165c10-47ac-4d50-a491-ac35ca9d4b4c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:18.894829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44165c10-47ac-4d50-a491-ac35ca9d4b4c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:18.922991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-44165c10-47ac-4d50-a491-ac35ca9d4b4c tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043974 Aug 24 06:21:18.923564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 334/670] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:18 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 06:21:18.986529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8377359d-ce86-4bf7-9fb8-5b32f5fc602b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:18.987026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8377359d-ce86-4bf7-9fb8-5b32f5fc602b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:18.993719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8377359d-ce86-4bf7-9fb8-5b32f5fc602b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:18.994203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8377359d-ce86-4bf7-9fb8-5b32f5fc602b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:18.994641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8377359d-ce86-4bf7-9fb8-5b32f5fc602b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:18.995334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8377359d-ce86-4bf7-9fb8-5b32f5fc602b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:18.995796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8377359d-ce86-4bf7-9fb8-5b32f5fc602b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:18.996219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8377359d-ce86-4bf7-9fb8-5b32f5fc602b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:19.000357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:19.024008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8377359d-ce86-4bf7-9fb8-5b32f5fc602b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:21:19.261439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8377359d-ce86-4bf7-9fb8-5b32f5fc602b tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 204 len: 0 microversion: 2.1 time: 0.278584 Aug 24 06:21:19.261951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 337/671] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:21:18 2022] DELETE /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:21:19.270388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-add0dcc6-0363-49c6-a643-db1dddf41588 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:19.271005 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-add0dcc6-0363-49c6-a643-db1dddf41588 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:19.277907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-add0dcc6-0363-49c6-a643-db1dddf41588 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:19.278484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-add0dcc6-0363-49c6-a643-db1dddf41588 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:19.280699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-add0dcc6-0363-49c6-a643-db1dddf41588 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:19.280699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-add0dcc6-0363-49c6-a643-db1dddf41588 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:19.280699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-add0dcc6-0363-49c6-a643-db1dddf41588 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:19.280699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-add0dcc6-0363-49c6-a643-db1dddf41588 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:19.409978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-add0dcc6-0363-49c6-a643-db1dddf41588 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:19.418407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-add0dcc6-0363-49c6-a643-db1dddf41588 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1671 microversion: 2.1 time: 0.152013 Aug 24 06:21:19.419049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 335/672] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:19 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:19.512069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-868ccd3d-a576-4d0b-a2d3-ffcbf3fdeb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:19.514291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-868ccd3d-a576-4d0b-a2d3-ffcbf3fdeb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:19.520777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868ccd3d-a576-4d0b-a2d3-ffcbf3fdeb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:19.521247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868ccd3d-a576-4d0b-a2d3-ffcbf3fdeb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:19.522174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868ccd3d-a576-4d0b-a2d3-ffcbf3fdeb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:19.522851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868ccd3d-a576-4d0b-a2d3-ffcbf3fdeb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:19.523380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868ccd3d-a576-4d0b-a2d3-ffcbf3fdeb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:19.523796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868ccd3d-a576-4d0b-a2d3-ffcbf3fdeb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:19.553025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-868ccd3d-a576-4d0b-a2d3-ffcbf3fdeb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045253 Aug 24 06:21:19.553589 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 338/673] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:19.561288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-662a2099-1c38-4b42-8484-798130c7fd27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:19.563497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-662a2099-1c38-4b42-8484-798130c7fd27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:19.569896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-662a2099-1c38-4b42-8484-798130c7fd27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:19.570372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-662a2099-1c38-4b42-8484-798130c7fd27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:19.570802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-662a2099-1c38-4b42-8484-798130c7fd27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:19.571486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-662a2099-1c38-4b42-8484-798130c7fd27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:19.571936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-662a2099-1c38-4b42-8484-798130c7fd27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:19.572357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-662a2099-1c38-4b42-8484-798130c7fd27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:19.601879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-662a2099-1c38-4b42-8484-798130c7fd27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Aug 24 06:21:19.602433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 336/674] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:20.439968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ccf1b6d0-6bc0-4139-bad4-ca11397b56e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:20.440593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ccf1b6d0-6bc0-4139-bad4-ca11397b56e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:20.447159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf1b6d0-6bc0-4139-bad4-ca11397b56e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:20.447630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf1b6d0-6bc0-4139-bad4-ca11397b56e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:20.448054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf1b6d0-6bc0-4139-bad4-ca11397b56e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:20.448771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf1b6d0-6bc0-4139-bad4-ca11397b56e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:20.449217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf1b6d0-6bc0-4139-bad4-ca11397b56e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:20.449628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccf1b6d0-6bc0-4139-bad4-ca11397b56e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:20.565453 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b554d183-b3b1-46eb-9404-468c1e1caddf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:20.567676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b554d183-b3b1-46eb-9404-468c1e1caddf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:20.574103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b554d183-b3b1-46eb-9404-468c1e1caddf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:20.579253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b554d183-b3b1-46eb-9404-468c1e1caddf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:20.579253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b554d183-b3b1-46eb-9404-468c1e1caddf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:20.579253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b554d183-b3b1-46eb-9404-468c1e1caddf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:20.579253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b554d183-b3b1-46eb-9404-468c1e1caddf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:20.579634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b554d183-b3b1-46eb-9404-468c1e1caddf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:20.584327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ccf1b6d0-6bc0-4139-bad4-ca11397b56e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:20.592229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ccf1b6d0-6bc0-4139-bad4-ca11397b56e4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1671 microversion: 2.1 time: 0.156073 Aug 24 06:21:20.592839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 339/675] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:20 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:20.606492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b554d183-b3b1-46eb-9404-468c1e1caddf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044869 Aug 24 06:21:20.606861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 337/676] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:20 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:20.613992 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-44c281ac-0d8a-4bd9-9819-44716cdf5db9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:20.617044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-44c281ac-0d8a-4bd9-9819-44716cdf5db9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:20.623041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44c281ac-0d8a-4bd9-9819-44716cdf5db9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:20.623506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44c281ac-0d8a-4bd9-9819-44716cdf5db9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:20.623938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44c281ac-0d8a-4bd9-9819-44716cdf5db9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:20.624700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44c281ac-0d8a-4bd9-9819-44716cdf5db9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:20.625149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44c281ac-0d8a-4bd9-9819-44716cdf5db9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:20.625569 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44c281ac-0d8a-4bd9-9819-44716cdf5db9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:20.653700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-44c281ac-0d8a-4bd9-9819-44716cdf5db9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Aug 24 06:21:20.654247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 340/677] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:21.613769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dfd068a4-1ae4-4285-a001-9b545359463e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:21.614445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dfd068a4-1ae4-4285-a001-9b545359463e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:21.619150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-eea3e76f-26d6-4771-abc0-9c73594ba965 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:21.621309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-eea3e76f-26d6-4771-abc0-9c73594ba965 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:21.621674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dfd068a4-1ae4-4285-a001-9b545359463e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:21.622161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dfd068a4-1ae4-4285-a001-9b545359463e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:21.622591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dfd068a4-1ae4-4285-a001-9b545359463e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:21.623293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dfd068a4-1ae4-4285-a001-9b545359463e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:21.623743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dfd068a4-1ae4-4285-a001-9b545359463e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:21.624161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dfd068a4-1ae4-4285-a001-9b545359463e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:21.629328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eea3e76f-26d6-4771-abc0-9c73594ba965 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:21.629328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eea3e76f-26d6-4771-abc0-9c73594ba965 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:21.629328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eea3e76f-26d6-4771-abc0-9c73594ba965 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:21.629803 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eea3e76f-26d6-4771-abc0-9c73594ba965 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:21.630676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eea3e76f-26d6-4771-abc0-9c73594ba965 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:21.631101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eea3e76f-26d6-4771-abc0-9c73594ba965 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:21.662197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-eea3e76f-26d6-4771-abc0-9c73594ba965 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047621 Aug 24 06:21:21.662811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 341/678] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:21.667919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e377f2cc-9134-41a4-8a04-7c278f9860d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:21.670061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e377f2cc-9134-41a4-8a04-7c278f9860d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:21.675971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e377f2cc-9134-41a4-8a04-7c278f9860d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:21.676450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e377f2cc-9134-41a4-8a04-7c278f9860d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:21.676908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e377f2cc-9134-41a4-8a04-7c278f9860d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:21.677598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e377f2cc-9134-41a4-8a04-7c278f9860d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:21.678342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e377f2cc-9134-41a4-8a04-7c278f9860d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:21.678760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e377f2cc-9134-41a4-8a04-7c278f9860d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:21.708729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e377f2cc-9134-41a4-8a04-7c278f9860d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044116 Aug 24 06:21:21.711816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 342/679] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:21 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:21.764001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dfd068a4-1ae4-4285-a001-9b545359463e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:21.772881 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dfd068a4-1ae4-4285-a001-9b545359463e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1671 microversion: 2.1 time: 0.162683 Aug 24 06:21:21.773454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 338/680] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:21 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:21:22.020636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-638f5fa6-a0e4-460d-afa0-95cc4656b345 req-e339eb7a-a6bb-460d-ab9e-13edce554389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5950cfdd-41b3-4842-81ab-e6507515a4a2", "name": "network-vif-deleted", "tag": "fcdb5142-a706-43a9-9c46-6ef15b217519"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:21:22.030533 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-638f5fa6-a0e4-460d-afa0-95cc4656b345 req-e339eb7a-a6bb-460d-ab9e-13edce554389 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:22.031007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-638f5fa6-a0e4-460d-afa0-95cc4656b345 req-e339eb7a-a6bb-460d-ab9e-13edce554389 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:22.031433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-638f5fa6-a0e4-460d-afa0-95cc4656b345 req-e339eb7a-a6bb-460d-ab9e-13edce554389 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:22.043510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-638f5fa6-a0e4-460d-afa0-95cc4656b345 req-e339eb7a-a6bb-460d-ab9e-13edce554389 service nova] Creating event network-vif-deleted:fcdb5142-a706-43a9-9c46-6ef15b217519 for instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 on hv-cinder-85426 Aug 24 06:21:22.049873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-638f5fa6-a0e4-460d-afa0-95cc4656b345 req-e339eb7a-a6bb-460d-ab9e-13edce554389 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031471 Aug 24 06:21:22.049873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 343/681] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:22.675363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3a5cc954-647e-4cb7-a11f-b717b11429a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:22.677531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3a5cc954-647e-4cb7-a11f-b717b11429a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:22.685017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a5cc954-647e-4cb7-a11f-b717b11429a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:22.685568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a5cc954-647e-4cb7-a11f-b717b11429a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:22.685953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a5cc954-647e-4cb7-a11f-b717b11429a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:22.686630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a5cc954-647e-4cb7-a11f-b717b11429a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:22.687102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a5cc954-647e-4cb7-a11f-b717b11429a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:22.687530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a5cc954-647e-4cb7-a11f-b717b11429a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:22.719561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3a5cc954-647e-4cb7-a11f-b717b11429a7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048121 Aug 24 06:21:22.720148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 339/682] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:22 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:22.722021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9ced9226-6c03-4975-8946-de0044d5332d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:22.724444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9ced9226-6c03-4975-8946-de0044d5332d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:22.730931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ced9226-6c03-4975-8946-de0044d5332d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:22.731448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ced9226-6c03-4975-8946-de0044d5332d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:22.731884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ced9226-6c03-4975-8946-de0044d5332d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:22.732650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ced9226-6c03-4975-8946-de0044d5332d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:22.733098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ced9226-6c03-4975-8946-de0044d5332d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:22.733519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ced9226-6c03-4975-8946-de0044d5332d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:22.764995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9ced9226-6c03-4975-8946-de0044d5332d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048015 Aug 24 06:21:22.765577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 344/683] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:22.794226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:22.794844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:22.801827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:22.802324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:22.802757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:22.804272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:22.804754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:22.805176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:22.839080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:22.839711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:22.840150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:22.840831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lazy-loading 'fault' on Instance uuid 5950cfdd-41b3-4842-81ab-e6507515a4a2 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:21:22.883762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:22.892836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3c47a5a5-8f19-4d60-911d-9325d8a4142f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 200 len: 1326 microversion: 2.1 time: 0.102378 Aug 24 06:21:22.893800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 340/684] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:22 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 1326 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:23.732295 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d33744ad-94bb-46e5-9af6-2cf0e814771a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:23.734434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d33744ad-94bb-46e5-9af6-2cf0e814771a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:23.740885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d33744ad-94bb-46e5-9af6-2cf0e814771a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:23.741392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d33744ad-94bb-46e5-9af6-2cf0e814771a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:23.741827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d33744ad-94bb-46e5-9af6-2cf0e814771a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:23.742512 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d33744ad-94bb-46e5-9af6-2cf0e814771a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:23.742962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d33744ad-94bb-46e5-9af6-2cf0e814771a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:23.743382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d33744ad-94bb-46e5-9af6-2cf0e814771a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:23.772088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d33744ad-94bb-46e5-9af6-2cf0e814771a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043730 Aug 24 06:21:23.773373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 345/685] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:23.778033 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-93fbb467-2615-4d43-b44d-c2ee9e635208 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:23.780160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-93fbb467-2615-4d43-b44d-c2ee9e635208 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:23.786754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb467-2615-4d43-b44d-c2ee9e635208 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:23.787224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb467-2615-4d43-b44d-c2ee9e635208 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:23.787650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb467-2615-4d43-b44d-c2ee9e635208 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:23.788319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb467-2615-4d43-b44d-c2ee9e635208 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:23.788805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb467-2615-4d43-b44d-c2ee9e635208 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:23.789201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fbb467-2615-4d43-b44d-c2ee9e635208 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:23.817615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-93fbb467-2615-4d43-b44d-c2ee9e635208 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043659 Aug 24 06:21:23.818150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 341/686] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:23 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:23.915309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:23.915910 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:23.921998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:23.922467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:23.922896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:23.923573 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:23.924018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:23.924431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:23.938419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] HTTP exception thrown: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Request method failure captured: Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 HTTP/1.1 Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcI_I9huvEuUVzRrBxRPdTG5qqUGpAdOvZQwpwndKekqpzx6nxYwOufm6cj1diqelUoat7BmXfCuCCyfQbzUbJH2Ne0wS3vk3thmsR_zFKt8mIthbCrQxYL6szHbAdh8cneu1yTM3W9rwToG1VfOG6HV0xiq0AWyQLRFhlAE9aP36Wc Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:21:23.940101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ff194aa4a2d744caaa09e0ceee54b1d2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 25908fb02f7f46f5b9e483811302a67e Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:21:23.941733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '5950cfdd-41b3-4842-81ab-e6507515a4a2'} Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:21:23.942702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:21:23.944218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:21:23.946281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Returning 404 to user: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:21:23.946281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c0f5e541-7c05-44de-8563-7ccb8f34b7f4 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 404 len: 111 microversion: 2.1 time: 0.030140 Aug 24 06:21:23.946281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 346/687] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:23 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:21:23.950861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ff4e19fb-e617-4b87-80ec-41a6c2d66f26 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '.version_select at 0x7fcddc179310>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:24.016287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ff4e19fb-e617-4b87-80ec-41a6c2d66f26 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-636509281" status: 202 len: 0 microversion: 2.1 time: 0.069047 Aug 24 06:21:24.016852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 342/688] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Aug 24 06:21:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-636509281 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:21:24.784983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2a4cb8d2-626f-40fb-95ed-0b24297dd997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:24.787128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2a4cb8d2-626f-40fb-95ed-0b24297dd997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:24.793788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8d2-626f-40fb-95ed-0b24297dd997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:24.794272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8d2-626f-40fb-95ed-0b24297dd997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:24.794706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8d2-626f-40fb-95ed-0b24297dd997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:24.795391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8d2-626f-40fb-95ed-0b24297dd997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:24.795841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8d2-626f-40fb-95ed-0b24297dd997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:24.796260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a4cb8d2-626f-40fb-95ed-0b24297dd997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:24.814992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-df84981e-e2bc-4b05-8441-5f68685c3fea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Action: 'create', calling method: .version_select at 0x7fcddc18ca60>, body: {"keypair": {"name": "tempest-keypair-1500610231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD/olk6FYXz1gfwvzlhGWEiM6rF4A/58YNoho1p0zeyC7YLqZh8mvo3WhEQDpUHs4uIl9f0aznrH8NCchKfwSy2OuRD4tYL7fdR21s25I0AWsF355iupmfLI5PKHjQ6fQ=="}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:21:24.827888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2a4cb8d2-626f-40fb-95ed-0b24297dd997 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046900 Aug 24 06:21:24.828451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 347/689] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:24.832964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7a7fcd4e-519c-4c70-90da-cbb6dfade896 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:24.833644 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-df84981e-e2bc-4b05-8441-5f68685c3fea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Getting quotas for project ff194aa4a2d744caaa09e0ceee54b1d2. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:21:24.835043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7a7fcd4e-519c-4c70-90da-cbb6dfade896 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:24.838310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-df84981e-e2bc-4b05-8441-5f68685c3fea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Getting quotas for user 25908fb02f7f46f5b9e483811302a67e and project ff194aa4a2d744caaa09e0ceee54b1d2. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:21:24.841119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a7fcd4e-519c-4c70-90da-cbb6dfade896 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:24.841600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a7fcd4e-519c-4c70-90da-cbb6dfade896 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:24.842030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a7fcd4e-519c-4c70-90da-cbb6dfade896 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:24.842718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a7fcd4e-519c-4c70-90da-cbb6dfade896 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:24.843171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a7fcd4e-519c-4c70-90da-cbb6dfade896 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:24.843594 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a7fcd4e-519c-4c70-90da-cbb6dfade896 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:24.872768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7a7fcd4e-519c-4c70-90da-cbb6dfade896 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043232 Aug 24 06:21:24.873323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 348/690] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:24.914568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-df84981e-e2bc-4b05-8441-5f68685c3fea tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103320 Aug 24 06:21:24.915196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 343/691] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 24 06:21:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:25.840668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6574b96b-6375-4eba-a3c2-d41e67049d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:25.842824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6574b96b-6375-4eba-a3c2-d41e67049d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:25.849268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6574b96b-6375-4eba-a3c2-d41e67049d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:25.849743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6574b96b-6375-4eba-a3c2-d41e67049d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:25.850179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6574b96b-6375-4eba-a3c2-d41e67049d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:25.850866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6574b96b-6375-4eba-a3c2-d41e67049d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:25.851311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6574b96b-6375-4eba-a3c2-d41e67049d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:25.851730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6574b96b-6375-4eba-a3c2-d41e67049d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:25.883960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6574b96b-6375-4eba-a3c2-d41e67049d93 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047846 Aug 24 06:21:25.884558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 349/692] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:25.885321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0bb5b5f6-aff9-439f-9698-c392f509396c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:25.887989 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0bb5b5f6-aff9-439f-9698-c392f509396c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:25.894508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bb5b5f6-aff9-439f-9698-c392f509396c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:25.898604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bb5b5f6-aff9-439f-9698-c392f509396c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:25.898604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bb5b5f6-aff9-439f-9698-c392f509396c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:25.898604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bb5b5f6-aff9-439f-9698-c392f509396c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:25.898604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bb5b5f6-aff9-439f-9698-c392f509396c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:25.899038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bb5b5f6-aff9-439f-9698-c392f509396c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:25.926250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0bb5b5f6-aff9-439f-9698-c392f509396c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045288 Aug 24 06:21:25.926808 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 344/693] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:25 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:26.896455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-30251999-8cf3-4d7f-a314-7bd787ea512b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:26.898597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-30251999-8cf3-4d7f-a314-7bd787ea512b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:26.912139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30251999-8cf3-4d7f-a314-7bd787ea512b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:26.912139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30251999-8cf3-4d7f-a314-7bd787ea512b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:26.912139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30251999-8cf3-4d7f-a314-7bd787ea512b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:26.912139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30251999-8cf3-4d7f-a314-7bd787ea512b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:26.912557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30251999-8cf3-4d7f-a314-7bd787ea512b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:26.912557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30251999-8cf3-4d7f-a314-7bd787ea512b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:26.938990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d29719b2-f901-449a-ac89-aa14d225cc2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:26.941235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d29719b2-f901-449a-ac89-aa14d225cc2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:26.942160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-30251999-8cf3-4d7f-a314-7bd787ea512b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049568 Aug 24 06:21:26.946860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 350/694] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:26.952226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d29719b2-f901-449a-ac89-aa14d225cc2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:26.952806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d29719b2-f901-449a-ac89-aa14d225cc2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:26.953240 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d29719b2-f901-449a-ac89-aa14d225cc2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:26.953929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d29719b2-f901-449a-ac89-aa14d225cc2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:26.954374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d29719b2-f901-449a-ac89-aa14d225cc2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:26.954787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d29719b2-f901-449a-ac89-aa14d225cc2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:26.974578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1795069466", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4af0a46d-e123-4947-9ac3-12223a01403a"}], "security_groups": [{"name": "tempest-securitygroup--634236581"}], "key_name": "tempest-keypair-1500610231", "user_data": "}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:21:26.985150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d29719b2-f901-449a-ac89-aa14d225cc2a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049991 Aug 24 06:21:26.985719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 345/695] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:27.133629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] validate_networks() for [('4af0a46d-e123-4947-9ac3-12223a01403a', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:21:27.765540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:21:27.765961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:21:27.766432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:21:27.766838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:21:27.767248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:21:27.776444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:27.776945 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:27.777383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:27.778103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:27.778553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:27.778970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:27.796008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Getting quotas for project ff194aa4a2d744caaa09e0ceee54b1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:21:27.799984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Getting quotas for user 25908fb02f7f46f5b9e483811302a67e and project ff194aa4a2d744caaa09e0ceee54b1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:21:27.811544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:21:27.814130 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:21:27.949087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-07c96671-cd45-453f-8ba3-5e9a8eb09418 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.978714 Aug 24 06:21:27.955565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 351/696] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:21:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:21:27.956000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bd1a3638-e52c-4e5e-91c8-560d9be8f5b3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:27.958301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bd1a3638-e52c-4e5e-91c8-560d9be8f5b3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:27.960409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3bce7b4d-9176-4045-884e-88aaca3fd4d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:27.961225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3bce7b4d-9176-4045-884e-88aaca3fd4d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:27.966809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd1a3638-e52c-4e5e-91c8-560d9be8f5b3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:27.967293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd1a3638-e52c-4e5e-91c8-560d9be8f5b3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:27.967720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd1a3638-e52c-4e5e-91c8-560d9be8f5b3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:27.968418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd1a3638-e52c-4e5e-91c8-560d9be8f5b3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:27.968904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd1a3638-e52c-4e5e-91c8-560d9be8f5b3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:27.969326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd1a3638-e52c-4e5e-91c8-560d9be8f5b3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:28.000772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bd1a3638-e52c-4e5e-91c8-560d9be8f5b3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049256 Aug 24 06:21:28.001422 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 346/697] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:28.006764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5e8ba8fc-883e-4c5e-a386-462fb8a1af4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:28.008874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5e8ba8fc-883e-4c5e-a386-462fb8a1af4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:28.015334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ba8fc-883e-4c5e-a386-462fb8a1af4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:28.015840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ba8fc-883e-4c5e-a386-462fb8a1af4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:28.016741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ba8fc-883e-4c5e-a386-462fb8a1af4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:28.017440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ba8fc-883e-4c5e-a386-462fb8a1af4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:28.017888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ba8fc-883e-4c5e-a386-462fb8a1af4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:28.018303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ba8fc-883e-4c5e-a386-462fb8a1af4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:28.019650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3bce7b4d-9176-4045-884e-88aaca3fd4d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:28.029640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3bce7b4d-9176-4045-884e-88aaca3fd4d1 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1238 microversion: 2.1 time: 0.073008 Aug 24 06:21:28.030336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 352/698] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:27 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:28.049558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5e8ba8fc-883e-4c5e-a386-462fb8a1af4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046898 Aug 24 06:21:28.050125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 347/699] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:28 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:29.013979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-24736739-ea31-49d2-a498-3fa68ec6833b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:29.016890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-24736739-ea31-49d2-a498-3fa68ec6833b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:29.023535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24736739-ea31-49d2-a498-3fa68ec6833b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:29.024020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24736739-ea31-49d2-a498-3fa68ec6833b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:29.024455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24736739-ea31-49d2-a498-3fa68ec6833b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:29.025183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24736739-ea31-49d2-a498-3fa68ec6833b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:29.026171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24736739-ea31-49d2-a498-3fa68ec6833b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:29.026599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24736739-ea31-49d2-a498-3fa68ec6833b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:29.049280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9c860c07-fa57-4549-a4a1-30c497d15dcb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:29.049915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9c860c07-fa57-4549-a4a1-30c497d15dcb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:29.057566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-24736739-ea31-49d2-a498-3fa68ec6833b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047760 Aug 24 06:21:29.058162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 353/700] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:29 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:29.058585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c860c07-fa57-4549-a4a1-30c497d15dcb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:29.059142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c860c07-fa57-4549-a4a1-30c497d15dcb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:29.059754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c860c07-fa57-4549-a4a1-30c497d15dcb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:29.060364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c860c07-fa57-4549-a4a1-30c497d15dcb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:29.061012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c860c07-fa57-4549-a4a1-30c497d15dcb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:29.061664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c860c07-fa57-4549-a4a1-30c497d15dcb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:29.066410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-dd16f360-41f8-4648-97a5-499b226ce086 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:29.068858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-dd16f360-41f8-4648-97a5-499b226ce086 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:29.075978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dd16f360-41f8-4648-97a5-499b226ce086 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:29.076526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dd16f360-41f8-4648-97a5-499b226ce086 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:29.077060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dd16f360-41f8-4648-97a5-499b226ce086 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:29.077907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dd16f360-41f8-4648-97a5-499b226ce086 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:29.078455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dd16f360-41f8-4648-97a5-499b226ce086 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:29.079026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dd16f360-41f8-4648-97a5-499b226ce086 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:29.112366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-dd16f360-41f8-4648-97a5-499b226ce086 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053164 Aug 24 06:21:29.112968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 354/701] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:29.177213 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9c860c07-fa57-4549-a4a1-30c497d15dcb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:29.185956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9c860c07-fa57-4549-a4a1-30c497d15dcb tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1242 microversion: 2.1 time: 0.140479 Aug 24 06:21:29.186523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 348/702] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:29 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1242 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:21:30.070526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-eb22385c-c660-42da-9e3d-ec3e844f8824 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:30.073357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-eb22385c-c660-42da-9e3d-ec3e844f8824 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:30.076071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:30.080906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb22385c-c660-42da-9e3d-ec3e844f8824 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:30.081382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb22385c-c660-42da-9e3d-ec3e844f8824 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:30.081810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb22385c-c660-42da-9e3d-ec3e844f8824 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:30.082494 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb22385c-c660-42da-9e3d-ec3e844f8824 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:30.082936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb22385c-c660-42da-9e3d-ec3e844f8824 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:30.083353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb22385c-c660-42da-9e3d-ec3e844f8824 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:30.086979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:30.113806 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-eb22385c-c660-42da-9e3d-ec3e844f8824 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047440 Aug 24 06:21:30.114372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 355/703] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:30.131434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bf0ae59c-b76e-467c-9e5e-f8bde0844027 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:30.133815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bf0ae59c-b76e-467c-9e5e-f8bde0844027 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:30.140853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf0ae59c-b76e-467c-9e5e-f8bde0844027 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:30.141330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf0ae59c-b76e-467c-9e5e-f8bde0844027 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:30.141759 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf0ae59c-b76e-467c-9e5e-f8bde0844027 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:30.142441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf0ae59c-b76e-467c-9e5e-f8bde0844027 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:30.142889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf0ae59c-b76e-467c-9e5e-f8bde0844027 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:30.143298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf0ae59c-b76e-467c-9e5e-f8bde0844027 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:30.147507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:30.173261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bf0ae59c-b76e-467c-9e5e-f8bde0844027 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045887 Aug 24 06:21:30.173836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 349/704] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:30.207389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1115130c-e1fb-4814-b6c4-768db0d04dce tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:30.208021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1115130c-e1fb-4814-b6c4-768db0d04dce tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:30.215062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1115130c-e1fb-4814-b6c4-768db0d04dce tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:30.215528 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1115130c-e1fb-4814-b6c4-768db0d04dce tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:30.216010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1115130c-e1fb-4814-b6c4-768db0d04dce tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:30.216775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1115130c-e1fb-4814-b6c4-768db0d04dce tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:30.217384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1115130c-e1fb-4814-b6c4-768db0d04dce tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:30.218588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1115130c-e1fb-4814-b6c4-768db0d04dce tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:30.296127 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1115130c-e1fb-4814-b6c4-768db0d04dce tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:30.304003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1115130c-e1fb-4814-b6c4-768db0d04dce tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1296 microversion: 2.1 time: 0.100534 Aug 24 06:21:30.304958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 356/705] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:30 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:31.126406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7e12f3cc-37e7-4f45-ad29-82a0a0d360c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:31.128574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7e12f3cc-37e7-4f45-ad29-82a0a0d360c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:31.135183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e12f3cc-37e7-4f45-ad29-82a0a0d360c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:31.135737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e12f3cc-37e7-4f45-ad29-82a0a0d360c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:31.136061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e12f3cc-37e7-4f45-ad29-82a0a0d360c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:31.136809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e12f3cc-37e7-4f45-ad29-82a0a0d360c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:31.137254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e12f3cc-37e7-4f45-ad29-82a0a0d360c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:31.137663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e12f3cc-37e7-4f45-ad29-82a0a0d360c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:31.166704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7e12f3cc-37e7-4f45-ad29-82a0a0d360c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044562 Aug 24 06:21:31.167244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 350/706] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:31.185905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5052b442-4605-4aec-8d24-3b733a25291b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:31.188019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5052b442-4605-4aec-8d24-3b733a25291b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:31.195419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5052b442-4605-4aec-8d24-3b733a25291b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:31.195888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5052b442-4605-4aec-8d24-3b733a25291b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:31.196314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5052b442-4605-4aec-8d24-3b733a25291b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:31.197026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5052b442-4605-4aec-8d24-3b733a25291b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:31.197980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5052b442-4605-4aec-8d24-3b733a25291b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:31.198396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5052b442-4605-4aec-8d24-3b733a25291b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:31.227451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5052b442-4605-4aec-8d24-3b733a25291b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045931 Aug 24 06:21:31.228006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 357/707] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:31 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:31.376874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e66403a1-8b4d-47c2-be4a-997a4fdb9da6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:31.377478 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e66403a1-8b4d-47c2-be4a-997a4fdb9da6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:31.385328 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e66403a1-8b4d-47c2-be4a-997a4fdb9da6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:31.386211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e66403a1-8b4d-47c2-be4a-997a4fdb9da6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:31.386464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e66403a1-8b4d-47c2-be4a-997a4fdb9da6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:31.387102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e66403a1-8b4d-47c2-be4a-997a4fdb9da6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:31.387606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e66403a1-8b4d-47c2-be4a-997a4fdb9da6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:31.388084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e66403a1-8b4d-47c2-be4a-997a4fdb9da6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:31.516256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e66403a1-8b4d-47c2-be4a-997a4fdb9da6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:31.524652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e66403a1-8b4d-47c2-be4a-997a4fdb9da6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1363 microversion: 2.1 time: 0.203058 Aug 24 06:21:31.525289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 351/708] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:31 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:32.179745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3e5b6c0a-29e0-4096-9d59-4ee6d76a7bdf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:32.182418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3e5b6c0a-29e0-4096-9d59-4ee6d76a7bdf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:32.188245 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e5b6c0a-29e0-4096-9d59-4ee6d76a7bdf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:32.188878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e5b6c0a-29e0-4096-9d59-4ee6d76a7bdf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:32.189161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e5b6c0a-29e0-4096-9d59-4ee6d76a7bdf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:32.189837 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e5b6c0a-29e0-4096-9d59-4ee6d76a7bdf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:32.190280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e5b6c0a-29e0-4096-9d59-4ee6d76a7bdf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:32.190694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e5b6c0a-29e0-4096-9d59-4ee6d76a7bdf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:32.221150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3e5b6c0a-29e0-4096-9d59-4ee6d76a7bdf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046024 Aug 24 06:21:32.221695 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 358/709] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:32.239372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1bec6866-170b-4da1-a331-ab0221373f9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:32.241619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1bec6866-170b-4da1-a331-ab0221373f9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:32.248552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1bec6866-170b-4da1-a331-ab0221373f9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:32.249034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1bec6866-170b-4da1-a331-ab0221373f9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:32.249462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1bec6866-170b-4da1-a331-ab0221373f9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:32.250142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1bec6866-170b-4da1-a331-ab0221373f9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:32.250589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1bec6866-170b-4da1-a331-ab0221373f9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:32.251007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1bec6866-170b-4da1-a331-ab0221373f9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:32.281218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1bec6866-170b-4da1-a331-ab0221373f9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045919 Aug 24 06:21:32.281763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 352/710] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:32.547089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-11699051-5dd1-4587-bc3d-ece8688620f6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:32.547691 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-11699051-5dd1-4587-bc3d-ece8688620f6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:32.553833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11699051-5dd1-4587-bc3d-ece8688620f6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:32.554306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11699051-5dd1-4587-bc3d-ece8688620f6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:32.554732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11699051-5dd1-4587-bc3d-ece8688620f6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:32.555411 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11699051-5dd1-4587-bc3d-ece8688620f6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:32.555856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11699051-5dd1-4587-bc3d-ece8688620f6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:32.556270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11699051-5dd1-4587-bc3d-ece8688620f6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:32.688763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-11699051-5dd1-4587-bc3d-ece8688620f6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:32.696706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-11699051-5dd1-4587-bc3d-ece8688620f6 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1363 microversion: 2.1 time: 0.153362 Aug 24 06:21:32.697274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 359/711] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:32 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:33.233521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-239f4502-c4af-42ca-a68e-35ca2be73dc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:33.235751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-239f4502-c4af-42ca-a68e-35ca2be73dc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:33.241745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-239f4502-c4af-42ca-a68e-35ca2be73dc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:33.242345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-239f4502-c4af-42ca-a68e-35ca2be73dc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:33.242631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-239f4502-c4af-42ca-a68e-35ca2be73dc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:33.243299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-239f4502-c4af-42ca-a68e-35ca2be73dc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:33.243764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-239f4502-c4af-42ca-a68e-35ca2be73dc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:33.244179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-239f4502-c4af-42ca-a68e-35ca2be73dc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:33.273143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-239f4502-c4af-42ca-a68e-35ca2be73dc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043528 Aug 24 06:21:33.273914 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 353/712] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:33.293495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-24ce0add-0b8d-4178-8f38-1320c5a9e168 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:33.295673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-24ce0add-0b8d-4178-8f38-1320c5a9e168 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:33.302155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24ce0add-0b8d-4178-8f38-1320c5a9e168 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:33.302627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24ce0add-0b8d-4178-8f38-1320c5a9e168 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:33.303315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24ce0add-0b8d-4178-8f38-1320c5a9e168 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:33.304000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24ce0add-0b8d-4178-8f38-1320c5a9e168 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:33.304448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24ce0add-0b8d-4178-8f38-1320c5a9e168 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:33.304897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24ce0add-0b8d-4178-8f38-1320c5a9e168 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:33.334652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-24ce0add-0b8d-4178-8f38-1320c5a9e168 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045137 Aug 24 06:21:33.335226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 360/713] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:33.717381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-035df279-5c15-4fdc-94a5-a82d832e9cf5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:33.717993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-035df279-5c15-4fdc-94a5-a82d832e9cf5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:33.724151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-035df279-5c15-4fdc-94a5-a82d832e9cf5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:33.724688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-035df279-5c15-4fdc-94a5-a82d832e9cf5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:33.725303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-035df279-5c15-4fdc-94a5-a82d832e9cf5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:33.728400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-035df279-5c15-4fdc-94a5-a82d832e9cf5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:33.728400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-035df279-5c15-4fdc-94a5-a82d832e9cf5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:33.728400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-035df279-5c15-4fdc-94a5-a82d832e9cf5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:33.855176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-c0734aca-36aa-41ba-a1fd-09692a085b18 req-db8f3f89-194b-4c2e-a6ee-ed55bb45b87a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22824cc5-84ad-4f4e-8830-018742399d15", "tag": "1f43ebfe-17fa-48a0-8031-d4a6e2750797"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:21:33.859156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-035df279-5c15-4fdc-94a5-a82d832e9cf5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:33.865594 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c0734aca-36aa-41ba-a1fd-09692a085b18 req-db8f3f89-194b-4c2e-a6ee-ed55bb45b87a service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:33.866060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c0734aca-36aa-41ba-a1fd-09692a085b18 req-db8f3f89-194b-4c2e-a6ee-ed55bb45b87a service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:33.866480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c0734aca-36aa-41ba-a1fd-09692a085b18 req-db8f3f89-194b-4c2e-a6ee-ed55bb45b87a service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:33.867655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-035df279-5c15-4fdc-94a5-a82d832e9cf5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1363 microversion: 2.1 time: 0.154266 Aug 24 06:21:33.868306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 354/714] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:33 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:33.878829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-c0734aca-36aa-41ba-a1fd-09692a085b18 req-db8f3f89-194b-4c2e-a6ee-ed55bb45b87a service nova] Creating event network-changed:1f43ebfe-17fa-48a0-8031-d4a6e2750797 for instance 22824cc5-84ad-4f4e-8830-018742399d15 on hv-cinder-85426 Aug 24 06:21:33.893007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-c0734aca-36aa-41ba-a1fd-09692a085b18 req-db8f3f89-194b-4c2e-a6ee-ed55bb45b87a service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040447 Aug 24 06:21:33.893928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 361/715] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:34.285631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d0f1092c-fc94-4ade-a05a-3b69a021ab5e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:34.287800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d0f1092c-fc94-4ade-a05a-3b69a021ab5e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:34.294752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0f1092c-fc94-4ade-a05a-3b69a021ab5e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:34.295234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0f1092c-fc94-4ade-a05a-3b69a021ab5e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:34.295666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0f1092c-fc94-4ade-a05a-3b69a021ab5e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:34.296363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0f1092c-fc94-4ade-a05a-3b69a021ab5e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:34.296835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0f1092c-fc94-4ade-a05a-3b69a021ab5e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:34.297283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0f1092c-fc94-4ade-a05a-3b69a021ab5e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:34.328161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d0f1092c-fc94-4ade-a05a-3b69a021ab5e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046383 Aug 24 06:21:34.328666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 355/716] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:34 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:34.348281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a3d964e9-971e-4136-a737-cd30a0f1cf3c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:34.350565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a3d964e9-971e-4136-a737-cd30a0f1cf3c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:34.357390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3d964e9-971e-4136-a737-cd30a0f1cf3c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:34.357913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3d964e9-971e-4136-a737-cd30a0f1cf3c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:34.358346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3d964e9-971e-4136-a737-cd30a0f1cf3c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:34.359045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3d964e9-971e-4136-a737-cd30a0f1cf3c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:34.359497 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3d964e9-971e-4136-a737-cd30a0f1cf3c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:34.359923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3d964e9-971e-4136-a737-cd30a0f1cf3c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:34.389425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a3d964e9-971e-4136-a737-cd30a0f1cf3c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045913 Aug 24 06:21:34.389999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 362/717] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:34 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:34.889292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-75aee916-d7ed-4a3b-b44c-9f4cf79ebbe2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:34.889886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-75aee916-d7ed-4a3b-b44c-9f4cf79ebbe2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:34.891696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=4 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:34.896375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75aee916-d7ed-4a3b-b44c-9f4cf79ebbe2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:34.896873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75aee916-d7ed-4a3b-b44c-9f4cf79ebbe2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:34.897295 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75aee916-d7ed-4a3b-b44c-9f4cf79ebbe2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:34.897968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75aee916-d7ed-4a3b-b44c-9f4cf79ebbe2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:34.898410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75aee916-d7ed-4a3b-b44c-9f4cf79ebbe2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:34.898823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75aee916-d7ed-4a3b-b44c-9f4cf79ebbe2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:35.244722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-75aee916-d7ed-4a3b-b44c-9f4cf79ebbe2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:35.252628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-75aee916-d7ed-4a3b-b44c-9f4cf79ebbe2 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1363 microversion: 2.1 time: 0.367557 Aug 24 06:21:35.253325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 356/718] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:34 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:35.341120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e067b23c-22b4-43de-aac3-6fe41138e33f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:35.343291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e067b23c-22b4-43de-aac3-6fe41138e33f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:35.349741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e067b23c-22b4-43de-aac3-6fe41138e33f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:35.350297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e067b23c-22b4-43de-aac3-6fe41138e33f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:35.350644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e067b23c-22b4-43de-aac3-6fe41138e33f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:35.351333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e067b23c-22b4-43de-aac3-6fe41138e33f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:35.351795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e067b23c-22b4-43de-aac3-6fe41138e33f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:35.352214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e067b23c-22b4-43de-aac3-6fe41138e33f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:35.380702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e067b23c-22b4-43de-aac3-6fe41138e33f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044237 Aug 24 06:21:35.381249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 363/719] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:35.401556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9a98a74b-ee17-43fc-aa84-054d1fc801e7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:35.404416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9a98a74b-ee17-43fc-aa84-054d1fc801e7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:35.410766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a98a74b-ee17-43fc-aa84-054d1fc801e7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:35.411246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a98a74b-ee17-43fc-aa84-054d1fc801e7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:35.411677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a98a74b-ee17-43fc-aa84-054d1fc801e7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:35.412360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a98a74b-ee17-43fc-aa84-054d1fc801e7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:35.412978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a98a74b-ee17-43fc-aa84-054d1fc801e7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:35.413404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a98a74b-ee17-43fc-aa84-054d1fc801e7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:35.443321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9a98a74b-ee17-43fc-aa84-054d1fc801e7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 Aug 24 06:21:35.443905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 357/720] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:36.274250 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d6ef4795-388f-48be-878e-623ed7216e4f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:36.274771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d6ef4795-388f-48be-878e-623ed7216e4f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:36.281564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6ef4795-388f-48be-878e-623ed7216e4f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:36.282046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6ef4795-388f-48be-878e-623ed7216e4f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:36.282476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6ef4795-388f-48be-878e-623ed7216e4f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:36.283164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6ef4795-388f-48be-878e-623ed7216e4f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:36.283610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6ef4795-388f-48be-878e-623ed7216e4f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:36.284091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6ef4795-388f-48be-878e-623ed7216e4f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:36.393204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-94add3fd-dd5a-420a-b1a9-891acac46204 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:36.395359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-94add3fd-dd5a-420a-b1a9-891acac46204 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:36.401314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94add3fd-dd5a-420a-b1a9-891acac46204 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:36.401794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94add3fd-dd5a-420a-b1a9-891acac46204 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:36.402394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94add3fd-dd5a-420a-b1a9-891acac46204 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:36.403401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94add3fd-dd5a-420a-b1a9-891acac46204 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:36.403853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94add3fd-dd5a-420a-b1a9-891acac46204 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:36.404270 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94add3fd-dd5a-420a-b1a9-891acac46204 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:36.421041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d6ef4795-388f-48be-878e-623ed7216e4f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:36.429180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d6ef4795-388f-48be-878e-623ed7216e4f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1363 microversion: 2.1 time: 0.159485 Aug 24 06:21:36.429775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 364/721] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:36 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:36.435195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-94add3fd-dd5a-420a-b1a9-891acac46204 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046016 Aug 24 06:21:36.439663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 358/722] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:36.455007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fdb7f60c-1e95-4da3-b7b1-e1d4b3dbc035 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:36.457163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fdb7f60c-1e95-4da3-b7b1-e1d4b3dbc035 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:36.462955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdb7f60c-1e95-4da3-b7b1-e1d4b3dbc035 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:36.463465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdb7f60c-1e95-4da3-b7b1-e1d4b3dbc035 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:36.463914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdb7f60c-1e95-4da3-b7b1-e1d4b3dbc035 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:36.464621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdb7f60c-1e95-4da3-b7b1-e1d4b3dbc035 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:36.465066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdb7f60c-1e95-4da3-b7b1-e1d4b3dbc035 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:36.465994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdb7f60c-1e95-4da3-b7b1-e1d4b3dbc035 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:36.495001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fdb7f60c-1e95-4da3-b7b1-e1d4b3dbc035 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Aug 24 06:21:36.495546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 365/723] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:36 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:37.451379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6d79f898-fb49-478c-b551-90f7ee6a38e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:37.454392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6d79f898-fb49-478c-b551-90f7ee6a38e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:37.457404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b28f3255-547d-4b1c-8191-401c47b56ba7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:37.458027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b28f3255-547d-4b1c-8191-401c47b56ba7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:37.461818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d79f898-fb49-478c-b551-90f7ee6a38e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:37.462293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d79f898-fb49-478c-b551-90f7ee6a38e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:37.462719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d79f898-fb49-478c-b551-90f7ee6a38e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:37.463403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d79f898-fb49-478c-b551-90f7ee6a38e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:37.463848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d79f898-fb49-478c-b551-90f7ee6a38e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:37.464257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d79f898-fb49-478c-b551-90f7ee6a38e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:37.464721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b28f3255-547d-4b1c-8191-401c47b56ba7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:37.465215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b28f3255-547d-4b1c-8191-401c47b56ba7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:37.465708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b28f3255-547d-4b1c-8191-401c47b56ba7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:37.466413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b28f3255-547d-4b1c-8191-401c47b56ba7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:37.466915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b28f3255-547d-4b1c-8191-401c47b56ba7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:37.467352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b28f3255-547d-4b1c-8191-401c47b56ba7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:37.495211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6d79f898-fb49-478c-b551-90f7ee6a38e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048407 Aug 24 06:21:37.495768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 359/724] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:37.507324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bcedde3a-83e0-4672-bd97-52ad80d0a380 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:37.509474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bcedde3a-83e0-4672-bd97-52ad80d0a380 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:37.515394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcedde3a-83e0-4672-bd97-52ad80d0a380 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:37.515879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcedde3a-83e0-4672-bd97-52ad80d0a380 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:37.516313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcedde3a-83e0-4672-bd97-52ad80d0a380 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:37.517043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcedde3a-83e0-4672-bd97-52ad80d0a380 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:37.517495 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcedde3a-83e0-4672-bd97-52ad80d0a380 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:37.517921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcedde3a-83e0-4672-bd97-52ad80d0a380 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:37.548224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bcedde3a-83e0-4672-bd97-52ad80d0a380 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Aug 24 06:21:37.549155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 360/725] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:37.601054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b28f3255-547d-4b1c-8191-401c47b56ba7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:37.608807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b28f3255-547d-4b1c-8191-401c47b56ba7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1363 microversion: 2.1 time: 0.155323 Aug 24 06:21:37.609865 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 366/726] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:37 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:21:38.507808 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-83c73bcc-69dd-40dd-8327-aaf5283668be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:38.510299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-83c73bcc-69dd-40dd-8327-aaf5283668be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:38.516906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83c73bcc-69dd-40dd-8327-aaf5283668be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:38.517384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83c73bcc-69dd-40dd-8327-aaf5283668be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:38.517814 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83c73bcc-69dd-40dd-8327-aaf5283668be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:38.518505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83c73bcc-69dd-40dd-8327-aaf5283668be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:38.518953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83c73bcc-69dd-40dd-8327-aaf5283668be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:38.519367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83c73bcc-69dd-40dd-8327-aaf5283668be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:38.551216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-83c73bcc-69dd-40dd-8327-aaf5283668be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047712 Aug 24 06:21:38.551871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 361/727] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:38.560972 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8dd7ec68-4715-4e3f-b1c5-2a46652598cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:38.563399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8dd7ec68-4715-4e3f-b1c5-2a46652598cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:38.565718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:38.566404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=8 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:38.572300 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8dd7ec68-4715-4e3f-b1c5-2a46652598cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:38.572912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8dd7ec68-4715-4e3f-b1c5-2a46652598cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:38.573421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8dd7ec68-4715-4e3f-b1c5-2a46652598cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:38.574230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8dd7ec68-4715-4e3f-b1c5-2a46652598cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:38.574827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8dd7ec68-4715-4e3f-b1c5-2a46652598cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:38.575372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8dd7ec68-4715-4e3f-b1c5-2a46652598cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:38.611307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8dd7ec68-4715-4e3f-b1c5-2a46652598cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055233 Aug 24 06:21:38.611876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 367/728] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:38 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:38.629523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-60f1e396-a8fe-4e18-ab6e-1e058d690b8d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:38.630131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-60f1e396-a8fe-4e18-ab6e-1e058d690b8d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:38.636119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60f1e396-a8fe-4e18-ab6e-1e058d690b8d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:38.636566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60f1e396-a8fe-4e18-ab6e-1e058d690b8d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:38.636998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60f1e396-a8fe-4e18-ab6e-1e058d690b8d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:38.637683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60f1e396-a8fe-4e18-ab6e-1e058d690b8d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:38.638132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60f1e396-a8fe-4e18-ab6e-1e058d690b8d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:38.638553 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60f1e396-a8fe-4e18-ab6e-1e058d690b8d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:38.769012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-60f1e396-a8fe-4e18-ab6e-1e058d690b8d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:38.773895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-60f1e396-a8fe-4e18-ab6e-1e058d690b8d tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1363 microversion: 2.1 time: 0.148224 Aug 24 06:21:38.774463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 362/729] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:38 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:39.317042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-c6e8f845-55ec-4c34-b814-2668f508f873 req-1951a72f-1e8e-4c90-8bf9-bcc9ef6e95a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22824cc5-84ad-4f4e-8830-018742399d15", "name": "network-vif-plugged", "status": "completed", "tag": "1f43ebfe-17fa-48a0-8031-d4a6e2750797"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:21:39.326815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c6e8f845-55ec-4c34-b814-2668f508f873 req-1951a72f-1e8e-4c90-8bf9-bcc9ef6e95a3 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:39.327294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c6e8f845-55ec-4c34-b814-2668f508f873 req-1951a72f-1e8e-4c90-8bf9-bcc9ef6e95a3 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:39.327806 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c6e8f845-55ec-4c34-b814-2668f508f873 req-1951a72f-1e8e-4c90-8bf9-bcc9ef6e95a3 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:39.338170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-c6e8f845-55ec-4c34-b814-2668f508f873 req-1951a72f-1e8e-4c90-8bf9-bcc9ef6e95a3 service nova] Creating event network-vif-plugged:1f43ebfe-17fa-48a0-8031-d4a6e2750797 for instance 22824cc5-84ad-4f4e-8830-018742399d15 on hv-cinder-85426 Aug 24 06:21:39.343517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-c6e8f845-55ec-4c34-b814-2668f508f873 req-1951a72f-1e8e-4c90-8bf9-bcc9ef6e95a3 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030851 Aug 24 06:21:39.344179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 368/730] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:39.624482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9275d1a0-6f11-458f-9348-03d668644a17 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:39.627404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9275d1a0-6f11-458f-9348-03d668644a17 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:39.634426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9275d1a0-6f11-458f-9348-03d668644a17 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:39.634910 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9275d1a0-6f11-458f-9348-03d668644a17 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:39.635385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9275d1a0-6f11-458f-9348-03d668644a17 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:39.639276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9275d1a0-6f11-458f-9348-03d668644a17 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:39.639276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9275d1a0-6f11-458f-9348-03d668644a17 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:39.639276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9275d1a0-6f11-458f-9348-03d668644a17 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:39.669248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9275d1a0-6f11-458f-9348-03d668644a17 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049651 Aug 24 06:21:39.670139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 369/731] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:39 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:39.688210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4e309d82-b9dc-4bab-8d9d-611ea76b2733 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:39.691115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4e309d82-b9dc-4bab-8d9d-611ea76b2733 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:39.697315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e309d82-b9dc-4bab-8d9d-611ea76b2733 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:39.697734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e309d82-b9dc-4bab-8d9d-611ea76b2733 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:39.698160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e309d82-b9dc-4bab-8d9d-611ea76b2733 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:39.698850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e309d82-b9dc-4bab-8d9d-611ea76b2733 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:39.699298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e309d82-b9dc-4bab-8d9d-611ea76b2733 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:39.699717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4e309d82-b9dc-4bab-8d9d-611ea76b2733 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:39.730604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4e309d82-b9dc-4bab-8d9d-611ea76b2733 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.168802 Aug 24 06:21:39.731171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 363/732] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:39.795543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c3d5c0e1-aead-4f80-be8a-6e2b1af58016 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:39.796168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c3d5c0e1-aead-4f80-be8a-6e2b1af58016 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:39.802172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c3d5c0e1-aead-4f80-be8a-6e2b1af58016 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:39.802653 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c3d5c0e1-aead-4f80-be8a-6e2b1af58016 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:39.803341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c3d5c0e1-aead-4f80-be8a-6e2b1af58016 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:39.804235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c3d5c0e1-aead-4f80-be8a-6e2b1af58016 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:39.804773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c3d5c0e1-aead-4f80-be8a-6e2b1af58016 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:39.805196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c3d5c0e1-aead-4f80-be8a-6e2b1af58016 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:39.932273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c3d5c0e1-aead-4f80-be8a-6e2b1af58016 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:39.940483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c3d5c0e1-aead-4f80-be8a-6e2b1af58016 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1363 microversion: 2.1 time: 0.148832 Aug 24 06:21:39.941070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 370/733] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:39 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:40.681008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d64e5fad-71da-44d7-ba18-7de802a27917 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:40.683267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d64e5fad-71da-44d7-ba18-7de802a27917 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:40.689724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64e5fad-71da-44d7-ba18-7de802a27917 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:40.690359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64e5fad-71da-44d7-ba18-7de802a27917 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:40.690609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64e5fad-71da-44d7-ba18-7de802a27917 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:40.691286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64e5fad-71da-44d7-ba18-7de802a27917 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:40.691728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64e5fad-71da-44d7-ba18-7de802a27917 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:40.692146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d64e5fad-71da-44d7-ba18-7de802a27917 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:40.722109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d64e5fad-71da-44d7-ba18-7de802a27917 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045344 Aug 24 06:21:40.722671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 364/734] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:40 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:40.743305 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-095a2777-cfae-4875-9513-592bf78339cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:40.745366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-095a2777-cfae-4875-9513-592bf78339cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:40.751756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-095a2777-cfae-4875-9513-592bf78339cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:40.752229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-095a2777-cfae-4875-9513-592bf78339cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:40.752694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-095a2777-cfae-4875-9513-592bf78339cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:40.753373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-095a2777-cfae-4875-9513-592bf78339cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:40.753845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-095a2777-cfae-4875-9513-592bf78339cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:40.754332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-095a2777-cfae-4875-9513-592bf78339cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:40.787994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-095a2777-cfae-4875-9513-592bf78339cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048779 Aug 24 06:21:40.788570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 371/735] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:40.961845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-339c3ae0-eb41-4419-a322-d8dc479578c8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:40.962450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-339c3ae0-eb41-4419-a322-d8dc479578c8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:40.968957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-339c3ae0-eb41-4419-a322-d8dc479578c8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:40.969432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-339c3ae0-eb41-4419-a322-d8dc479578c8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:40.969866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-339c3ae0-eb41-4419-a322-d8dc479578c8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:40.970545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-339c3ae0-eb41-4419-a322-d8dc479578c8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:40.970993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-339c3ae0-eb41-4419-a322-d8dc479578c8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:40.971413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-339c3ae0-eb41-4419-a322-d8dc479578c8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:41.101217 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-339c3ae0-eb41-4419-a322-d8dc479578c8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:41.104756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:41.109329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-339c3ae0-eb41-4419-a322-d8dc479578c8 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1363 microversion: 2.1 time: 0.151322 Aug 24 06:21:41.109898 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 365/736] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:40 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:21:41.734672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-02dca17b-d46a-4aac-a73b-f81eef7e797e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:41.736863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-02dca17b-d46a-4aac-a73b-f81eef7e797e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:41.742820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02dca17b-d46a-4aac-a73b-f81eef7e797e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:41.743279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02dca17b-d46a-4aac-a73b-f81eef7e797e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:41.743714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02dca17b-d46a-4aac-a73b-f81eef7e797e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:41.744408 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02dca17b-d46a-4aac-a73b-f81eef7e797e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:41.744885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02dca17b-d46a-4aac-a73b-f81eef7e797e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:41.745307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02dca17b-d46a-4aac-a73b-f81eef7e797e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:41.775090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-02dca17b-d46a-4aac-a73b-f81eef7e797e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Aug 24 06:21:41.775634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 372/737] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:41 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:41.801009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0a494392-f0c2-40f9-95d9-9dd5f7fcb0c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:41.803985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0a494392-f0c2-40f9-95d9-9dd5f7fcb0c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:41.812376 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a494392-f0c2-40f9-95d9-9dd5f7fcb0c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:41.812954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a494392-f0c2-40f9-95d9-9dd5f7fcb0c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:41.813441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a494392-f0c2-40f9-95d9-9dd5f7fcb0c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:41.814275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a494392-f0c2-40f9-95d9-9dd5f7fcb0c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:41.814816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a494392-f0c2-40f9-95d9-9dd5f7fcb0c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:41.815342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a494392-f0c2-40f9-95d9-9dd5f7fcb0c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:41.847704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0a494392-f0c2-40f9-95d9-9dd5f7fcb0c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052357 Aug 24 06:21:41.848251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 366/738] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:41 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:42.129523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-45115277-e8df-4844-b869-20ebf3f81596 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:42.130118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-45115277-e8df-4844-b869-20ebf3f81596 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:42.135994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45115277-e8df-4844-b869-20ebf3f81596 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:42.136464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45115277-e8df-4844-b869-20ebf3f81596 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:42.136929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45115277-e8df-4844-b869-20ebf3f81596 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:42.137615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45115277-e8df-4844-b869-20ebf3f81596 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:42.138062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45115277-e8df-4844-b869-20ebf3f81596 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:42.138591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45115277-e8df-4844-b869-20ebf3f81596 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:42.142632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:42.265233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-45115277-e8df-4844-b869-20ebf3f81596 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:21:42.272959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-45115277-e8df-4844-b869-20ebf3f81596 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1548 microversion: 2.1 time: 0.147290 Aug 24 06:21:42.273528 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 373/739] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:21:42 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1548 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:21:42.293289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-07298f61-21b2-4017-8bdc-2fbd5fff8395 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:42.293781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-07298f61-21b2-4017-8bdc-2fbd5fff8395 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:42.300261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07298f61-21b2-4017-8bdc-2fbd5fff8395 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:42.300780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07298f61-21b2-4017-8bdc-2fbd5fff8395 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:42.301210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07298f61-21b2-4017-8bdc-2fbd5fff8395 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:42.301896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07298f61-21b2-4017-8bdc-2fbd5fff8395 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:42.302347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07298f61-21b2-4017-8bdc-2fbd5fff8395 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:42.302766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07298f61-21b2-4017-8bdc-2fbd5fff8395 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:42.390810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-07298f61-21b2-4017-8bdc-2fbd5fff8395 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101143 Aug 24 06:21:42.391468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 367/740] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 24 06:21:42 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:42.843684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6be2c130-35ef-4c1b-82a9-5861c1f7321c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:42.845936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6be2c130-35ef-4c1b-82a9-5861c1f7321c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:42.852133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6be2c130-35ef-4c1b-82a9-5861c1f7321c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:42.852645 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6be2c130-35ef-4c1b-82a9-5861c1f7321c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:42.853072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6be2c130-35ef-4c1b-82a9-5861c1f7321c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:42.853805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6be2c130-35ef-4c1b-82a9-5861c1f7321c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:42.854326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6be2c130-35ef-4c1b-82a9-5861c1f7321c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:42.854751 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6be2c130-35ef-4c1b-82a9-5861c1f7321c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:42.860244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2ea77051-97c5-46f1-aafc-2daff45f1ba3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:42.867513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2ea77051-97c5-46f1-aafc-2daff45f1ba3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:42.868464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ea77051-97c5-46f1-aafc-2daff45f1ba3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:42.868980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ea77051-97c5-46f1-aafc-2daff45f1ba3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:42.869659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ea77051-97c5-46f1-aafc-2daff45f1ba3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:42.870549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ea77051-97c5-46f1-aafc-2daff45f1ba3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:42.871020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ea77051-97c5-46f1-aafc-2daff45f1ba3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:42.871411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ea77051-97c5-46f1-aafc-2daff45f1ba3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:42.886422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6be2c130-35ef-4c1b-82a9-5861c1f7321c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102613 Aug 24 06:21:42.887000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 374/741] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:42 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:42.902270 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2ea77051-97c5-46f1-aafc-2daff45f1ba3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046483 Aug 24 06:21:42.902843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 368/742] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:43.338250 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-d9fec429-fa13-4027-a607-b28c3bd2df36 req-372afce5-12a9-4f0d-ac07-ba50d3c3c466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22824cc5-84ad-4f4e-8830-018742399d15", "tag": "1f43ebfe-17fa-48a0-8031-d4a6e2750797"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:21:43.347577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-d9fec429-fa13-4027-a607-b28c3bd2df36 req-372afce5-12a9-4f0d-ac07-ba50d3c3c466 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:43.348044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-d9fec429-fa13-4027-a607-b28c3bd2df36 req-372afce5-12a9-4f0d-ac07-ba50d3c3c466 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:43.348461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-d9fec429-fa13-4027-a607-b28c3bd2df36 req-372afce5-12a9-4f0d-ac07-ba50d3c3c466 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:43.360178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-d9fec429-fa13-4027-a607-b28c3bd2df36 req-372afce5-12a9-4f0d-ac07-ba50d3c3c466 service nova] Creating event network-changed:1f43ebfe-17fa-48a0-8031-d4a6e2750797 for instance 22824cc5-84ad-4f4e-8830-018742399d15 on hv-cinder-85426 Aug 24 06:21:43.364936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-d9fec429-fa13-4027-a607-b28c3bd2df36 req-372afce5-12a9-4f0d-ac07-ba50d3c3c466 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030288 Aug 24 06:21:43.365575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 375/743] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:43.899228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5544493f-969d-4774-825e-13b4225bc811 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:43.901867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5544493f-969d-4774-825e-13b4225bc811 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:43.904506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:43.910411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5544493f-969d-4774-825e-13b4225bc811 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:43.911130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5544493f-969d-4774-825e-13b4225bc811 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:43.911741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5544493f-969d-4774-825e-13b4225bc811 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:43.912864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5544493f-969d-4774-825e-13b4225bc811 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:43.913667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5544493f-969d-4774-825e-13b4225bc811 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:43.914093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5544493f-969d-4774-825e-13b4225bc811 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:43.915705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1693844e-cb00-4266-a5eb-e7920ef2b3fc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:43.918163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1693844e-cb00-4266-a5eb-e7920ef2b3fc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:43.940202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1693844e-cb00-4266-a5eb-e7920ef2b3fc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:43.948616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5544493f-969d-4774-825e-13b4225bc811 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053261 Aug 24 06:21:43.948908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1693844e-cb00-4266-a5eb-e7920ef2b3fc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:43.953029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1693844e-cb00-4266-a5eb-e7920ef2b3fc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:43.953150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 369/744] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:43 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:43.953244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1693844e-cb00-4266-a5eb-e7920ef2b3fc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:43.953244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1693844e-cb00-4266-a5eb-e7920ef2b3fc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:43.953244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1693844e-cb00-4266-a5eb-e7920ef2b3fc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:43.990732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1693844e-cb00-4266-a5eb-e7920ef2b3fc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079386 Aug 24 06:21:43.991332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 376/745] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:44.962273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3c9b3ee7-3096-4677-a936-cf8c3c9828d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:44.964427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3c9b3ee7-3096-4677-a936-cf8c3c9828d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:44.971092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ee7-3096-4677-a936-cf8c3c9828d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:44.971569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ee7-3096-4677-a936-cf8c3c9828d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:44.971999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ee7-3096-4677-a936-cf8c3c9828d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:44.972794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ee7-3096-4677-a936-cf8c3c9828d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:44.973241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ee7-3096-4677-a936-cf8c3c9828d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:44.973657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9b3ee7-3096-4677-a936-cf8c3c9828d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:45.004613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3c9b3ee7-3096-4677-a936-cf8c3c9828d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046635 Aug 24 06:21:45.004817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2a9ae1c1-a998-49d8-89dc-55490cdaaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:45.005264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 370/746] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:44 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:45.007241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2a9ae1c1-a998-49d8-89dc-55490cdaaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:45.014321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a9ae1c1-a998-49d8-89dc-55490cdaaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:45.014867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a9ae1c1-a998-49d8-89dc-55490cdaaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:45.015378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a9ae1c1-a998-49d8-89dc-55490cdaaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:45.016158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a9ae1c1-a998-49d8-89dc-55490cdaaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:45.016707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a9ae1c1-a998-49d8-89dc-55490cdaaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:45.017191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a9ae1c1-a998-49d8-89dc-55490cdaaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:45.051563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2a9ae1c1-a998-49d8-89dc-55490cdaaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052082 Aug 24 06:21:45.052098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 377/747] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:46.019445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ba258708-8db2-4fda-8aee-60d8bb49cff8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:46.022005 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ba258708-8db2-4fda-8aee-60d8bb49cff8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:46.029319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba258708-8db2-4fda-8aee-60d8bb49cff8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:46.029803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba258708-8db2-4fda-8aee-60d8bb49cff8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:46.030235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba258708-8db2-4fda-8aee-60d8bb49cff8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:46.030938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba258708-8db2-4fda-8aee-60d8bb49cff8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:46.031447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba258708-8db2-4fda-8aee-60d8bb49cff8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:46.031873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba258708-8db2-4fda-8aee-60d8bb49cff8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:46.062623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ba258708-8db2-4fda-8aee-60d8bb49cff8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049185 Aug 24 06:21:46.063688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 371/748] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:46.064744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-21ba796b-4b7e-4aff-9ad2-61242fa7267b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:46.066879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-21ba796b-4b7e-4aff-9ad2-61242fa7267b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:46.073423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21ba796b-4b7e-4aff-9ad2-61242fa7267b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:46.073900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21ba796b-4b7e-4aff-9ad2-61242fa7267b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:46.074328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21ba796b-4b7e-4aff-9ad2-61242fa7267b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:46.075025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21ba796b-4b7e-4aff-9ad2-61242fa7267b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:46.075475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21ba796b-4b7e-4aff-9ad2-61242fa7267b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:46.075896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21ba796b-4b7e-4aff-9ad2-61242fa7267b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:46.105072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-21ba796b-4b7e-4aff-9ad2-61242fa7267b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044980 Aug 24 06:21:46.105635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 378/749] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:47.075600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2811cac5-86a4-425c-94f3-d6e9df02296e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:47.077736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2811cac5-86a4-425c-94f3-d6e9df02296e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:47.086974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2811cac5-86a4-425c-94f3-d6e9df02296e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:47.087507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2811cac5-86a4-425c-94f3-d6e9df02296e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:47.087942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2811cac5-86a4-425c-94f3-d6e9df02296e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:47.088679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2811cac5-86a4-425c-94f3-d6e9df02296e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:47.089139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2811cac5-86a4-425c-94f3-d6e9df02296e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:47.089562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2811cac5-86a4-425c-94f3-d6e9df02296e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:47.117727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-472a25d2-6756-4161-863c-5b1fe0d6880e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:47.120075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-472a25d2-6756-4161-863c-5b1fe0d6880e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:47.121089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2811cac5-86a4-425c-94f3-d6e9df02296e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049571 Aug 24 06:21:47.121884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 372/750] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:47.127536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-472a25d2-6756-4161-863c-5b1fe0d6880e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:47.128016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-472a25d2-6756-4161-863c-5b1fe0d6880e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:47.128535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-472a25d2-6756-4161-863c-5b1fe0d6880e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:47.129239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-472a25d2-6756-4161-863c-5b1fe0d6880e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:47.129683 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-472a25d2-6756-4161-863c-5b1fe0d6880e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:47.130096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-472a25d2-6756-4161-863c-5b1fe0d6880e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:47.159189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-472a25d2-6756-4161-863c-5b1fe0d6880e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045965 Aug 24 06:21:47.159756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 379/751] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:48.135825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7f2727ac-fd3e-4332-99e9-7a80d1476d83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:48.137934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7f2727ac-fd3e-4332-99e9-7a80d1476d83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:48.144996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2727ac-fd3e-4332-99e9-7a80d1476d83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:48.145477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2727ac-fd3e-4332-99e9-7a80d1476d83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:48.145909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2727ac-fd3e-4332-99e9-7a80d1476d83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:48.146583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2727ac-fd3e-4332-99e9-7a80d1476d83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:48.147030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2727ac-fd3e-4332-99e9-7a80d1476d83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:48.147441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2727ac-fd3e-4332-99e9-7a80d1476d83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:48.172346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5646aea7-5966-4dcb-825d-69ebf1ca43ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:48.174660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5646aea7-5966-4dcb-825d-69ebf1ca43ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:48.176702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7f2727ac-fd3e-4332-99e9-7a80d1476d83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044819 Aug 24 06:21:48.177270 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 373/752] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:48.181578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5646aea7-5966-4dcb-825d-69ebf1ca43ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:48.182124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5646aea7-5966-4dcb-825d-69ebf1ca43ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:48.182563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5646aea7-5966-4dcb-825d-69ebf1ca43ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:48.183274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5646aea7-5966-4dcb-825d-69ebf1ca43ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:48.183725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5646aea7-5966-4dcb-825d-69ebf1ca43ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:48.184150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5646aea7-5966-4dcb-825d-69ebf1ca43ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:48.216476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5646aea7-5966-4dcb-825d-69ebf1ca43ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048819 Aug 24 06:21:48.217071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 380/753] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:49.189511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8fe73753-cce8-4857-a978-27f90a9401d0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:49.191639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8fe73753-cce8-4857-a978-27f90a9401d0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:49.198160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8fe73753-cce8-4857-a978-27f90a9401d0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:49.198652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8fe73753-cce8-4857-a978-27f90a9401d0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:49.199069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8fe73753-cce8-4857-a978-27f90a9401d0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:49.199766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8fe73753-cce8-4857-a978-27f90a9401d0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:49.200211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8fe73753-cce8-4857-a978-27f90a9401d0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:49.200675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8fe73753-cce8-4857-a978-27f90a9401d0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:49.230109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0ef74c60-e1b1-4433-8463-a6885593993c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:49.231405 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8fe73753-cce8-4857-a978-27f90a9401d0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046442 Aug 24 06:21:49.231996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 374/754] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:49 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:49.232354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0ef74c60-e1b1-4433-8463-a6885593993c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:49.239455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ef74c60-e1b1-4433-8463-a6885593993c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:49.239926 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ef74c60-e1b1-4433-8463-a6885593993c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:49.240352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ef74c60-e1b1-4433-8463-a6885593993c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:49.241071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ef74c60-e1b1-4433-8463-a6885593993c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:49.241515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ef74c60-e1b1-4433-8463-a6885593993c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:49.241931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0ef74c60-e1b1-4433-8463-a6885593993c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:49.270934 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0ef74c60-e1b1-4433-8463-a6885593993c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045217 Aug 24 06:21:49.271482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 381/755] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:50.244321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-24343924-d167-4b73-b2e4-6e5d306fdfa4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:50.246502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-24343924-d167-4b73-b2e4-6e5d306fdfa4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:50.253011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24343924-d167-4b73-b2e4-6e5d306fdfa4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:50.253489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24343924-d167-4b73-b2e4-6e5d306fdfa4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:50.253918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24343924-d167-4b73-b2e4-6e5d306fdfa4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:50.254602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24343924-d167-4b73-b2e4-6e5d306fdfa4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:50.255043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24343924-d167-4b73-b2e4-6e5d306fdfa4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:50.255468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24343924-d167-4b73-b2e4-6e5d306fdfa4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:50.284015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-848040f3-a699-488d-b708-36543c14c3e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:50.285634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-24343924-d167-4b73-b2e4-6e5d306fdfa4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045351 Aug 24 06:21:50.286201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 375/756] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:50.286339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-848040f3-a699-488d-b708-36543c14c3e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:50.292786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-848040f3-a699-488d-b708-36543c14c3e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:50.293256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-848040f3-a699-488d-b708-36543c14c3e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:50.293680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-848040f3-a699-488d-b708-36543c14c3e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:50.294387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-848040f3-a699-488d-b708-36543c14c3e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:50.294831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-848040f3-a699-488d-b708-36543c14c3e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:50.295247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-848040f3-a699-488d-b708-36543c14c3e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:50.324696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-848040f3-a699-488d-b708-36543c14c3e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045288 Aug 24 06:21:50.325243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 382/757] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:51.298157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6fedd284-8250-463d-a965-95a8ee6cd85b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:51.300170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6fedd284-8250-463d-a965-95a8ee6cd85b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:51.306888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fedd284-8250-463d-a965-95a8ee6cd85b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:51.307361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fedd284-8250-463d-a965-95a8ee6cd85b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:51.307797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fedd284-8250-463d-a965-95a8ee6cd85b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:51.308474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fedd284-8250-463d-a965-95a8ee6cd85b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:51.309034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fedd284-8250-463d-a965-95a8ee6cd85b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:51.309454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fedd284-8250-463d-a965-95a8ee6cd85b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:51.337626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-433c9c2a-9695-4da0-afaf-194c0fa58b9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:51.339763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6fedd284-8250-463d-a965-95a8ee6cd85b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045631 Aug 24 06:21:51.339883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-433c9c2a-9695-4da0-afaf-194c0fa58b9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:51.340324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 376/758] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:51.346298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-433c9c2a-9695-4da0-afaf-194c0fa58b9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:51.346767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-433c9c2a-9695-4da0-afaf-194c0fa58b9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:51.347194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-433c9c2a-9695-4da0-afaf-194c0fa58b9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:51.347875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-433c9c2a-9695-4da0-afaf-194c0fa58b9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:51.348322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-433c9c2a-9695-4da0-afaf-194c0fa58b9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:51.348759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-433c9c2a-9695-4da0-afaf-194c0fa58b9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:51.377429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-433c9c2a-9695-4da0-afaf-194c0fa58b9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043675 Aug 24 06:21:51.377955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 383/759] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:51 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:52.351511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f14000b1-a635-4683-8eca-075065a912f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:52.353607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f14000b1-a635-4683-8eca-075065a912f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:52.360022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f14000b1-a635-4683-8eca-075065a912f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:52.361045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f14000b1-a635-4683-8eca-075065a912f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:52.361473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f14000b1-a635-4683-8eca-075065a912f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:52.362148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f14000b1-a635-4683-8eca-075065a912f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:52.362588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f14000b1-a635-4683-8eca-075065a912f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:52.362999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f14000b1-a635-4683-8eca-075065a912f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:52.390292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3b32c004-d1b4-47ce-8923-88b734fef8b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:52.392507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3b32c004-d1b4-47ce-8923-88b734fef8b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:52.392651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f14000b1-a635-4683-8eca-075065a912f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Aug 24 06:21:52.393178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 377/760] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:52 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:21:52.400840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b32c004-d1b4-47ce-8923-88b734fef8b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:52.401318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b32c004-d1b4-47ce-8923-88b734fef8b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:52.401751 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b32c004-d1b4-47ce-8923-88b734fef8b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:52.402455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b32c004-d1b4-47ce-8923-88b734fef8b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:52.402905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b32c004-d1b4-47ce-8923-88b734fef8b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:52.403327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b32c004-d1b4-47ce-8923-88b734fef8b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:52.433248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3b32c004-d1b4-47ce-8923-88b734fef8b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047026 Aug 24 06:21:52.433802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 384/761] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:53.404357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-14c9368f-4362-4556-a5b0-6d50436727f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:53.406520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-14c9368f-4362-4556-a5b0-6d50436727f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:53.413550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14c9368f-4362-4556-a5b0-6d50436727f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:53.414033 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14c9368f-4362-4556-a5b0-6d50436727f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:53.414461 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14c9368f-4362-4556-a5b0-6d50436727f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:53.415144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14c9368f-4362-4556-a5b0-6d50436727f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:53.415591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14c9368f-4362-4556-a5b0-6d50436727f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:53.416008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14c9368f-4362-4556-a5b0-6d50436727f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:53.445822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-81cd53b3-6f9d-4d9d-97c1-a0e14a03fc21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:53.446375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-14c9368f-4362-4556-a5b0-6d50436727f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045974 Aug 24 06:21:53.447017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 378/762] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:53.448072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-81cd53b3-6f9d-4d9d-97c1-a0e14a03fc21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:53.454487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81cd53b3-6f9d-4d9d-97c1-a0e14a03fc21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:53.454955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81cd53b3-6f9d-4d9d-97c1-a0e14a03fc21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:53.455381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81cd53b3-6f9d-4d9d-97c1-a0e14a03fc21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:53.456064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81cd53b3-6f9d-4d9d-97c1-a0e14a03fc21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:53.456526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81cd53b3-6f9d-4d9d-97c1-a0e14a03fc21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:53.456958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81cd53b3-6f9d-4d9d-97c1-a0e14a03fc21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:53.486073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-81cd53b3-6f9d-4d9d-97c1-a0e14a03fc21 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044132 Aug 24 06:21:53.487288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 385/763] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:54.458783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2831430c-b43e-41af-8525-ec18da4bc930 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:54.460967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2831430c-b43e-41af-8525-ec18da4bc930 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:54.467354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2831430c-b43e-41af-8525-ec18da4bc930 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:54.467861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2831430c-b43e-41af-8525-ec18da4bc930 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:54.468296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2831430c-b43e-41af-8525-ec18da4bc930 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:54.469004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2831430c-b43e-41af-8525-ec18da4bc930 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:54.469469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2831430c-b43e-41af-8525-ec18da4bc930 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:54.469926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2831430c-b43e-41af-8525-ec18da4bc930 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:54.499266 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2831430c-b43e-41af-8525-ec18da4bc930 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Aug 24 06:21:54.499468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cf5f506c-be7e-4356-83aa-b432c3c258f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:54.500073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 379/764] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:54.501541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cf5f506c-be7e-4356-83aa-b432c3c258f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:54.508543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf5f506c-be7e-4356-83aa-b432c3c258f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:54.509032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf5f506c-be7e-4356-83aa-b432c3c258f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:54.509469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf5f506c-be7e-4356-83aa-b432c3c258f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:54.510168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf5f506c-be7e-4356-83aa-b432c3c258f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:54.510624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf5f506c-be7e-4356-83aa-b432c3c258f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:54.511050 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf5f506c-be7e-4356-83aa-b432c3c258f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:54.540017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cf5f506c-be7e-4356-83aa-b432c3c258f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044638 Aug 24 06:21:54.540616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 386/765] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:54 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:55.511517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d7fdc806-77d4-4783-8dcb-eca5d8ec0e2e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:55.513653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d7fdc806-77d4-4783-8dcb-eca5d8ec0e2e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:55.520790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7fdc806-77d4-4783-8dcb-eca5d8ec0e2e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:55.521272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7fdc806-77d4-4783-8dcb-eca5d8ec0e2e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:55.521699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7fdc806-77d4-4783-8dcb-eca5d8ec0e2e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:55.522379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7fdc806-77d4-4783-8dcb-eca5d8ec0e2e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:55.522824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7fdc806-77d4-4783-8dcb-eca5d8ec0e2e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:55.523333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7fdc806-77d4-4783-8dcb-eca5d8ec0e2e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:55.551322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e239b373-5f40-4e82-be0c-965353968f47 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:55.551879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d7fdc806-77d4-4783-8dcb-eca5d8ec0e2e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044270 Aug 24 06:21:55.552190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 380/766] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:55 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:55.553742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e239b373-5f40-4e82-be0c-965353968f47 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:55.560085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e239b373-5f40-4e82-be0c-965353968f47 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:55.560597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e239b373-5f40-4e82-be0c-965353968f47 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:55.561032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e239b373-5f40-4e82-be0c-965353968f47 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:55.561720 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e239b373-5f40-4e82-be0c-965353968f47 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:55.562177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e239b373-5f40-4e82-be0c-965353968f47 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:55.562598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e239b373-5f40-4e82-be0c-965353968f47 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:55.592828 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e239b373-5f40-4e82-be0c-965353968f47 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045462 Aug 24 06:21:55.593386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 387/767] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:56.564313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4926b5d5-8729-4609-a23e-dc74e33192a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:56.566416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4926b5d5-8729-4609-a23e-dc74e33192a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:56.572821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4926b5d5-8729-4609-a23e-dc74e33192a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:56.573304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4926b5d5-8729-4609-a23e-dc74e33192a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:56.573732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4926b5d5-8729-4609-a23e-dc74e33192a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:56.574411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4926b5d5-8729-4609-a23e-dc74e33192a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:56.574858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4926b5d5-8729-4609-a23e-dc74e33192a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:56.575275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4926b5d5-8729-4609-a23e-dc74e33192a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:56.605408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4926b5d5-8729-4609-a23e-dc74e33192a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045154 Aug 24 06:21:56.605691 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c1979a7c-c4ac-4f93-89ba-c8b768d531fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:56.606153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 381/768] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:56.607976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c1979a7c-c4ac-4f93-89ba-c8b768d531fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:56.614399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1979a7c-c4ac-4f93-89ba-c8b768d531fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:56.614867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1979a7c-c4ac-4f93-89ba-c8b768d531fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:56.615296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1979a7c-c4ac-4f93-89ba-c8b768d531fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:56.615985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1979a7c-c4ac-4f93-89ba-c8b768d531fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:56.616427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1979a7c-c4ac-4f93-89ba-c8b768d531fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:56.616877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1979a7c-c4ac-4f93-89ba-c8b768d531fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:56.646178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c1979a7c-c4ac-4f93-89ba-c8b768d531fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044693 Aug 24 06:21:56.646787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 388/769] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:21:57.618436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-583a00e2-209d-4df6-9ece-23812527dbcc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:57.620525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-583a00e2-209d-4df6-9ece-23812527dbcc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:57.626896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-583a00e2-209d-4df6-9ece-23812527dbcc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:57.627371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-583a00e2-209d-4df6-9ece-23812527dbcc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:57.627797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-583a00e2-209d-4df6-9ece-23812527dbcc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:57.629122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-583a00e2-209d-4df6-9ece-23812527dbcc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:57.629568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-583a00e2-209d-4df6-9ece-23812527dbcc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:57.629983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-583a00e2-209d-4df6-9ece-23812527dbcc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:57.653937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:57.658104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-31134329-9b42-43f8-85e9-3a1d829f1b89 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:57.658591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-583a00e2-209d-4df6-9ece-23812527dbcc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044252 Aug 24 06:21:57.659145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 382/770] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:57 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:57.660218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-31134329-9b42-43f8-85e9-3a1d829f1b89 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:57.666590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31134329-9b42-43f8-85e9-3a1d829f1b89 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:57.669044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31134329-9b42-43f8-85e9-3a1d829f1b89 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:57.669044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31134329-9b42-43f8-85e9-3a1d829f1b89 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:57.669044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31134329-9b42-43f8-85e9-3a1d829f1b89 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:57.669044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31134329-9b42-43f8-85e9-3a1d829f1b89 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:57.669414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31134329-9b42-43f8-85e9-3a1d829f1b89 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:57.699858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-31134329-9b42-43f8-85e9-3a1d829f1b89 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045604 Aug 24 06:21:57.700421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 389/771] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:57 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:58.670867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c02341fe-d06d-40c5-ae00-e09700322c1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:58.673142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c02341fe-d06d-40c5-ae00-e09700322c1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:58.680316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c02341fe-d06d-40c5-ae00-e09700322c1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:58.680828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c02341fe-d06d-40c5-ae00-e09700322c1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:58.681261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c02341fe-d06d-40c5-ae00-e09700322c1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:58.681944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c02341fe-d06d-40c5-ae00-e09700322c1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:58.682454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c02341fe-d06d-40c5-ae00-e09700322c1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:58.682872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c02341fe-d06d-40c5-ae00-e09700322c1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:58.713252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d82adb5e-cc01-41f1-ab2b-b0d2972dcf48 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:58.713895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c02341fe-d06d-40c5-ae00-e09700322c1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046943 Aug 24 06:21:58.714466 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 383/772] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:58.715647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d82adb5e-cc01-41f1-ab2b-b0d2972dcf48 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:58.722676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d82adb5e-cc01-41f1-ab2b-b0d2972dcf48 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:58.723159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d82adb5e-cc01-41f1-ab2b-b0d2972dcf48 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:58.723606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d82adb5e-cc01-41f1-ab2b-b0d2972dcf48 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:58.724322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d82adb5e-cc01-41f1-ab2b-b0d2972dcf48 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:58.724817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d82adb5e-cc01-41f1-ab2b-b0d2972dcf48 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:58.725373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d82adb5e-cc01-41f1-ab2b-b0d2972dcf48 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:58.742975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:21:58.755714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d82adb5e-cc01-41f1-ab2b-b0d2972dcf48 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046777 Aug 24 06:21:58.756274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 390/773] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:58 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:21:59.726259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-93fca15b-39d5-4e46-bfbb-f1c48f78bb10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:59.728607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-93fca15b-39d5-4e46-bfbb-f1c48f78bb10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:59.735144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fca15b-39d5-4e46-bfbb-f1c48f78bb10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:59.735595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fca15b-39d5-4e46-bfbb-f1c48f78bb10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:59.736022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fca15b-39d5-4e46-bfbb-f1c48f78bb10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:59.736729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fca15b-39d5-4e46-bfbb-f1c48f78bb10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:59.737178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fca15b-39d5-4e46-bfbb-f1c48f78bb10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:59.738078 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93fca15b-39d5-4e46-bfbb-f1c48f78bb10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:59.767365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-93fca15b-39d5-4e46-bfbb-f1c48f78bb10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Aug 24 06:21:59.767914 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 384/774] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:21:59 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:21:59.768276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3858da3a-51e8-4e2b-8f6a-8183370c0624 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:21:59.770445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3858da3a-51e8-4e2b-8f6a-8183370c0624 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:21:59.778742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3858da3a-51e8-4e2b-8f6a-8183370c0624 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:59.779436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3858da3a-51e8-4e2b-8f6a-8183370c0624 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:59.780051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3858da3a-51e8-4e2b-8f6a-8183370c0624 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:59.780781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3858da3a-51e8-4e2b-8f6a-8183370c0624 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:21:59.781233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3858da3a-51e8-4e2b-8f6a-8183370c0624 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:21:59.781661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3858da3a-51e8-4e2b-8f6a-8183370c0624 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:21:59.816863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3858da3a-51e8-4e2b-8f6a-8183370c0624 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052875 Aug 24 06:21:59.817425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 391/775] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:21:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:00.779392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2d24312f-e18f-4b44-8fb9-98db9c5dc739 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:00.781553 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2d24312f-e18f-4b44-8fb9-98db9c5dc739 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:00.788377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d24312f-e18f-4b44-8fb9-98db9c5dc739 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:00.788937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d24312f-e18f-4b44-8fb9-98db9c5dc739 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:00.789361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d24312f-e18f-4b44-8fb9-98db9c5dc739 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:00.790039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d24312f-e18f-4b44-8fb9-98db9c5dc739 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:00.790479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d24312f-e18f-4b44-8fb9-98db9c5dc739 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:00.790886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d24312f-e18f-4b44-8fb9-98db9c5dc739 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:00.821189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2d24312f-e18f-4b44-8fb9-98db9c5dc739 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045863 Aug 24 06:22:00.821739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 385/776] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:00.829093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f96678c2-751d-49dd-822f-6f26fdf8461c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:00.831225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f96678c2-751d-49dd-822f-6f26fdf8461c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:00.837689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96678c2-751d-49dd-822f-6f26fdf8461c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:00.838157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96678c2-751d-49dd-822f-6f26fdf8461c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:00.838586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96678c2-751d-49dd-822f-6f26fdf8461c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:00.839327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96678c2-751d-49dd-822f-6f26fdf8461c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:00.839774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96678c2-751d-49dd-822f-6f26fdf8461c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:00.840188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96678c2-751d-49dd-822f-6f26fdf8461c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:00.871658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f96678c2-751d-49dd-822f-6f26fdf8461c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046443 Aug 24 06:22:00.872217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 392/777] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:00 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:01.833004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-769a691e-d404-40c2-aa7f-4bbd1ad88119 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:01.835161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-769a691e-d404-40c2-aa7f-4bbd1ad88119 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:01.841518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-769a691e-d404-40c2-aa7f-4bbd1ad88119 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:01.841984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-769a691e-d404-40c2-aa7f-4bbd1ad88119 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:01.842408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-769a691e-d404-40c2-aa7f-4bbd1ad88119 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:01.843075 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-769a691e-d404-40c2-aa7f-4bbd1ad88119 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:01.843629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-769a691e-d404-40c2-aa7f-4bbd1ad88119 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:01.844047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-769a691e-d404-40c2-aa7f-4bbd1ad88119 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:01.873199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-769a691e-d404-40c2-aa7f-4bbd1ad88119 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Aug 24 06:22:01.873755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 386/778] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:01.883317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3ef27b4e-c76e-44cb-a805-8e30a0bae980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:01.885462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3ef27b4e-c76e-44cb-a805-8e30a0bae980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:01.891804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ef27b4e-c76e-44cb-a805-8e30a0bae980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:01.892280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ef27b4e-c76e-44cb-a805-8e30a0bae980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:01.892750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ef27b4e-c76e-44cb-a805-8e30a0bae980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:01.893952 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ef27b4e-c76e-44cb-a805-8e30a0bae980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:01.894407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ef27b4e-c76e-44cb-a805-8e30a0bae980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:01.894827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ef27b4e-c76e-44cb-a805-8e30a0bae980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:01.924249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3ef27b4e-c76e-44cb-a805-8e30a0bae980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044791 Aug 24 06:22:01.924878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 393/779] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:22:02.885784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c7404a8c-4266-4c3f-8677-4f90d8c55837 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:02.887845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c7404a8c-4266-4c3f-8677-4f90d8c55837 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:02.893860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7404a8c-4266-4c3f-8677-4f90d8c55837 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:02.894326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7404a8c-4266-4c3f-8677-4f90d8c55837 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:02.895357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7404a8c-4266-4c3f-8677-4f90d8c55837 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:02.896442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7404a8c-4266-4c3f-8677-4f90d8c55837 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:02.897144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7404a8c-4266-4c3f-8677-4f90d8c55837 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:02.897742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7404a8c-4266-4c3f-8677-4f90d8c55837 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:02.927470 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c7404a8c-4266-4c3f-8677-4f90d8c55837 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045841 Aug 24 06:22:02.928032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 387/780] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:02 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:02.937370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-735091f7-afb4-4582-871b-feb01afcc10b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:02.939505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-735091f7-afb4-4582-871b-feb01afcc10b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:02.942313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=78 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:22:02.947105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-735091f7-afb4-4582-871b-feb01afcc10b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:02.951951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-735091f7-afb4-4582-871b-feb01afcc10b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:02.951951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-735091f7-afb4-4582-871b-feb01afcc10b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:02.951951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-735091f7-afb4-4582-871b-feb01afcc10b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:02.951951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-735091f7-afb4-4582-871b-feb01afcc10b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:02.952315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-735091f7-afb4-4582-871b-feb01afcc10b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:02.979096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-735091f7-afb4-4582-871b-feb01afcc10b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045625 Aug 24 06:22:02.979652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 394/781] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:03.939425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f730b23a-296f-465a-b96e-0a81dc9b8503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:03.941606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f730b23a-296f-465a-b96e-0a81dc9b8503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:03.947950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f730b23a-296f-465a-b96e-0a81dc9b8503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:03.948423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f730b23a-296f-465a-b96e-0a81dc9b8503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:03.948905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f730b23a-296f-465a-b96e-0a81dc9b8503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:03.949613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f730b23a-296f-465a-b96e-0a81dc9b8503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:03.950058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f730b23a-296f-465a-b96e-0a81dc9b8503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:03.950474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f730b23a-296f-465a-b96e-0a81dc9b8503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:03.979774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f730b23a-296f-465a-b96e-0a81dc9b8503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Aug 24 06:22:03.980336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 388/782] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:03 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:03.991923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-14a163ee-12ea-493c-ad42-678bbdb21399 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:03.994112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-14a163ee-12ea-493c-ad42-678bbdb21399 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:04.000417 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14a163ee-12ea-493c-ad42-678bbdb21399 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:04.000919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14a163ee-12ea-493c-ad42-678bbdb21399 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:04.001345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14a163ee-12ea-493c-ad42-678bbdb21399 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:04.002019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14a163ee-12ea-493c-ad42-678bbdb21399 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:04.002459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14a163ee-12ea-493c-ad42-678bbdb21399 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:04.002869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14a163ee-12ea-493c-ad42-678bbdb21399 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:04.031717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-14a163ee-12ea-493c-ad42-678bbdb21399 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044389 Aug 24 06:22:04.032262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 395/783] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:04.991980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1ca08a3e-f662-418f-9236-85f0b501f5f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:04.994049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1ca08a3e-f662-418f-9236-85f0b501f5f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:05.000415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ca08a3e-f662-418f-9236-85f0b501f5f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:05.000925 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ca08a3e-f662-418f-9236-85f0b501f5f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:05.001347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ca08a3e-f662-418f-9236-85f0b501f5f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:05.002023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ca08a3e-f662-418f-9236-85f0b501f5f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:05.002465 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ca08a3e-f662-418f-9236-85f0b501f5f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:05.002876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ca08a3e-f662-418f-9236-85f0b501f5f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:05.040852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1ca08a3e-f662-418f-9236-85f0b501f5f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052948 Aug 24 06:22:05.041902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 389/784] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:05.044047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ddd1dcc9-2d98-49f2-a552-15cdd21098d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:05.046207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ddd1dcc9-2d98-49f2-a552-15cdd21098d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:05.053117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ddd1dcc9-2d98-49f2-a552-15cdd21098d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:05.053835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ddd1dcc9-2d98-49f2-a552-15cdd21098d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:05.054267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ddd1dcc9-2d98-49f2-a552-15cdd21098d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:05.054956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ddd1dcc9-2d98-49f2-a552-15cdd21098d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:05.055403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ddd1dcc9-2d98-49f2-a552-15cdd21098d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:05.055840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ddd1dcc9-2d98-49f2-a552-15cdd21098d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:05.085227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ddd1dcc9-2d98-49f2-a552-15cdd21098d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045168 Aug 24 06:22:05.085783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 396/785] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:06.054221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e065d8e8-235a-4538-89ad-c9e5f9c47700 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:06.056244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e065d8e8-235a-4538-89ad-c9e5f9c47700 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:06.062607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e065d8e8-235a-4538-89ad-c9e5f9c47700 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:06.063080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e065d8e8-235a-4538-89ad-c9e5f9c47700 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:06.063550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e065d8e8-235a-4538-89ad-c9e5f9c47700 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:06.064231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e065d8e8-235a-4538-89ad-c9e5f9c47700 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:06.064738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e065d8e8-235a-4538-89ad-c9e5f9c47700 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:06.065153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e065d8e8-235a-4538-89ad-c9e5f9c47700 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:06.095353 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e065d8e8-235a-4538-89ad-c9e5f9c47700 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045381 Aug 24 06:22:06.100442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 390/786] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:06.105805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-677f96b2-d6dc-482d-a111-b6d901c7cfe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:06.107968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-677f96b2-d6dc-482d-a111-b6d901c7cfe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:06.114427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-677f96b2-d6dc-482d-a111-b6d901c7cfe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:06.114956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-677f96b2-d6dc-482d-a111-b6d901c7cfe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:06.115404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-677f96b2-d6dc-482d-a111-b6d901c7cfe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:06.116092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-677f96b2-d6dc-482d-a111-b6d901c7cfe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:06.116568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-677f96b2-d6dc-482d-a111-b6d901c7cfe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:06.116994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-677f96b2-d6dc-482d-a111-b6d901c7cfe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:06.147064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-677f96b2-d6dc-482d-a111-b6d901c7cfe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045302 Aug 24 06:22:06.147619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 397/787] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:07.109624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-301f86eb-7a7b-46f0-9cb3-814f652ff723 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:07.111746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-301f86eb-7a7b-46f0-9cb3-814f652ff723 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:07.118185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-301f86eb-7a7b-46f0-9cb3-814f652ff723 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:07.118661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-301f86eb-7a7b-46f0-9cb3-814f652ff723 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:07.119093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-301f86eb-7a7b-46f0-9cb3-814f652ff723 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:07.119781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-301f86eb-7a7b-46f0-9cb3-814f652ff723 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:07.120228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-301f86eb-7a7b-46f0-9cb3-814f652ff723 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:07.120683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-301f86eb-7a7b-46f0-9cb3-814f652ff723 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:07.150239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-301f86eb-7a7b-46f0-9cb3-814f652ff723 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044750 Aug 24 06:22:07.150801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 391/788] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:07.159221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-da2f6a8b-19ba-44f1-a047-72d0576da9b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:07.162064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-da2f6a8b-19ba-44f1-a047-72d0576da9b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:07.168314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da2f6a8b-19ba-44f1-a047-72d0576da9b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:07.168824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da2f6a8b-19ba-44f1-a047-72d0576da9b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:07.169253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da2f6a8b-19ba-44f1-a047-72d0576da9b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:07.169931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da2f6a8b-19ba-44f1-a047-72d0576da9b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:07.170372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da2f6a8b-19ba-44f1-a047-72d0576da9b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:07.170823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da2f6a8b-19ba-44f1-a047-72d0576da9b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:07.199159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-da2f6a8b-19ba-44f1-a047-72d0576da9b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043872 Aug 24 06:22:07.199708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 398/789] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:07 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:08.163035 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0191c864-7dda-485e-a719-6138d75b8c6e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:08.165184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0191c864-7dda-485e-a719-6138d75b8c6e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:08.171458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0191c864-7dda-485e-a719-6138d75b8c6e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:08.171928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0191c864-7dda-485e-a719-6138d75b8c6e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:08.172354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0191c864-7dda-485e-a719-6138d75b8c6e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:08.173065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0191c864-7dda-485e-a719-6138d75b8c6e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:08.173509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0191c864-7dda-485e-a719-6138d75b8c6e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:08.173919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0191c864-7dda-485e-a719-6138d75b8c6e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:08.202860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0191c864-7dda-485e-a719-6138d75b8c6e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044301 Aug 24 06:22:08.203398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 392/790] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:08.211301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9c8f286a-2fbd-4c57-a5ee-efe3779fcc4e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:08.213465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9c8f286a-2fbd-4c57-a5ee-efe3779fcc4e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:08.219798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9c8f286a-2fbd-4c57-a5ee-efe3779fcc4e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:08.220270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9c8f286a-2fbd-4c57-a5ee-efe3779fcc4e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:08.220743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9c8f286a-2fbd-4c57-a5ee-efe3779fcc4e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:08.221426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9c8f286a-2fbd-4c57-a5ee-efe3779fcc4e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:08.221875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9c8f286a-2fbd-4c57-a5ee-efe3779fcc4e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:08.222283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9c8f286a-2fbd-4c57-a5ee-efe3779fcc4e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:08.251631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9c8f286a-2fbd-4c57-a5ee-efe3779fcc4e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044312 Aug 24 06:22:08.252167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 399/791] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:09.215284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-aaeed797-df4e-44bc-b790-54c861b03cb0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:09.217454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-aaeed797-df4e-44bc-b790-54c861b03cb0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:09.223961 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaeed797-df4e-44bc-b790-54c861b03cb0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:09.224435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaeed797-df4e-44bc-b790-54c861b03cb0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:09.224890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaeed797-df4e-44bc-b790-54c861b03cb0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:09.225570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaeed797-df4e-44bc-b790-54c861b03cb0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:09.226013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaeed797-df4e-44bc-b790-54c861b03cb0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:09.226426 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaeed797-df4e-44bc-b790-54c861b03cb0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:09.254595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-aaeed797-df4e-44bc-b790-54c861b03cb0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Aug 24 06:22:09.255619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 393/792] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:09 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:09.263295 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6b651a78-9a5f-4a0a-a104-efc1c41069e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:09.265438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6b651a78-9a5f-4a0a-a104-efc1c41069e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:09.272468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b651a78-9a5f-4a0a-a104-efc1c41069e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:09.272985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b651a78-9a5f-4a0a-a104-efc1c41069e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:09.273418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b651a78-9a5f-4a0a-a104-efc1c41069e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:09.274107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b651a78-9a5f-4a0a-a104-efc1c41069e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:09.274552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b651a78-9a5f-4a0a-a104-efc1c41069e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:09.274971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6b651a78-9a5f-4a0a-a104-efc1c41069e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:09.304526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6b651a78-9a5f-4a0a-a104-efc1c41069e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045232 Aug 24 06:22:09.305102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 400/793] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:10.267282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-698af737-bb69-4089-9e2b-6b2f7c3ddcaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:10.269370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-698af737-bb69-4089-9e2b-6b2f7c3ddcaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:10.275684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-698af737-bb69-4089-9e2b-6b2f7c3ddcaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:10.276151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-698af737-bb69-4089-9e2b-6b2f7c3ddcaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:10.276610 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-698af737-bb69-4089-9e2b-6b2f7c3ddcaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:10.277283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-698af737-bb69-4089-9e2b-6b2f7c3ddcaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:10.277725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-698af737-bb69-4089-9e2b-6b2f7c3ddcaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:10.278137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-698af737-bb69-4089-9e2b-6b2f7c3ddcaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:10.307133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-698af737-bb69-4089-9e2b-6b2f7c3ddcaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Aug 24 06:22:10.307687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 394/794] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:10 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:10.316764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ecc8346b-3dcf-45a6-801a-533e98b79c08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:10.319502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ecc8346b-3dcf-45a6-801a-533e98b79c08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:10.325904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecc8346b-3dcf-45a6-801a-533e98b79c08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:10.326382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecc8346b-3dcf-45a6-801a-533e98b79c08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:10.326815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecc8346b-3dcf-45a6-801a-533e98b79c08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:10.327502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecc8346b-3dcf-45a6-801a-533e98b79c08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:10.328012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecc8346b-3dcf-45a6-801a-533e98b79c08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:10.328433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecc8346b-3dcf-45a6-801a-533e98b79c08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:10.357216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ecc8346b-3dcf-45a6-801a-533e98b79c08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044431 Aug 24 06:22:10.357774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 401/795] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:10 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:11.319932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c364d91b-470d-4b53-96c6-ca9d445aeb55 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:11.322010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c364d91b-470d-4b53-96c6-ca9d445aeb55 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:11.328349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c364d91b-470d-4b53-96c6-ca9d445aeb55 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:11.328855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c364d91b-470d-4b53-96c6-ca9d445aeb55 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:11.329284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c364d91b-470d-4b53-96c6-ca9d445aeb55 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:11.329954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c364d91b-470d-4b53-96c6-ca9d445aeb55 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:11.330477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c364d91b-470d-4b53-96c6-ca9d445aeb55 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:11.330811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c364d91b-470d-4b53-96c6-ca9d445aeb55 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:11.359955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c364d91b-470d-4b53-96c6-ca9d445aeb55 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Aug 24 06:22:11.360489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 395/796] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:11.369467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f92f932f-5ab9-4c12-87fa-0c3d778e91a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:11.371631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f92f932f-5ab9-4c12-87fa-0c3d778e91a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:11.378435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f92f932f-5ab9-4c12-87fa-0c3d778e91a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:11.378954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f92f932f-5ab9-4c12-87fa-0c3d778e91a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:11.379386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f92f932f-5ab9-4c12-87fa-0c3d778e91a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:11.380596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f92f932f-5ab9-4c12-87fa-0c3d778e91a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:11.381044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f92f932f-5ab9-4c12-87fa-0c3d778e91a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:11.381468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f92f932f-5ab9-4c12-87fa-0c3d778e91a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:11.410578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f92f932f-5ab9-4c12-87fa-0c3d778e91a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045112 Aug 24 06:22:11.411150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 402/797] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:12.371463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8393d1b0-c249-457a-8ca4-5fe988bd0ded tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:12.373571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8393d1b0-c249-457a-8ca4-5fe988bd0ded tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:12.380053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8393d1b0-c249-457a-8ca4-5fe988bd0ded tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:12.380567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8393d1b0-c249-457a-8ca4-5fe988bd0ded tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:12.381007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8393d1b0-c249-457a-8ca4-5fe988bd0ded tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:12.381712 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8393d1b0-c249-457a-8ca4-5fe988bd0ded tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:12.382287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8393d1b0-c249-457a-8ca4-5fe988bd0ded tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:12.382711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8393d1b0-c249-457a-8ca4-5fe988bd0ded tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:12.413127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8393d1b0-c249-457a-8ca4-5fe988bd0ded tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045703 Aug 24 06:22:12.413678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 396/798] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:12.422866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ca18dd04-971c-4678-92c4-cdb13bc0542f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:12.425104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ca18dd04-971c-4678-92c4-cdb13bc0542f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:12.431699 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca18dd04-971c-4678-92c4-cdb13bc0542f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:12.432168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca18dd04-971c-4678-92c4-cdb13bc0542f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:12.432617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca18dd04-971c-4678-92c4-cdb13bc0542f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:12.433294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca18dd04-971c-4678-92c4-cdb13bc0542f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:12.433829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca18dd04-971c-4678-92c4-cdb13bc0542f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:12.434247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca18dd04-971c-4678-92c4-cdb13bc0542f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:12.462920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ca18dd04-971c-4678-92c4-cdb13bc0542f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044088 Aug 24 06:22:12.463466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 403/799] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:13.425692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-26936288-801e-4b1c-ae8c-8827484837e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:13.427807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-26936288-801e-4b1c-ae8c-8827484837e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:13.434529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26936288-801e-4b1c-ae8c-8827484837e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:13.435030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26936288-801e-4b1c-ae8c-8827484837e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:13.435462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26936288-801e-4b1c-ae8c-8827484837e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:13.436173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26936288-801e-4b1c-ae8c-8827484837e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:13.436653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26936288-801e-4b1c-ae8c-8827484837e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:13.437069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26936288-801e-4b1c-ae8c-8827484837e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:13.467015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-26936288-801e-4b1c-ae8c-8827484837e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045293 Aug 24 06:22:13.467570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 397/800] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:13.475171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c769c797-a36d-4b94-84df-fa89c4937a0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:13.477373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c769c797-a36d-4b94-84df-fa89c4937a0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:13.483695 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c769c797-a36d-4b94-84df-fa89c4937a0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:13.484166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c769c797-a36d-4b94-84df-fa89c4937a0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:13.484619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c769c797-a36d-4b94-84df-fa89c4937a0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:13.485298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c769c797-a36d-4b94-84df-fa89c4937a0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:13.485739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c769c797-a36d-4b94-84df-fa89c4937a0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:13.486151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c769c797-a36d-4b94-84df-fa89c4937a0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:13.514648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c769c797-a36d-4b94-84df-fa89c4937a0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043478 Aug 24 06:22:13.515192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 404/801] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:13 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:22:14.478975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9d5a85fa-0611-45d4-90f5-53ac43aa1f4b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:14.481167 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9d5a85fa-0611-45d4-90f5-53ac43aa1f4b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:14.487452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d5a85fa-0611-45d4-90f5-53ac43aa1f4b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:14.487924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d5a85fa-0611-45d4-90f5-53ac43aa1f4b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:14.488350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d5a85fa-0611-45d4-90f5-53ac43aa1f4b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:14.489052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d5a85fa-0611-45d4-90f5-53ac43aa1f4b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:14.489496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d5a85fa-0611-45d4-90f5-53ac43aa1f4b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:14.489907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9d5a85fa-0611-45d4-90f5-53ac43aa1f4b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:14.518644 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9d5a85fa-0611-45d4-90f5-53ac43aa1f4b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044084 Aug 24 06:22:14.519186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 398/802] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:14.528023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5a5d90fc-bd5a-42e6-ad20-8925fd3ac90e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:14.530175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5a5d90fc-bd5a-42e6-ad20-8925fd3ac90e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:14.538189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a5d90fc-bd5a-42e6-ad20-8925fd3ac90e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:14.538675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a5d90fc-bd5a-42e6-ad20-8925fd3ac90e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:14.539106 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a5d90fc-bd5a-42e6-ad20-8925fd3ac90e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:14.539804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a5d90fc-bd5a-42e6-ad20-8925fd3ac90e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:14.540255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a5d90fc-bd5a-42e6-ad20-8925fd3ac90e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:14.540703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a5d90fc-bd5a-42e6-ad20-8925fd3ac90e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:14.569871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5a5d90fc-bd5a-42e6-ad20-8925fd3ac90e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045861 Aug 24 06:22:14.570434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 405/803] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:15.531178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-04fdbb37-e751-40aa-b5df-ceef003f3c4e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:15.533221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-04fdbb37-e751-40aa-b5df-ceef003f3c4e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:15.539937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04fdbb37-e751-40aa-b5df-ceef003f3c4e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:15.540413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04fdbb37-e751-40aa-b5df-ceef003f3c4e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:15.540886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04fdbb37-e751-40aa-b5df-ceef003f3c4e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:15.541571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04fdbb37-e751-40aa-b5df-ceef003f3c4e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:15.542013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04fdbb37-e751-40aa-b5df-ceef003f3c4e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:15.542426 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04fdbb37-e751-40aa-b5df-ceef003f3c4e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:15.559437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:22:15.572310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-04fdbb37-e751-40aa-b5df-ceef003f3c4e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045194 Aug 24 06:22:15.572895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 399/804] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:15 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:15.581983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-64b57663-db16-4054-9984-71d5e962abe2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:15.584084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-64b57663-db16-4054-9984-71d5e962abe2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:15.590412 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b57663-db16-4054-9984-71d5e962abe2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:15.590876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b57663-db16-4054-9984-71d5e962abe2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:15.591296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b57663-db16-4054-9984-71d5e962abe2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:15.591967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b57663-db16-4054-9984-71d5e962abe2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:15.592409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b57663-db16-4054-9984-71d5e962abe2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:15.592860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b57663-db16-4054-9984-71d5e962abe2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:15.621408 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-64b57663-db16-4054-9984-71d5e962abe2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043341 Aug 24 06:22:15.621955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 406/805] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:16.510386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c952e339-fe09-4491-bc15-cb279561a3d7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:16.510786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c952e339-fe09-4491-bc15-cb279561a3d7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:16.513018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=62 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:22:16.517611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c952e339-fe09-4491-bc15-cb279561a3d7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:16.518079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c952e339-fe09-4491-bc15-cb279561a3d7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:16.518500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c952e339-fe09-4491-bc15-cb279561a3d7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:16.519170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c952e339-fe09-4491-bc15-cb279561a3d7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:16.519648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c952e339-fe09-4491-bc15-cb279561a3d7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:16.520059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c952e339-fe09-4491-bc15-cb279561a3d7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:16.543897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c952e339-fe09-4491-bc15-cb279561a3d7 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15/ips" status: 200 len: 145 microversion: 2.1 time: 0.038124 Aug 24 06:22:16.544570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 400/806] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 24 06:22:16 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:16.585317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-22292443-d9d2-491d-9611-28282a487dda tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:16.587475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-22292443-d9d2-491d-9611-28282a487dda tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:16.593966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22292443-d9d2-491d-9611-28282a487dda tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:16.594463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22292443-d9d2-491d-9611-28282a487dda tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:16.594898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22292443-d9d2-491d-9611-28282a487dda tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:16.595590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22292443-d9d2-491d-9611-28282a487dda tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:16.596043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22292443-d9d2-491d-9611-28282a487dda tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:16.596464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-22292443-d9d2-491d-9611-28282a487dda tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:16.600165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:22:16.625184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-22292443-d9d2-491d-9611-28282a487dda tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Aug 24 06:22:16.625750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 407/807] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:16.634105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ea9b35cf-7a9a-4a2d-abcc-6d38d4414c73 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:16.636216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ea9b35cf-7a9a-4a2d-abcc-6d38d4414c73 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:16.642429 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea9b35cf-7a9a-4a2d-abcc-6d38d4414c73 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:16.642906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea9b35cf-7a9a-4a2d-abcc-6d38d4414c73 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:16.643332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea9b35cf-7a9a-4a2d-abcc-6d38d4414c73 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:16.644020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea9b35cf-7a9a-4a2d-abcc-6d38d4414c73 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:16.644462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea9b35cf-7a9a-4a2d-abcc-6d38d4414c73 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:16.644901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ea9b35cf-7a9a-4a2d-abcc-6d38d4414c73 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:16.674669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ea9b35cf-7a9a-4a2d-abcc-6d38d4414c73 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045288 Aug 24 06:22:16.675235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 401/808] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:16 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:17.637907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-80b860ec-c58e-4493-9e4e-5caabe4e7912 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:17.639980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-80b860ec-c58e-4493-9e4e-5caabe4e7912 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:17.646449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b860ec-c58e-4493-9e4e-5caabe4e7912 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:17.647462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b860ec-c58e-4493-9e4e-5caabe4e7912 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:17.647897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b860ec-c58e-4493-9e4e-5caabe4e7912 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:17.648613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b860ec-c58e-4493-9e4e-5caabe4e7912 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:17.649063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b860ec-c58e-4493-9e4e-5caabe4e7912 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:17.649486 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b860ec-c58e-4493-9e4e-5caabe4e7912 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:17.678527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-80b860ec-c58e-4493-9e4e-5caabe4e7912 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Aug 24 06:22:17.679339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 408/809] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:17 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:17.686614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2f3ecf3c-6438-455b-96f5-312553f0cefd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:17.688819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2f3ecf3c-6438-455b-96f5-312553f0cefd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:17.695552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f3ecf3c-6438-455b-96f5-312553f0cefd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:17.696030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f3ecf3c-6438-455b-96f5-312553f0cefd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:17.696461 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f3ecf3c-6438-455b-96f5-312553f0cefd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:17.697234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f3ecf3c-6438-455b-96f5-312553f0cefd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:17.697685 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f3ecf3c-6438-455b-96f5-312553f0cefd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:17.698106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f3ecf3c-6438-455b-96f5-312553f0cefd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:17.729768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2f3ecf3c-6438-455b-96f5-312553f0cefd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047220 Aug 24 06:22:17.730342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 402/810] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:18.690377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fc7420ec-903c-4fc0-b483-0bf7041c07cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:18.692668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fc7420ec-903c-4fc0-b483-0bf7041c07cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:18.699559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc7420ec-903c-4fc0-b483-0bf7041c07cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:18.700035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc7420ec-903c-4fc0-b483-0bf7041c07cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:18.700467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc7420ec-903c-4fc0-b483-0bf7041c07cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:18.701211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc7420ec-903c-4fc0-b483-0bf7041c07cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:18.701661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc7420ec-903c-4fc0-b483-0bf7041c07cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:18.702094 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc7420ec-903c-4fc0-b483-0bf7041c07cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:18.731722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fc7420ec-903c-4fc0-b483-0bf7041c07cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045311 Aug 24 06:22:18.732331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 409/811] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:18.742076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e98dbd03-581b-4c6a-98f6-746f5e97dc62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:18.744230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e98dbd03-581b-4c6a-98f6-746f5e97dc62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:18.750631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98dbd03-581b-4c6a-98f6-746f5e97dc62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:18.751106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98dbd03-581b-4c6a-98f6-746f5e97dc62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:18.751531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98dbd03-581b-4c6a-98f6-746f5e97dc62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:18.752212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98dbd03-581b-4c6a-98f6-746f5e97dc62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:18.752686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98dbd03-581b-4c6a-98f6-746f5e97dc62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:18.753103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98dbd03-581b-4c6a-98f6-746f5e97dc62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:18.783684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e98dbd03-581b-4c6a-98f6-746f5e97dc62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045555 Aug 24 06:22:18.784262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 403/812] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:19.743610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-66443521-f7cb-4831-a173-f334a3cc135c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:19.745903 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-66443521-f7cb-4831-a173-f334a3cc135c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:19.752482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66443521-f7cb-4831-a173-f334a3cc135c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:19.753041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66443521-f7cb-4831-a173-f334a3cc135c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:19.753480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66443521-f7cb-4831-a173-f334a3cc135c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:19.754198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66443521-f7cb-4831-a173-f334a3cc135c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:19.754647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66443521-f7cb-4831-a173-f334a3cc135c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:19.755068 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-66443521-f7cb-4831-a173-f334a3cc135c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:19.783956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-66443521-f7cb-4831-a173-f334a3cc135c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Aug 24 06:22:19.784535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 410/813] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:19.796145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-babe77ef-23e4-4941-b133-a50e178524ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:19.798312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-babe77ef-23e4-4941-b133-a50e178524ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:19.805033 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-babe77ef-23e4-4941-b133-a50e178524ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:19.805519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-babe77ef-23e4-4941-b133-a50e178524ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:19.805977 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-babe77ef-23e4-4941-b133-a50e178524ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:19.806714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-babe77ef-23e4-4941-b133-a50e178524ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:19.807168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-babe77ef-23e4-4941-b133-a50e178524ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:19.807618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-babe77ef-23e4-4941-b133-a50e178524ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:19.841278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-babe77ef-23e4-4941-b133-a50e178524ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046848 Aug 24 06:22:19.841876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 404/814] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:20.796737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1cce80ec-16fa-4931-ab4e-bdcc4677a7bf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:20.798852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1cce80ec-16fa-4931-ab4e-bdcc4677a7bf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:20.805912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cce80ec-16fa-4931-ab4e-bdcc4677a7bf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:20.806385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cce80ec-16fa-4931-ab4e-bdcc4677a7bf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:20.806807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cce80ec-16fa-4931-ab4e-bdcc4677a7bf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:20.807484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cce80ec-16fa-4931-ab4e-bdcc4677a7bf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:20.807920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cce80ec-16fa-4931-ab4e-bdcc4677a7bf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:20.808333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cce80ec-16fa-4931-ab4e-bdcc4677a7bf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:20.837444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1cce80ec-16fa-4931-ab4e-bdcc4677a7bf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Aug 24 06:22:20.837989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 411/815] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:20.854220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-02de8795-dbc1-4237-9713-e2dd4d3d0a2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:20.856427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-02de8795-dbc1-4237-9713-e2dd4d3d0a2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:20.862820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-02de8795-dbc1-4237-9713-e2dd4d3d0a2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:20.863288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-02de8795-dbc1-4237-9713-e2dd4d3d0a2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:20.863762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-02de8795-dbc1-4237-9713-e2dd4d3d0a2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:20.864441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-02de8795-dbc1-4237-9713-e2dd4d3d0a2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:20.864914 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-02de8795-dbc1-4237-9713-e2dd4d3d0a2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:20.865323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-02de8795-dbc1-4237-9713-e2dd4d3d0a2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:20.895519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-02de8795-dbc1-4237-9713-e2dd4d3d0a2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045683 Aug 24 06:22:20.896083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 405/816] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:20 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:21.849635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-49940b09-6b50-461b-9fbc-b876600c4473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:21.852187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-49940b09-6b50-461b-9fbc-b876600c4473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:21.858765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49940b09-6b50-461b-9fbc-b876600c4473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:21.859236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49940b09-6b50-461b-9fbc-b876600c4473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:21.859668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49940b09-6b50-461b-9fbc-b876600c4473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:21.860349 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49940b09-6b50-461b-9fbc-b876600c4473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:21.860826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49940b09-6b50-461b-9fbc-b876600c4473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:21.861243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49940b09-6b50-461b-9fbc-b876600c4473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:21.890522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-49940b09-6b50-461b-9fbc-b876600c4473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044960 Aug 24 06:22:21.891065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 412/817] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:21 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:22:21.907319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-66468ab3-c82b-44bf-9d3c-c5d8b479478d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:21.909580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-66468ab3-c82b-44bf-9d3c-c5d8b479478d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:21.916555 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66468ab3-c82b-44bf-9d3c-c5d8b479478d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:21.917034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66468ab3-c82b-44bf-9d3c-c5d8b479478d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:21.917462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66468ab3-c82b-44bf-9d3c-c5d8b479478d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:21.918146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66468ab3-c82b-44bf-9d3c-c5d8b479478d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:21.918592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66468ab3-c82b-44bf-9d3c-c5d8b479478d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:21.919008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66468ab3-c82b-44bf-9d3c-c5d8b479478d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:21.948152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-66468ab3-c82b-44bf-9d3c-c5d8b479478d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044879 Aug 24 06:22:21.948726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 406/818] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:22.903740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-dac610c8-4c5c-47e4-8d06-f9e697463a70 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:22.905897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-dac610c8-4c5c-47e4-8d06-f9e697463a70 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:22.912296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dac610c8-4c5c-47e4-8d06-f9e697463a70 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:22.912811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dac610c8-4c5c-47e4-8d06-f9e697463a70 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:22.913857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dac610c8-4c5c-47e4-8d06-f9e697463a70 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:22.914568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dac610c8-4c5c-47e4-8d06-f9e697463a70 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:22.915007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dac610c8-4c5c-47e4-8d06-f9e697463a70 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:22.915422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dac610c8-4c5c-47e4-8d06-f9e697463a70 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:22.945127 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-dac610c8-4c5c-47e4-8d06-f9e697463a70 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045351 Aug 24 06:22:22.945684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 413/819] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:22.960845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-eaf30519-e64d-4a9b-b801-42f5ffee839f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:22.962982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-eaf30519-e64d-4a9b-b801-42f5ffee839f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:22.969345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eaf30519-e64d-4a9b-b801-42f5ffee839f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:22.969824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eaf30519-e64d-4a9b-b801-42f5ffee839f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:22.970253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eaf30519-e64d-4a9b-b801-42f5ffee839f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:22.970940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eaf30519-e64d-4a9b-b801-42f5ffee839f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:22.971627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eaf30519-e64d-4a9b-b801-42f5ffee839f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:22.972118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eaf30519-e64d-4a9b-b801-42f5ffee839f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:23.002343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-eaf30519-e64d-4a9b-b801-42f5ffee839f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045942 Aug 24 06:22:23.002888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 407/820] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:22 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:23.957505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-82d1a7a3-dc09-497e-a6cf-38d4e41ee6fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:23.959672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-82d1a7a3-dc09-497e-a6cf-38d4e41ee6fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:23.966160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82d1a7a3-dc09-497e-a6cf-38d4e41ee6fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:23.966641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82d1a7a3-dc09-497e-a6cf-38d4e41ee6fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:23.967076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82d1a7a3-dc09-497e-a6cf-38d4e41ee6fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:23.967765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82d1a7a3-dc09-497e-a6cf-38d4e41ee6fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:23.968218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82d1a7a3-dc09-497e-a6cf-38d4e41ee6fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:23.968675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82d1a7a3-dc09-497e-a6cf-38d4e41ee6fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:23.998685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-82d1a7a3-dc09-497e-a6cf-38d4e41ee6fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045230 Aug 24 06:22:23.999240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 414/821] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:23 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:24.014627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0e56ff2b-7de8-43ad-b3bb-2ff434109e7e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:24.016799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0e56ff2b-7de8-43ad-b3bb-2ff434109e7e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:24.023252 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e56ff2b-7de8-43ad-b3bb-2ff434109e7e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:24.023825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e56ff2b-7de8-43ad-b3bb-2ff434109e7e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:24.024253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e56ff2b-7de8-43ad-b3bb-2ff434109e7e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:24.024994 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e56ff2b-7de8-43ad-b3bb-2ff434109e7e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:24.025468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e56ff2b-7de8-43ad-b3bb-2ff434109e7e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:24.025887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e56ff2b-7de8-43ad-b3bb-2ff434109e7e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:24.056945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0e56ff2b-7de8-43ad-b3bb-2ff434109e7e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046316 Aug 24 06:22:24.057500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 408/822] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:25.011248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-868db7b9-cb1b-400e-8e82-dbd29b30c02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:25.013352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-868db7b9-cb1b-400e-8e82-dbd29b30c02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:25.019729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868db7b9-cb1b-400e-8e82-dbd29b30c02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:25.020198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868db7b9-cb1b-400e-8e82-dbd29b30c02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:25.020654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868db7b9-cb1b-400e-8e82-dbd29b30c02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:25.021333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868db7b9-cb1b-400e-8e82-dbd29b30c02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:25.021776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868db7b9-cb1b-400e-8e82-dbd29b30c02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:25.022189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-868db7b9-cb1b-400e-8e82-dbd29b30c02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:25.051577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-868db7b9-cb1b-400e-8e82-dbd29b30c02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044398 Aug 24 06:22:25.052125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 415/823] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:25 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:25.069118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2ed8362d-463e-45f7-9fff-f555ef2bb2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:25.071864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2ed8362d-463e-45f7-9fff-f555ef2bb2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:25.078570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ed8362d-463e-45f7-9fff-f555ef2bb2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:25.079043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ed8362d-463e-45f7-9fff-f555ef2bb2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:25.079496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ed8362d-463e-45f7-9fff-f555ef2bb2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:25.080178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ed8362d-463e-45f7-9fff-f555ef2bb2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:25.080736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ed8362d-463e-45f7-9fff-f555ef2bb2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:25.081134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ed8362d-463e-45f7-9fff-f555ef2bb2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:25.113288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2ed8362d-463e-45f7-9fff-f555ef2bb2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048019 Aug 24 06:22:25.113843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 409/824] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:26.065422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-09fa7f3e-1c69-4c49-9620-49bcb6672041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:26.067456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-09fa7f3e-1c69-4c49-9620-49bcb6672041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:26.073886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fa7f3e-1c69-4c49-9620-49bcb6672041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:26.074364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fa7f3e-1c69-4c49-9620-49bcb6672041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:26.074796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fa7f3e-1c69-4c49-9620-49bcb6672041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:26.075481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fa7f3e-1c69-4c49-9620-49bcb6672041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:26.075929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fa7f3e-1c69-4c49-9620-49bcb6672041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:26.076348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fa7f3e-1c69-4c49-9620-49bcb6672041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:26.106361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-09fa7f3e-1c69-4c49-9620-49bcb6672041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044980 Aug 24 06:22:26.111777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 416/825] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:26.126580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7326247f-46d2-4f3f-ba30-9331fdb8139c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:26.129197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7326247f-46d2-4f3f-ba30-9331fdb8139c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:26.136708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7326247f-46d2-4f3f-ba30-9331fdb8139c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:26.137185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7326247f-46d2-4f3f-ba30-9331fdb8139c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:26.137619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7326247f-46d2-4f3f-ba30-9331fdb8139c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:26.138415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7326247f-46d2-4f3f-ba30-9331fdb8139c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:26.138893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7326247f-46d2-4f3f-ba30-9331fdb8139c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:26.139313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7326247f-46d2-4f3f-ba30-9331fdb8139c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:26.169592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7326247f-46d2-4f3f-ba30-9331fdb8139c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047423 Aug 24 06:22:26.170151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 410/826] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:27.123265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d03ca9f9-16ce-473a-949f-17d9acbeaaa6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:27.125463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d03ca9f9-16ce-473a-949f-17d9acbeaaa6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:27.131817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d03ca9f9-16ce-473a-949f-17d9acbeaaa6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:27.132317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d03ca9f9-16ce-473a-949f-17d9acbeaaa6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:27.132779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d03ca9f9-16ce-473a-949f-17d9acbeaaa6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:27.133466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d03ca9f9-16ce-473a-949f-17d9acbeaaa6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:27.133917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d03ca9f9-16ce-473a-949f-17d9acbeaaa6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:27.134335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d03ca9f9-16ce-473a-949f-17d9acbeaaa6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:27.164842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d03ca9f9-16ce-473a-949f-17d9acbeaaa6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045639 Aug 24 06:22:27.165402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 417/827] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:27.181982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-82bab3c6-6b57-4ea5-b854-bf1ece904bff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:27.184269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-82bab3c6-6b57-4ea5-b854-bf1ece904bff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:27.190682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82bab3c6-6b57-4ea5-b854-bf1ece904bff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:27.191150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82bab3c6-6b57-4ea5-b854-bf1ece904bff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:27.191575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82bab3c6-6b57-4ea5-b854-bf1ece904bff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:27.192250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82bab3c6-6b57-4ea5-b854-bf1ece904bff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:27.192725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82bab3c6-6b57-4ea5-b854-bf1ece904bff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:27.193137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-82bab3c6-6b57-4ea5-b854-bf1ece904bff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:27.221842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-82bab3c6-6b57-4ea5-b854-bf1ece904bff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045038 Aug 24 06:22:27.222431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 411/828] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:28.176181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-43975502-57eb-4524-a8db-c338737781cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:28.178342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-43975502-57eb-4524-a8db-c338737781cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:28.185371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-43975502-57eb-4524-a8db-c338737781cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:28.185847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-43975502-57eb-4524-a8db-c338737781cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:28.186278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-43975502-57eb-4524-a8db-c338737781cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:28.186960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-43975502-57eb-4524-a8db-c338737781cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:28.187407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-43975502-57eb-4524-a8db-c338737781cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:28.187833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-43975502-57eb-4524-a8db-c338737781cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:28.223107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-43975502-57eb-4524-a8db-c338737781cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050838 Aug 24 06:22:28.223658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 418/829] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:28 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:28.234708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-68c8f4a4-0c26-4105-89e8-c347849dcee9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:28.236899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-68c8f4a4-0c26-4105-89e8-c347849dcee9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:28.243754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68c8f4a4-0c26-4105-89e8-c347849dcee9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:28.244255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68c8f4a4-0c26-4105-89e8-c347849dcee9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:28.244720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68c8f4a4-0c26-4105-89e8-c347849dcee9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:28.245397 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68c8f4a4-0c26-4105-89e8-c347849dcee9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:28.245845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68c8f4a4-0c26-4105-89e8-c347849dcee9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:28.246264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68c8f4a4-0c26-4105-89e8-c347849dcee9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:28.275691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-68c8f4a4-0c26-4105-89e8-c347849dcee9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044909 Aug 24 06:22:28.276248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 412/830] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:28 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:29.235608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5b529815-57e6-4e72-b57d-d53338619eec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:29.237824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5b529815-57e6-4e72-b57d-d53338619eec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:29.244192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b529815-57e6-4e72-b57d-d53338619eec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:29.244700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b529815-57e6-4e72-b57d-d53338619eec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:29.245123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b529815-57e6-4e72-b57d-d53338619eec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:29.245803 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b529815-57e6-4e72-b57d-d53338619eec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:29.246245 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b529815-57e6-4e72-b57d-d53338619eec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:29.246656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b529815-57e6-4e72-b57d-d53338619eec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:29.275897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5b529815-57e6-4e72-b57d-d53338619eec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044416 Aug 24 06:22:29.276443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 419/831] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:29.287824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-95393147-3339-4dd3-8670-eae76ea9b4c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:29.290162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-95393147-3339-4dd3-8670-eae76ea9b4c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:29.296960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95393147-3339-4dd3-8670-eae76ea9b4c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:29.297497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95393147-3339-4dd3-8670-eae76ea9b4c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:29.298019 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95393147-3339-4dd3-8670-eae76ea9b4c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:29.298763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95393147-3339-4dd3-8670-eae76ea9b4c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:29.299210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95393147-3339-4dd3-8670-eae76ea9b4c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:29.299661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95393147-3339-4dd3-8670-eae76ea9b4c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:29.330998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-95393147-3339-4dd3-8670-eae76ea9b4c4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047559 Aug 24 06:22:29.331554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 413/832] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:29 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:30.287368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3147b538-a4ac-4e01-8a47-71f60eb9946d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:30.290126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3147b538-a4ac-4e01-8a47-71f60eb9946d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:30.296421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3147b538-a4ac-4e01-8a47-71f60eb9946d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:30.296929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3147b538-a4ac-4e01-8a47-71f60eb9946d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:30.297354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3147b538-a4ac-4e01-8a47-71f60eb9946d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:30.298033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3147b538-a4ac-4e01-8a47-71f60eb9946d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:30.298472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3147b538-a4ac-4e01-8a47-71f60eb9946d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:30.298884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3147b538-a4ac-4e01-8a47-71f60eb9946d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:30.327386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3147b538-a4ac-4e01-8a47-71f60eb9946d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Aug 24 06:22:30.328003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 420/833] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:30.343281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-be407425-1217-46d8-a3cf-248735a5210f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:30.345380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-be407425-1217-46d8-a3cf-248735a5210f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:30.352207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be407425-1217-46d8-a3cf-248735a5210f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:30.352836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be407425-1217-46d8-a3cf-248735a5210f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:30.353262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be407425-1217-46d8-a3cf-248735a5210f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:30.353933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be407425-1217-46d8-a3cf-248735a5210f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:30.354373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be407425-1217-46d8-a3cf-248735a5210f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:30.354781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be407425-1217-46d8-a3cf-248735a5210f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:30.382811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-be407425-1217-46d8-a3cf-248735a5210f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043495 Aug 24 06:22:30.383343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 414/834] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:31.339793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5c866524-05ce-44c8-94fc-741bc4e9f9c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:31.342015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5c866524-05ce-44c8-94fc-741bc4e9f9c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:31.348357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c866524-05ce-44c8-94fc-741bc4e9f9c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:31.348880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c866524-05ce-44c8-94fc-741bc4e9f9c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:31.349313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c866524-05ce-44c8-94fc-741bc4e9f9c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:31.349991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c866524-05ce-44c8-94fc-741bc4e9f9c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:31.350931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c866524-05ce-44c8-94fc-741bc4e9f9c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:31.351347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c866524-05ce-44c8-94fc-741bc4e9f9c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:31.381207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5c866524-05ce-44c8-94fc-741bc4e9f9c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045669 Aug 24 06:22:31.381786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 421/835] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:31 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:31.395305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-05acfbb6-f263-4042-a1bc-367d2d5ee514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:31.397443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-05acfbb6-f263-4042-a1bc-367d2d5ee514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:31.403822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-05acfbb6-f263-4042-a1bc-367d2d5ee514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:31.404342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-05acfbb6-f263-4042-a1bc-367d2d5ee514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:31.404810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-05acfbb6-f263-4042-a1bc-367d2d5ee514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:31.405490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-05acfbb6-f263-4042-a1bc-367d2d5ee514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:31.405934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-05acfbb6-f263-4042-a1bc-367d2d5ee514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:31.406394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-05acfbb6-f263-4042-a1bc-367d2d5ee514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:31.436148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-05acfbb6-f263-4042-a1bc-367d2d5ee514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044886 Aug 24 06:22:31.436724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 415/836] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:32.393793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-080e23d6-6112-4150-a639-c7f00969d292 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:32.395841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-080e23d6-6112-4150-a639-c7f00969d292 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:32.403326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-080e23d6-6112-4150-a639-c7f00969d292 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:32.403809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-080e23d6-6112-4150-a639-c7f00969d292 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:32.404248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-080e23d6-6112-4150-a639-c7f00969d292 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:32.405057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-080e23d6-6112-4150-a639-c7f00969d292 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:32.405509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-080e23d6-6112-4150-a639-c7f00969d292 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:32.405935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-080e23d6-6112-4150-a639-c7f00969d292 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:32.435707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-080e23d6-6112-4150-a639-c7f00969d292 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Aug 24 06:22:32.436312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 422/837] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:32.449428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7ef7e179-7ddc-4514-9613-17603e819207 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:32.451871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7ef7e179-7ddc-4514-9613-17603e819207 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:32.458495 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ef7e179-7ddc-4514-9613-17603e819207 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:32.459079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ef7e179-7ddc-4514-9613-17603e819207 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:32.459614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ef7e179-7ddc-4514-9613-17603e819207 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:32.460949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ef7e179-7ddc-4514-9613-17603e819207 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:32.461407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ef7e179-7ddc-4514-9613-17603e819207 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:32.461887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7ef7e179-7ddc-4514-9613-17603e819207 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:32.478394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:22:32.491542 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7ef7e179-7ddc-4514-9613-17603e819207 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046916 Aug 24 06:22:32.495343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 416/838] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:33.448579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-25430737-169a-48f2-9d88-f31cfc32bace tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:33.450731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-25430737-169a-48f2-9d88-f31cfc32bace tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:33.453081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=58 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:22:33.457726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25430737-169a-48f2-9d88-f31cfc32bace tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:33.458231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25430737-169a-48f2-9d88-f31cfc32bace tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:33.458664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25430737-169a-48f2-9d88-f31cfc32bace tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:33.459347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25430737-169a-48f2-9d88-f31cfc32bace tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:33.459802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25430737-169a-48f2-9d88-f31cfc32bace tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:33.460218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-25430737-169a-48f2-9d88-f31cfc32bace tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:33.484364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:22:33.488936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-25430737-169a-48f2-9d88-f31cfc32bace tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044879 Aug 24 06:22:33.489486 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 423/839] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:33.505089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f3edee76-2529-47ee-943b-f027bc4311bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:33.507788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f3edee76-2529-47ee-943b-f027bc4311bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:33.514661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3edee76-2529-47ee-943b-f027bc4311bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:33.515136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3edee76-2529-47ee-943b-f027bc4311bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:33.515566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3edee76-2529-47ee-943b-f027bc4311bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:33.516244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3edee76-2529-47ee-943b-f027bc4311bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:33.516737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3edee76-2529-47ee-943b-f027bc4311bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:33.517154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f3edee76-2529-47ee-943b-f027bc4311bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:33.545767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f3edee76-2529-47ee-943b-f027bc4311bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044620 Aug 24 06:22:33.546324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 417/840] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:34.501529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e96d5de5-4e61-496a-bf16-8291241bec97 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:34.503690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e96d5de5-4e61-496a-bf16-8291241bec97 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:34.511200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96d5de5-4e61-496a-bf16-8291241bec97 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:34.511681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96d5de5-4e61-496a-bf16-8291241bec97 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:34.512224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96d5de5-4e61-496a-bf16-8291241bec97 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:34.512951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96d5de5-4e61-496a-bf16-8291241bec97 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:34.513409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96d5de5-4e61-496a-bf16-8291241bec97 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:34.513836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96d5de5-4e61-496a-bf16-8291241bec97 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:34.544042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e96d5de5-4e61-496a-bf16-8291241bec97 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046838 Aug 24 06:22:34.544629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 424/841] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:34 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:34.558919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-690596a8-3384-4393-b621-8d08b8a757e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:34.561173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-690596a8-3384-4393-b621-8d08b8a757e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:34.568036 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-690596a8-3384-4393-b621-8d08b8a757e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:34.568648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-690596a8-3384-4393-b621-8d08b8a757e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:34.569605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-690596a8-3384-4393-b621-8d08b8a757e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:34.570344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-690596a8-3384-4393-b621-8d08b8a757e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:34.570798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-690596a8-3384-4393-b621-8d08b8a757e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:34.571308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-690596a8-3384-4393-b621-8d08b8a757e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:34.601862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-690596a8-3384-4393-b621-8d08b8a757e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047212 Aug 24 06:22:34.602428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 418/842] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:34 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:35.556735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c962880f-cdfb-46fd-b739-0c2a3a1fe722 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:35.558852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c962880f-cdfb-46fd-b739-0c2a3a1fe722 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:35.565349 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c962880f-cdfb-46fd-b739-0c2a3a1fe722 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:35.565818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c962880f-cdfb-46fd-b739-0c2a3a1fe722 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:35.566251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c962880f-cdfb-46fd-b739-0c2a3a1fe722 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:35.566929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c962880f-cdfb-46fd-b739-0c2a3a1fe722 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:35.567373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c962880f-cdfb-46fd-b739-0c2a3a1fe722 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:35.567786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c962880f-cdfb-46fd-b739-0c2a3a1fe722 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:35.596749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c962880f-cdfb-46fd-b739-0c2a3a1fe722 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Aug 24 06:22:35.597224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 425/843] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:35.613974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b1691b69-1bb0-42a1-98db-20c7fef3f841 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:35.616114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b1691b69-1bb0-42a1-98db-20c7fef3f841 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:35.622813 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1691b69-1bb0-42a1-98db-20c7fef3f841 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:35.623384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1691b69-1bb0-42a1-98db-20c7fef3f841 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:35.623809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1691b69-1bb0-42a1-98db-20c7fef3f841 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:35.624521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1691b69-1bb0-42a1-98db-20c7fef3f841 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:35.624979 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1691b69-1bb0-42a1-98db-20c7fef3f841 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:35.625392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1691b69-1bb0-42a1-98db-20c7fef3f841 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:35.654387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b1691b69-1bb0-42a1-98db-20c7fef3f841 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044377 Aug 24 06:22:35.654944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 419/844] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:36.609348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-dcfb156c-e5c0-4ec6-867f-fa73f1eeecd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:36.611491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-dcfb156c-e5c0-4ec6-867f-fa73f1eeecd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:36.617861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcfb156c-e5c0-4ec6-867f-fa73f1eeecd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:36.618329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcfb156c-e5c0-4ec6-867f-fa73f1eeecd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:36.618751 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcfb156c-e5c0-4ec6-867f-fa73f1eeecd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:36.619428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcfb156c-e5c0-4ec6-867f-fa73f1eeecd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:36.619869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcfb156c-e5c0-4ec6-867f-fa73f1eeecd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:36.620280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcfb156c-e5c0-4ec6-867f-fa73f1eeecd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:36.649775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-dcfb156c-e5c0-4ec6-867f-fa73f1eeecd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044272 Aug 24 06:22:36.650255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 426/845] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:36 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:36.666692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-80654d36-8484-440d-8314-076cd583ee61 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:36.668829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-80654d36-8484-440d-8314-076cd583ee61 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:36.675196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80654d36-8484-440d-8314-076cd583ee61 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:36.675672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80654d36-8484-440d-8314-076cd583ee61 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:36.676103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80654d36-8484-440d-8314-076cd583ee61 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:36.676818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80654d36-8484-440d-8314-076cd583ee61 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:36.677265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80654d36-8484-440d-8314-076cd583ee61 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:36.677682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80654d36-8484-440d-8314-076cd583ee61 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:36.707470 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-80654d36-8484-440d-8314-076cd583ee61 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044736 Aug 24 06:22:36.708240 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 420/846] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:37.661876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bf9caa30-9827-440e-8b63-c6f5edb81c10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:37.664559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bf9caa30-9827-440e-8b63-c6f5edb81c10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:37.670876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf9caa30-9827-440e-8b63-c6f5edb81c10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:37.671344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf9caa30-9827-440e-8b63-c6f5edb81c10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:37.671771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf9caa30-9827-440e-8b63-c6f5edb81c10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:37.672514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf9caa30-9827-440e-8b63-c6f5edb81c10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:37.672962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf9caa30-9827-440e-8b63-c6f5edb81c10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:37.673375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf9caa30-9827-440e-8b63-c6f5edb81c10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:37.703050 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bf9caa30-9827-440e-8b63-c6f5edb81c10 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Aug 24 06:22:37.703530 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 427/847] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:37.719233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ab95118a-7e85-4c90-8af0-3abb890a4ee1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:37.721382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ab95118a-7e85-4c90-8af0-3abb890a4ee1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:37.728582 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab95118a-7e85-4c90-8af0-3abb890a4ee1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:37.729063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab95118a-7e85-4c90-8af0-3abb890a4ee1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:37.729492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab95118a-7e85-4c90-8af0-3abb890a4ee1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab95118a-7e85-4c90-8af0-3abb890a4ee1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:37.730627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab95118a-7e85-4c90-8af0-3abb890a4ee1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:37.731040 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab95118a-7e85-4c90-8af0-3abb890a4ee1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:37.760071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ab95118a-7e85-4c90-8af0-3abb890a4ee1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044759 Aug 24 06:22:37.760659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 421/848] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:38.715562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-979d7145-245c-49e0-95be-83e56b779c95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:38.717711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-979d7145-245c-49e0-95be-83e56b779c95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:38.724103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-979d7145-245c-49e0-95be-83e56b779c95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:38.724608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-979d7145-245c-49e0-95be-83e56b779c95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:38.725040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-979d7145-245c-49e0-95be-83e56b779c95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:38.725722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-979d7145-245c-49e0-95be-83e56b779c95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:38.726164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-979d7145-245c-49e0-95be-83e56b779c95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:38.726579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-979d7145-245c-49e0-95be-83e56b779c95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:38.755847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-979d7145-245c-49e0-95be-83e56b779c95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Aug 24 06:22:38.756321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 428/849] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:38 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:38.772271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-08dc10a3-adbe-4618-83b2-85f3a57e36a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:38.774436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-08dc10a3-adbe-4618-83b2-85f3a57e36a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:38.780967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-08dc10a3-adbe-4618-83b2-85f3a57e36a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:38.781448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-08dc10a3-adbe-4618-83b2-85f3a57e36a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:38.781894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-08dc10a3-adbe-4618-83b2-85f3a57e36a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:38.782588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-08dc10a3-adbe-4618-83b2-85f3a57e36a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:38.783041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-08dc10a3-adbe-4618-83b2-85f3a57e36a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:38.783504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-08dc10a3-adbe-4618-83b2-85f3a57e36a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:38.813916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-08dc10a3-adbe-4618-83b2-85f3a57e36a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045550 Aug 24 06:22:38.814474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 422/850] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:39.768870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2a1c9f96-3479-4dc4-aa9e-5d018e855c9e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:39.771237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2a1c9f96-3479-4dc4-aa9e-5d018e855c9e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:39.778408 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a1c9f96-3479-4dc4-aa9e-5d018e855c9e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:39.778882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a1c9f96-3479-4dc4-aa9e-5d018e855c9e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:39.779310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a1c9f96-3479-4dc4-aa9e-5d018e855c9e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:39.779996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a1c9f96-3479-4dc4-aa9e-5d018e855c9e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:39.780444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a1c9f96-3479-4dc4-aa9e-5d018e855c9e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:39.780888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a1c9f96-3479-4dc4-aa9e-5d018e855c9e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:39.811097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2a1c9f96-3479-4dc4-aa9e-5d018e855c9e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046050 Aug 24 06:22:39.811572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 429/851] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:39 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:39.826219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e1fc4ece-f580-490d-a1cf-101843224985 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:39.828361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e1fc4ece-f580-490d-a1cf-101843224985 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:39.835454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fc4ece-f580-490d-a1cf-101843224985 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:39.835934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fc4ece-f580-490d-a1cf-101843224985 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:39.836367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fc4ece-f580-490d-a1cf-101843224985 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:39.837085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fc4ece-f580-490d-a1cf-101843224985 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:39.837536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fc4ece-f580-490d-a1cf-101843224985 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:39.837952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fc4ece-f580-490d-a1cf-101843224985 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:39.866456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e1fc4ece-f580-490d-a1cf-101843224985 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044203 Aug 24 06:22:39.867009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 423/852] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:40.823207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-09bac8ee-164a-4441-a3a9-e00e8f4b933b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:40.825466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-09bac8ee-164a-4441-a3a9-e00e8f4b933b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:40.831793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09bac8ee-164a-4441-a3a9-e00e8f4b933b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:40.832266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09bac8ee-164a-4441-a3a9-e00e8f4b933b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:40.832737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09bac8ee-164a-4441-a3a9-e00e8f4b933b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:40.833417 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09bac8ee-164a-4441-a3a9-e00e8f4b933b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:40.833857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09bac8ee-164a-4441-a3a9-e00e8f4b933b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:40.834269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09bac8ee-164a-4441-a3a9-e00e8f4b933b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:40.863925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-09bac8ee-164a-4441-a3a9-e00e8f4b933b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Aug 24 06:22:40.864428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 430/853] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:40 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:40.877781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-49c4e8e7-64d5-47a8-ac1c-66b6996cdeff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:40.879863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-49c4e8e7-64d5-47a8-ac1c-66b6996cdeff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:40.886152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-49c4e8e7-64d5-47a8-ac1c-66b6996cdeff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:40.886623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-49c4e8e7-64d5-47a8-ac1c-66b6996cdeff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:40.887048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-49c4e8e7-64d5-47a8-ac1c-66b6996cdeff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:40.887721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-49c4e8e7-64d5-47a8-ac1c-66b6996cdeff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:40.888161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-49c4e8e7-64d5-47a8-ac1c-66b6996cdeff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:40.888611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-49c4e8e7-64d5-47a8-ac1c-66b6996cdeff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:40.918266 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-49c4e8e7-64d5-47a8-ac1c-66b6996cdeff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044391 Aug 24 06:22:40.918815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 424/854] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:41.876225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-965e3de5-ee9b-4b8c-84a4-f82a4037c355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:41.878514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-965e3de5-ee9b-4b8c-84a4-f82a4037c355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:41.885440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-965e3de5-ee9b-4b8c-84a4-f82a4037c355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:41.885937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-965e3de5-ee9b-4b8c-84a4-f82a4037c355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:41.886346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-965e3de5-ee9b-4b8c-84a4-f82a4037c355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:41.887028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-965e3de5-ee9b-4b8c-84a4-f82a4037c355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:41.887504 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-965e3de5-ee9b-4b8c-84a4-f82a4037c355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:41.887951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-965e3de5-ee9b-4b8c-84a4-f82a4037c355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:41.917998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-965e3de5-ee9b-4b8c-84a4-f82a4037c355 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045669 Aug 24 06:22:41.918472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 431/855] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:41 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:41.930028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f04b8398-3951-4ae5-b1fb-de6d94e1b81e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:41.932134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f04b8398-3951-4ae5-b1fb-de6d94e1b81e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:41.938530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04b8398-3951-4ae5-b1fb-de6d94e1b81e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:41.938977 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04b8398-3951-4ae5-b1fb-de6d94e1b81e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:41.939402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04b8398-3951-4ae5-b1fb-de6d94e1b81e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:41.940074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04b8398-3951-4ae5-b1fb-de6d94e1b81e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:41.940534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04b8398-3951-4ae5-b1fb-de6d94e1b81e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:41.940953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f04b8398-3951-4ae5-b1fb-de6d94e1b81e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:41.971109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f04b8398-3951-4ae5-b1fb-de6d94e1b81e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045290 Aug 24 06:22:41.971658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 425/856] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:41 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:22:42.930605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f5ec8447-aeb7-4841-988d-547462c8ce5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:42.932857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f5ec8447-aeb7-4841-988d-547462c8ce5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:42.939431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ec8447-aeb7-4841-988d-547462c8ce5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:42.939931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ec8447-aeb7-4841-988d-547462c8ce5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:42.940359 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ec8447-aeb7-4841-988d-547462c8ce5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:42.941071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ec8447-aeb7-4841-988d-547462c8ce5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:42.941517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ec8447-aeb7-4841-988d-547462c8ce5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:42.941932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ec8447-aeb7-4841-988d-547462c8ce5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:42.970848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f5ec8447-aeb7-4841-988d-547462c8ce5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Aug 24 06:22:42.971323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 432/857] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:42 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:42.983526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8f0155aa-777a-484a-87af-98b1aecbfa18 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:42.985894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8f0155aa-777a-484a-87af-98b1aecbfa18 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:42.992710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f0155aa-777a-484a-87af-98b1aecbfa18 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:42.993193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f0155aa-777a-484a-87af-98b1aecbfa18 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:42.993627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f0155aa-777a-484a-87af-98b1aecbfa18 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:42.994318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f0155aa-777a-484a-87af-98b1aecbfa18 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:42.994797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f0155aa-777a-484a-87af-98b1aecbfa18 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:42.995218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f0155aa-777a-484a-87af-98b1aecbfa18 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:43.028769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8f0155aa-777a-484a-87af-98b1aecbfa18 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049451 Aug 24 06:22:43.029326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 426/858] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:43.983838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-38802cbe-10f4-4869-94cd-cb21bc92015a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:43.985909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-38802cbe-10f4-4869-94cd-cb21bc92015a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:43.992763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38802cbe-10f4-4869-94cd-cb21bc92015a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:43.993233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38802cbe-10f4-4869-94cd-cb21bc92015a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:43.993663 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38802cbe-10f4-4869-94cd-cb21bc92015a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:43.994337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38802cbe-10f4-4869-94cd-cb21bc92015a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:43.994779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38802cbe-10f4-4869-94cd-cb21bc92015a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:43.995196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38802cbe-10f4-4869-94cd-cb21bc92015a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:44.024262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-38802cbe-10f4-4869-94cd-cb21bc92015a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Aug 24 06:22:44.024834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 433/859] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:43 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:44.040961 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-13050cf3-2f06-4d35-817e-77439450b686 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:44.043092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-13050cf3-2f06-4d35-817e-77439450b686 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:44.049446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13050cf3-2f06-4d35-817e-77439450b686 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:44.049931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13050cf3-2f06-4d35-817e-77439450b686 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:44.050360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13050cf3-2f06-4d35-817e-77439450b686 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:44.051037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13050cf3-2f06-4d35-817e-77439450b686 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:44.051481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13050cf3-2f06-4d35-817e-77439450b686 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:44.051894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13050cf3-2f06-4d35-817e-77439450b686 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:44.081500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-13050cf3-2f06-4d35-817e-77439450b686 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044573 Aug 24 06:22:44.082054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 427/860] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:45.036669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9e0d4170-b508-4bb7-addf-4e35e8bc9343 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:45.038755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9e0d4170-b508-4bb7-addf-4e35e8bc9343 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:45.045151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e0d4170-b508-4bb7-addf-4e35e8bc9343 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:45.045621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e0d4170-b508-4bb7-addf-4e35e8bc9343 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:45.046046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e0d4170-b508-4bb7-addf-4e35e8bc9343 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:45.046761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e0d4170-b508-4bb7-addf-4e35e8bc9343 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:45.047203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e0d4170-b508-4bb7-addf-4e35e8bc9343 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:45.047617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e0d4170-b508-4bb7-addf-4e35e8bc9343 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:45.076488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9e0d4170-b508-4bb7-addf-4e35e8bc9343 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Aug 24 06:22:45.077052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 434/861] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:45 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:45.093716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b5ddf760-1719-47c5-8562-fc55e484867e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:45.101725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b5ddf760-1719-47c5-8562-fc55e484867e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:45.102509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ddf760-1719-47c5-8562-fc55e484867e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:45.102984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ddf760-1719-47c5-8562-fc55e484867e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:45.103413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ddf760-1719-47c5-8562-fc55e484867e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:45.104093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ddf760-1719-47c5-8562-fc55e484867e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:45.104566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ddf760-1719-47c5-8562-fc55e484867e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:45.104984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5ddf760-1719-47c5-8562-fc55e484867e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:45.133955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b5ddf760-1719-47c5-8562-fc55e484867e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044193 Aug 24 06:22:45.134500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 428/862] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:46.088715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f457019c-34af-407f-bc18-70514c310986 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:46.090877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f457019c-34af-407f-bc18-70514c310986 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:46.097235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f457019c-34af-407f-bc18-70514c310986 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:46.105721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f457019c-34af-407f-bc18-70514c310986 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:46.105721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f457019c-34af-407f-bc18-70514c310986 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:46.105721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f457019c-34af-407f-bc18-70514c310986 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:46.105721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f457019c-34af-407f-bc18-70514c310986 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:46.106154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f457019c-34af-407f-bc18-70514c310986 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:46.128314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f457019c-34af-407f-bc18-70514c310986 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043591 Aug 24 06:22:46.128895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 435/863] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:46.151514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ab09a572-e9da-4144-83cb-c67eda2485bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:46.151514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ab09a572-e9da-4144-83cb-c67eda2485bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:46.154867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab09a572-e9da-4144-83cb-c67eda2485bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:46.155359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab09a572-e9da-4144-83cb-c67eda2485bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:46.155779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab09a572-e9da-4144-83cb-c67eda2485bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:46.156459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab09a572-e9da-4144-83cb-c67eda2485bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:46.156936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab09a572-e9da-4144-83cb-c67eda2485bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:46.157355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab09a572-e9da-4144-83cb-c67eda2485bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:46.186576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ab09a572-e9da-4144-83cb-c67eda2485bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044295 Aug 24 06:22:46.187126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 429/864] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:47.141358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7079677c-c795-445b-845c-2e135072a12e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:47.143601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7079677c-c795-445b-845c-2e135072a12e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:47.150281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7079677c-c795-445b-845c-2e135072a12e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:47.150755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7079677c-c795-445b-845c-2e135072a12e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:47.151185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7079677c-c795-445b-845c-2e135072a12e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:47.151869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7079677c-c795-445b-845c-2e135072a12e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:47.152316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7079677c-c795-445b-845c-2e135072a12e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:47.152771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7079677c-c795-445b-845c-2e135072a12e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:47.182261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7079677c-c795-445b-845c-2e135072a12e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Aug 24 06:22:47.182861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 436/865] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:47.199290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-661fec5c-0d4b-4a2d-87d9-d553425ba1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:47.201513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-661fec5c-0d4b-4a2d-87d9-d553425ba1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:47.203782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=60 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:22:47.208424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-661fec5c-0d4b-4a2d-87d9-d553425ba1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:47.208944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-661fec5c-0d4b-4a2d-87d9-d553425ba1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:47.210029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-661fec5c-0d4b-4a2d-87d9-d553425ba1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:47.210716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-661fec5c-0d4b-4a2d-87d9-d553425ba1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:47.211186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-661fec5c-0d4b-4a2d-87d9-d553425ba1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:47.211603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-661fec5c-0d4b-4a2d-87d9-d553425ba1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:47.240237 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-661fec5c-0d4b-4a2d-87d9-d553425ba1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044963 Aug 24 06:22:47.240835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 430/866] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:48.194719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5730cac9-db35-4763-b144-b4c261fcf136 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:48.196953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5730cac9-db35-4763-b144-b4c261fcf136 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:48.203501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5730cac9-db35-4763-b144-b4c261fcf136 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:48.203986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5730cac9-db35-4763-b144-b4c261fcf136 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:48.204423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5730cac9-db35-4763-b144-b4c261fcf136 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:48.205145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5730cac9-db35-4763-b144-b4c261fcf136 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:48.205622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5730cac9-db35-4763-b144-b4c261fcf136 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:48.206045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5730cac9-db35-4763-b144-b4c261fcf136 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:48.236113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5730cac9-db35-4763-b144-b4c261fcf136 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045343 Aug 24 06:22:48.236603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 437/867] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:48.253096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0a52f048-6873-452e-af82-71a1002c6157 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:48.255182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0a52f048-6873-452e-af82-71a1002c6157 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:48.261844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a52f048-6873-452e-af82-71a1002c6157 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:48.262318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a52f048-6873-452e-af82-71a1002c6157 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:48.262746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a52f048-6873-452e-af82-71a1002c6157 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:48.263501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a52f048-6873-452e-af82-71a1002c6157 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:48.263949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a52f048-6873-452e-af82-71a1002c6157 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:48.264365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a52f048-6873-452e-af82-71a1002c6157 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:48.293573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0a52f048-6873-452e-af82-71a1002c6157 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045066 Aug 24 06:22:48.294127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 431/868] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:49.248233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-12b93ec1-25d9-4267-992f-2a396e19cda0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:49.250427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-12b93ec1-25d9-4267-992f-2a396e19cda0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:49.257585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12b93ec1-25d9-4267-992f-2a396e19cda0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:49.258064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12b93ec1-25d9-4267-992f-2a396e19cda0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:49.258497 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12b93ec1-25d9-4267-992f-2a396e19cda0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:49.259189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12b93ec1-25d9-4267-992f-2a396e19cda0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:49.259644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12b93ec1-25d9-4267-992f-2a396e19cda0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:49.260062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12b93ec1-25d9-4267-992f-2a396e19cda0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:49.289469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-12b93ec1-25d9-4267-992f-2a396e19cda0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045108 Aug 24 06:22:49.289939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 438/869] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:49 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:49.306664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ce87412e-4ddc-44f0-854c-084a83a01a81 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:49.308877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ce87412e-4ddc-44f0-854c-084a83a01a81 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:49.315401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce87412e-4ddc-44f0-854c-084a83a01a81 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:49.315880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce87412e-4ddc-44f0-854c-084a83a01a81 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:49.316312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce87412e-4ddc-44f0-854c-084a83a01a81 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:49.317028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce87412e-4ddc-44f0-854c-084a83a01a81 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:49.317483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce87412e-4ddc-44f0-854c-084a83a01a81 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:49.317904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce87412e-4ddc-44f0-854c-084a83a01a81 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:49.347113 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ce87412e-4ddc-44f0-854c-084a83a01a81 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045233 Aug 24 06:22:49.347664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 432/870] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:50.301824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-300c4c68-3994-469d-af08-5705711db421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:50.303899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-300c4c68-3994-469d-af08-5705711db421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:50.310735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-300c4c68-3994-469d-af08-5705711db421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:50.311242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-300c4c68-3994-469d-af08-5705711db421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:50.311670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-300c4c68-3994-469d-af08-5705711db421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:50.312352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-300c4c68-3994-469d-af08-5705711db421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:50.312841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-300c4c68-3994-469d-af08-5705711db421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:50.313310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-300c4c68-3994-469d-af08-5705711db421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:50.343111 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-300c4c68-3994-469d-af08-5705711db421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 Aug 24 06:22:50.343656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 439/871] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:22:50.359232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4c00ecec-8b15-4647-8455-17b977d7e623 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:50.361348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4c00ecec-8b15-4647-8455-17b977d7e623 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:50.367675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4c00ecec-8b15-4647-8455-17b977d7e623 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:50.368162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4c00ecec-8b15-4647-8455-17b977d7e623 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:50.368607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4c00ecec-8b15-4647-8455-17b977d7e623 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:50.369283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4c00ecec-8b15-4647-8455-17b977d7e623 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:50.369724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4c00ecec-8b15-4647-8455-17b977d7e623 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:50.370137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4c00ecec-8b15-4647-8455-17b977d7e623 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:50.373747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:22:50.402375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4c00ecec-8b15-4647-8455-17b977d7e623 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046953 Aug 24 06:22:50.402947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 433/872] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:51.355824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-57e292aa-2f5d-4377-bead-7e94482d1a1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:51.357996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-57e292aa-2f5d-4377-bead-7e94482d1a1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:51.364587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57e292aa-2f5d-4377-bead-7e94482d1a1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:51.365068 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57e292aa-2f5d-4377-bead-7e94482d1a1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:51.365507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57e292aa-2f5d-4377-bead-7e94482d1a1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:51.366241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57e292aa-2f5d-4377-bead-7e94482d1a1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:51.366697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57e292aa-2f5d-4377-bead-7e94482d1a1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:51.367122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57e292aa-2f5d-4377-bead-7e94482d1a1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:51.383273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:22:51.395818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-57e292aa-2f5d-4377-bead-7e94482d1a1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044037 Aug 24 06:22:51.396311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 440/873] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:51.415517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a1ac609e-6fbe-4f81-87a3-95a13272923e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:51.417682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a1ac609e-6fbe-4f81-87a3-95a13272923e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:51.424398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a1ac609e-6fbe-4f81-87a3-95a13272923e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:51.424899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a1ac609e-6fbe-4f81-87a3-95a13272923e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:51.425332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a1ac609e-6fbe-4f81-87a3-95a13272923e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:51.426007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a1ac609e-6fbe-4f81-87a3-95a13272923e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:51.426455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a1ac609e-6fbe-4f81-87a3-95a13272923e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:51.426872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a1ac609e-6fbe-4f81-87a3-95a13272923e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:51.455107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a1ac609e-6fbe-4f81-87a3-95a13272923e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044308 Aug 24 06:22:51.455649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 434/874] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:51 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:52.408944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-64fed1ab-2afd-462d-bdf6-7f0a89b8e012 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:52.411140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-64fed1ab-2afd-462d-bdf6-7f0a89b8e012 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:52.418462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64fed1ab-2afd-462d-bdf6-7f0a89b8e012 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:52.418974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64fed1ab-2afd-462d-bdf6-7f0a89b8e012 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:52.419406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64fed1ab-2afd-462d-bdf6-7f0a89b8e012 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:52.420134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64fed1ab-2afd-462d-bdf6-7f0a89b8e012 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:52.420609 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64fed1ab-2afd-462d-bdf6-7f0a89b8e012 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:52.421029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64fed1ab-2afd-462d-bdf6-7f0a89b8e012 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:52.451758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-64fed1ab-2afd-462d-bdf6-7f0a89b8e012 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047244 Aug 24 06:22:52.452313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 441/875] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:52 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:52.467429 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a5f2ab05-85c5-4030-be2d-8d7ea90c87ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:52.469633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a5f2ab05-85c5-4030-be2d-8d7ea90c87ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:52.476378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f2ab05-85c5-4030-be2d-8d7ea90c87ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:52.476889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f2ab05-85c5-4030-be2d-8d7ea90c87ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:52.477317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f2ab05-85c5-4030-be2d-8d7ea90c87ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:52.477999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f2ab05-85c5-4030-be2d-8d7ea90c87ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:52.478447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f2ab05-85c5-4030-be2d-8d7ea90c87ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:52.478864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f2ab05-85c5-4030-be2d-8d7ea90c87ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:52.510565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a5f2ab05-85c5-4030-be2d-8d7ea90c87ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047108 Aug 24 06:22:52.511135 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 435/876] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:53.466284 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c1223cce-68df-4f95-89e2-1596cc9d65b3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:53.468585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c1223cce-68df-4f95-89e2-1596cc9d65b3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:53.475152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223cce-68df-4f95-89e2-1596cc9d65b3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:53.475631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223cce-68df-4f95-89e2-1596cc9d65b3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:53.476067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223cce-68df-4f95-89e2-1596cc9d65b3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:53.476787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223cce-68df-4f95-89e2-1596cc9d65b3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:53.477238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223cce-68df-4f95-89e2-1596cc9d65b3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:53.477660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223cce-68df-4f95-89e2-1596cc9d65b3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:53.507505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c1223cce-68df-4f95-89e2-1596cc9d65b3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046857 Aug 24 06:22:53.507996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 442/877] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:53.522883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-25601226-3477-4e5f-84ce-8217a933704c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:53.525015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-25601226-3477-4e5f-84ce-8217a933704c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:53.531282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25601226-3477-4e5f-84ce-8217a933704c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:53.531751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25601226-3477-4e5f-84ce-8217a933704c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:53.532176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25601226-3477-4e5f-84ce-8217a933704c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:53.532886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25601226-3477-4e5f-84ce-8217a933704c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:53.533333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25601226-3477-4e5f-84ce-8217a933704c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:53.533746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25601226-3477-4e5f-84ce-8217a933704c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:53.562732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-25601226-3477-4e5f-84ce-8217a933704c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043833 Aug 24 06:22:53.563280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 436/878] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:54.519231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e4ead49c-3853-4b93-876d-82b20d97ac77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:54.521390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e4ead49c-3853-4b93-876d-82b20d97ac77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:54.528288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ead49c-3853-4b93-876d-82b20d97ac77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:54.528800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ead49c-3853-4b93-876d-82b20d97ac77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:54.529234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ead49c-3853-4b93-876d-82b20d97ac77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:54.529920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ead49c-3853-4b93-876d-82b20d97ac77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:54.530375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ead49c-3853-4b93-876d-82b20d97ac77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:54.530797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ead49c-3853-4b93-876d-82b20d97ac77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:54.559843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e4ead49c-3853-4b93-876d-82b20d97ac77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Aug 24 06:22:54.560330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 443/879] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:54.575389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6896dd5b-cbc5-421c-a56b-89fa75818daa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:54.577589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6896dd5b-cbc5-421c-a56b-89fa75818daa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:54.584207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6896dd5b-cbc5-421c-a56b-89fa75818daa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:54.584724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6896dd5b-cbc5-421c-a56b-89fa75818daa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:54.585158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6896dd5b-cbc5-421c-a56b-89fa75818daa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:54.585838 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6896dd5b-cbc5-421c-a56b-89fa75818daa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:54.586283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6896dd5b-cbc5-421c-a56b-89fa75818daa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:54.586707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6896dd5b-cbc5-421c-a56b-89fa75818daa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:54.616119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6896dd5b-cbc5-421c-a56b-89fa75818daa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043985 Aug 24 06:22:54.616686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 437/880] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:54 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:55.572219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d2ca7d8c-418f-40ff-a70a-0474f42bd6b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:55.574393 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d2ca7d8c-418f-40ff-a70a-0474f42bd6b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:55.581069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2ca7d8c-418f-40ff-a70a-0474f42bd6b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:55.581548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2ca7d8c-418f-40ff-a70a-0474f42bd6b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:55.581977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2ca7d8c-418f-40ff-a70a-0474f42bd6b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:55.582672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2ca7d8c-418f-40ff-a70a-0474f42bd6b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:55.583116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2ca7d8c-418f-40ff-a70a-0474f42bd6b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:55.583534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2ca7d8c-418f-40ff-a70a-0474f42bd6b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:55.612721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d2ca7d8c-418f-40ff-a70a-0474f42bd6b7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044785 Aug 24 06:22:55.613205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 444/881] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:55 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:55.627741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bb37cdeb-6ef9-4621-8921-7e833389fbf4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:55.629983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bb37cdeb-6ef9-4621-8921-7e833389fbf4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:55.637199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb37cdeb-6ef9-4621-8921-7e833389fbf4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:55.637678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb37cdeb-6ef9-4621-8921-7e833389fbf4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:55.638107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb37cdeb-6ef9-4621-8921-7e833389fbf4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:55.638792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb37cdeb-6ef9-4621-8921-7e833389fbf4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:55.639241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb37cdeb-6ef9-4621-8921-7e833389fbf4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:55.639659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb37cdeb-6ef9-4621-8921-7e833389fbf4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:55.669207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bb37cdeb-6ef9-4621-8921-7e833389fbf4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045129 Aug 24 06:22:55.669778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 438/882] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:56.625062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a21c8571-d6fd-4b2e-b087-528f92d72759 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:56.627229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a21c8571-d6fd-4b2e-b087-528f92d72759 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:56.633802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a21c8571-d6fd-4b2e-b087-528f92d72759 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:56.634278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a21c8571-d6fd-4b2e-b087-528f92d72759 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:56.634707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a21c8571-d6fd-4b2e-b087-528f92d72759 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:56.635396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a21c8571-d6fd-4b2e-b087-528f92d72759 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:56.635841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a21c8571-d6fd-4b2e-b087-528f92d72759 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:56.636275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a21c8571-d6fd-4b2e-b087-528f92d72759 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:56.665893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a21c8571-d6fd-4b2e-b087-528f92d72759 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Aug 24 06:22:56.666454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 445/883] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:56.681807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b1085f5d-cfd3-471e-a8f3-090d7eb84b9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:56.684214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b1085f5d-cfd3-471e-a8f3-090d7eb84b9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:56.690845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1085f5d-cfd3-471e-a8f3-090d7eb84b9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:56.691327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1085f5d-cfd3-471e-a8f3-090d7eb84b9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:56.691763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1085f5d-cfd3-471e-a8f3-090d7eb84b9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:56.692477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1085f5d-cfd3-471e-a8f3-090d7eb84b9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:56.692949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1085f5d-cfd3-471e-a8f3-090d7eb84b9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:56.693370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1085f5d-cfd3-471e-a8f3-090d7eb84b9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:56.723167 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b1085f5d-cfd3-471e-a8f3-090d7eb84b9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045571 Aug 24 06:22:56.723727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 439/884] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:57.678815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-816a2043-32ec-41ea-850f-d313a8023289 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:57.681255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-816a2043-32ec-41ea-850f-d313a8023289 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:57.687932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-816a2043-32ec-41ea-850f-d313a8023289 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:57.688434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-816a2043-32ec-41ea-850f-d313a8023289 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:57.688909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-816a2043-32ec-41ea-850f-d313a8023289 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:57.689597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-816a2043-32ec-41ea-850f-d313a8023289 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:57.690070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-816a2043-32ec-41ea-850f-d313a8023289 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:57.690487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-816a2043-32ec-41ea-850f-d313a8023289 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:57.719330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-816a2043-32ec-41ea-850f-d313a8023289 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 Aug 24 06:22:57.719886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 446/885] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:57 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:57.735084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4cce276d-2782-403f-9a4e-4b8a88c24aa8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:57.737215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4cce276d-2782-403f-9a4e-4b8a88c24aa8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:57.744177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4cce276d-2782-403f-9a4e-4b8a88c24aa8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:57.744684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4cce276d-2782-403f-9a4e-4b8a88c24aa8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:57.745113 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4cce276d-2782-403f-9a4e-4b8a88c24aa8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:57.745796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4cce276d-2782-403f-9a4e-4b8a88c24aa8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:57.746238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4cce276d-2782-403f-9a4e-4b8a88c24aa8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:57.746650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4cce276d-2782-403f-9a4e-4b8a88c24aa8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:57.775224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4cce276d-2782-403f-9a4e-4b8a88c24aa8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043994 Aug 24 06:22:57.775773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 440/886] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:57 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:58.731432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0bc7797e-2e35-4216-a494-d36fdd1cd3fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:58.733684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0bc7797e-2e35-4216-a494-d36fdd1cd3fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:58.740629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0bc7797e-2e35-4216-a494-d36fdd1cd3fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:58.741124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0bc7797e-2e35-4216-a494-d36fdd1cd3fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:58.741555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0bc7797e-2e35-4216-a494-d36fdd1cd3fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:58.742242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0bc7797e-2e35-4216-a494-d36fdd1cd3fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:58.742757 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0bc7797e-2e35-4216-a494-d36fdd1cd3fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:58.743180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0bc7797e-2e35-4216-a494-d36fdd1cd3fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:58.772870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0bc7797e-2e35-4216-a494-d36fdd1cd3fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045292 Aug 24 06:22:58.773430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 447/887] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:58.787256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1586b168-dc48-4777-af68-a5739e1a67f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:58.789505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1586b168-dc48-4777-af68-a5739e1a67f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:58.796047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1586b168-dc48-4777-af68-a5739e1a67f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:58.796535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1586b168-dc48-4777-af68-a5739e1a67f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:58.796968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1586b168-dc48-4777-af68-a5739e1a67f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:58.797648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1586b168-dc48-4777-af68-a5739e1a67f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:58.798157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1586b168-dc48-4777-af68-a5739e1a67f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:58.798503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1586b168-dc48-4777-af68-a5739e1a67f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:58.828284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1586b168-dc48-4777-af68-a5739e1a67f4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045013 Aug 24 06:22:58.828876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 441/888] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:58 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:22:59.785268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bc9c9bb6-0a6a-4c53-abb1-f46c27210283 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:59.790745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bc9c9bb6-0a6a-4c53-abb1-f46c27210283 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:59.797524 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc9c9bb6-0a6a-4c53-abb1-f46c27210283 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:59.798208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc9c9bb6-0a6a-4c53-abb1-f46c27210283 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:59.798837 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc9c9bb6-0a6a-4c53-abb1-f46c27210283 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:59.799689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc9c9bb6-0a6a-4c53-abb1-f46c27210283 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:59.800267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc9c9bb6-0a6a-4c53-abb1-f46c27210283 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:59.800850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc9c9bb6-0a6a-4c53-abb1-f46c27210283 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:59.840285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bc9c9bb6-0a6a-4c53-abb1-f46c27210283 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058946 Aug 24 06:22:59.840961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 448/889] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:22:59 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:22:59.841795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6bc756fe-cded-4a05-85ea-628c2710f8c2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:22:59.844114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6bc756fe-cded-4a05-85ea-628c2710f8c2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:22:59.851237 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bc756fe-cded-4a05-85ea-628c2710f8c2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:59.851712 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bc756fe-cded-4a05-85ea-628c2710f8c2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:59.852133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bc756fe-cded-4a05-85ea-628c2710f8c2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:59.852868 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bc756fe-cded-4a05-85ea-628c2710f8c2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:22:59.853308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bc756fe-cded-4a05-85ea-628c2710f8c2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:22:59.853726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bc756fe-cded-4a05-85ea-628c2710f8c2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:22:59.883059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6bc756fe-cded-4a05-85ea-628c2710f8c2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045742 Aug 24 06:22:59.883612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 442/890] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:22:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:23:00.852805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8e2f7a5a-2222-44c8-8a24-58372aebab91 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:00.854913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8e2f7a5a-2222-44c8-8a24-58372aebab91 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:00.861265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e2f7a5a-2222-44c8-8a24-58372aebab91 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:00.861734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e2f7a5a-2222-44c8-8a24-58372aebab91 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:00.862219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e2f7a5a-2222-44c8-8a24-58372aebab91 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:00.862899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e2f7a5a-2222-44c8-8a24-58372aebab91 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:00.863344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e2f7a5a-2222-44c8-8a24-58372aebab91 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:00.863753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e2f7a5a-2222-44c8-8a24-58372aebab91 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:00.892689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8e2f7a5a-2222-44c8-8a24-58372aebab91 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Aug 24 06:23:00.893163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 449/891] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:00.895619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-334c7acb-7b04-4277-ac71-5486cfc9505b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:00.898437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-334c7acb-7b04-4277-ac71-5486cfc9505b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:00.905215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334c7acb-7b04-4277-ac71-5486cfc9505b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:00.905707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334c7acb-7b04-4277-ac71-5486cfc9505b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:00.906175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334c7acb-7b04-4277-ac71-5486cfc9505b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:00.906923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334c7acb-7b04-4277-ac71-5486cfc9505b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:00.907374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334c7acb-7b04-4277-ac71-5486cfc9505b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:00.907824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334c7acb-7b04-4277-ac71-5486cfc9505b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:00.937735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-334c7acb-7b04-4277-ac71-5486cfc9505b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046315 Aug 24 06:23:00.938313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 443/892] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:00 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:23:01.904950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9e8c3597-4095-44d3-88f6-ac2e83752adb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:01.907099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9e8c3597-4095-44d3-88f6-ac2e83752adb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:01.914097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e8c3597-4095-44d3-88f6-ac2e83752adb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:01.914567 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e8c3597-4095-44d3-88f6-ac2e83752adb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:01.915034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e8c3597-4095-44d3-88f6-ac2e83752adb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:01.915711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e8c3597-4095-44d3-88f6-ac2e83752adb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:01.916154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e8c3597-4095-44d3-88f6-ac2e83752adb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:01.916675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e8c3597-4095-44d3-88f6-ac2e83752adb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:01.946627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9e8c3597-4095-44d3-88f6-ac2e83752adb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045651 Aug 24 06:23:01.947105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 450/893] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:01.950264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c8ab07da-5112-4641-86dc-f6d5683ba6ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:01.952480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c8ab07da-5112-4641-86dc-f6d5683ba6ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:01.959799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ab07da-5112-4641-86dc-f6d5683ba6ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:01.960269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ab07da-5112-4641-86dc-f6d5683ba6ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:01.960721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ab07da-5112-4641-86dc-f6d5683ba6ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:01.961405 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ab07da-5112-4641-86dc-f6d5683ba6ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:01.961848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ab07da-5112-4641-86dc-f6d5683ba6ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:01.962292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ab07da-5112-4641-86dc-f6d5683ba6ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:01.991677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c8ab07da-5112-4641-86dc-f6d5683ba6ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045489 Aug 24 06:23:01.992230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 444/894] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:23:02.958705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a79b6ac5-feb5-40fb-b509-a910e95ab53e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:02.960872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a79b6ac5-feb5-40fb-b509-a910e95ab53e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:02.967291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a79b6ac5-feb5-40fb-b509-a910e95ab53e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:02.967758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a79b6ac5-feb5-40fb-b509-a910e95ab53e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:02.968185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a79b6ac5-feb5-40fb-b509-a910e95ab53e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:02.968893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a79b6ac5-feb5-40fb-b509-a910e95ab53e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:02.969337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a79b6ac5-feb5-40fb-b509-a910e95ab53e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:02.969750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a79b6ac5-feb5-40fb-b509-a910e95ab53e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:02.999254 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a79b6ac5-feb5-40fb-b509-a910e95ab53e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044389 Aug 24 06:23:02.999728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 451/895] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:02 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:03.003225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7fc922f6-9e28-475c-a4f8-f8c9bd5c84f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:03.005364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7fc922f6-9e28-475c-a4f8-f8c9bd5c84f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:03.011404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fc922f6-9e28-475c-a4f8-f8c9bd5c84f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:03.011879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fc922f6-9e28-475c-a4f8-f8c9bd5c84f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:03.012310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fc922f6-9e28-475c-a4f8-f8c9bd5c84f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:03.013108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fc922f6-9e28-475c-a4f8-f8c9bd5c84f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:03.013558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fc922f6-9e28-475c-a4f8-f8c9bd5c84f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:03.013976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fc922f6-9e28-475c-a4f8-f8c9bd5c84f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:03.043044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7fc922f6-9e28-475c-a4f8-f8c9bd5c84f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043730 Aug 24 06:23:03.043596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 445/896] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:23:04.011304 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1c570793-d1fe-4fe7-8bc4-00cbdc4b702b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:04.013482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1c570793-d1fe-4fe7-8bc4-00cbdc4b702b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:04.019949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c570793-d1fe-4fe7-8bc4-00cbdc4b702b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:04.020428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c570793-d1fe-4fe7-8bc4-00cbdc4b702b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:04.020893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c570793-d1fe-4fe7-8bc4-00cbdc4b702b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:04.022081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c570793-d1fe-4fe7-8bc4-00cbdc4b702b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:04.022529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c570793-d1fe-4fe7-8bc4-00cbdc4b702b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:04.022944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c570793-d1fe-4fe7-8bc4-00cbdc4b702b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:04.052418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1c570793-d1fe-4fe7-8bc4-00cbdc4b702b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Aug 24 06:23:04.052923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 452/897] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:04.055657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e7f3f761-8133-44f9-a683-7ddd26c0e647 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:04.057854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e7f3f761-8133-44f9-a683-7ddd26c0e647 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:04.064162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7f3f761-8133-44f9-a683-7ddd26c0e647 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:04.064675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7f3f761-8133-44f9-a683-7ddd26c0e647 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:04.065103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7f3f761-8133-44f9-a683-7ddd26c0e647 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:04.065776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7f3f761-8133-44f9-a683-7ddd26c0e647 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:04.066219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7f3f761-8133-44f9-a683-7ddd26c0e647 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:04.066630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7f3f761-8133-44f9-a683-7ddd26c0e647 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:04.095040 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e7f3f761-8133-44f9-a683-7ddd26c0e647 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043698 Aug 24 06:23:04.095591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 446/898] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:04 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:23:05.064752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-837ba2ab-2fb1-40ea-a15f-532d0625e2cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:05.066868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-837ba2ab-2fb1-40ea-a15f-532d0625e2cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:05.069778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=60 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:23:05.074455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-837ba2ab-2fb1-40ea-a15f-532d0625e2cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:05.074931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-837ba2ab-2fb1-40ea-a15f-532d0625e2cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:05.075364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-837ba2ab-2fb1-40ea-a15f-532d0625e2cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:05.076047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-837ba2ab-2fb1-40ea-a15f-532d0625e2cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:05.076517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-837ba2ab-2fb1-40ea-a15f-532d0625e2cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:05.076937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-837ba2ab-2fb1-40ea-a15f-532d0625e2cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:05.106552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-837ba2ab-2fb1-40ea-a15f-532d0625e2cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045762 Aug 24 06:23:05.107031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 453/899] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:05.113910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-39301c0a-b062-4fdf-b615-71d403f450d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:05.116675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-39301c0a-b062-4fdf-b615-71d403f450d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:05.123227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39301c0a-b062-4fdf-b615-71d403f450d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:05.123717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39301c0a-b062-4fdf-b615-71d403f450d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:05.124147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39301c0a-b062-4fdf-b615-71d403f450d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:05.124951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39301c0a-b062-4fdf-b615-71d403f450d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:05.125390 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39301c0a-b062-4fdf-b615-71d403f450d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:05.125801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39301c0a-b062-4fdf-b615-71d403f450d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:05.205386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-39301c0a-b062-4fdf-b615-71d403f450d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.095397 Aug 24 06:23:05.205975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 447/900] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:06.118085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b98695e6-6200-49f9-8be9-bcc61e6cf502 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:06.120208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b98695e6-6200-49f9-8be9-bcc61e6cf502 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:06.126995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b98695e6-6200-49f9-8be9-bcc61e6cf502 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:06.127473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b98695e6-6200-49f9-8be9-bcc61e6cf502 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:06.127903 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b98695e6-6200-49f9-8be9-bcc61e6cf502 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:06.128607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b98695e6-6200-49f9-8be9-bcc61e6cf502 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:06.129057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b98695e6-6200-49f9-8be9-bcc61e6cf502 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:06.129478 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b98695e6-6200-49f9-8be9-bcc61e6cf502 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:06.159098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b98695e6-6200-49f9-8be9-bcc61e6cf502 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044968 Aug 24 06:23:06.159588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 454/901] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:06.217871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ce8725ba-2bd1-4282-81c5-a1de2597564f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:06.220014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ce8725ba-2bd1-4282-81c5-a1de2597564f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:06.226537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce8725ba-2bd1-4282-81c5-a1de2597564f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:06.227009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce8725ba-2bd1-4282-81c5-a1de2597564f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:06.227435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce8725ba-2bd1-4282-81c5-a1de2597564f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:06.228148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce8725ba-2bd1-4282-81c5-a1de2597564f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:06.228616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce8725ba-2bd1-4282-81c5-a1de2597564f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:06.229029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce8725ba-2bd1-4282-81c5-a1de2597564f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:06.258387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ce8725ba-2bd1-4282-81c5-a1de2597564f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044594 Aug 24 06:23:06.258931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 448/902] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:07.171052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3fd84836-d5cf-4341-926f-3249c17ac261 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:07.173246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3fd84836-d5cf-4341-926f-3249c17ac261 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:07.180550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fd84836-d5cf-4341-926f-3249c17ac261 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:07.181036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fd84836-d5cf-4341-926f-3249c17ac261 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:07.181471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fd84836-d5cf-4341-926f-3249c17ac261 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:07.182164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fd84836-d5cf-4341-926f-3249c17ac261 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:07.182612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fd84836-d5cf-4341-926f-3249c17ac261 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:07.183091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fd84836-d5cf-4341-926f-3249c17ac261 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:07.213402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3fd84836-d5cf-4341-926f-3249c17ac261 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046515 Aug 24 06:23:07.213880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 455/903] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:07.270748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e8aabc26-ddfa-4700-bf06-ed25728912d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:07.272891 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e8aabc26-ddfa-4700-bf06-ed25728912d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:07.279509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8aabc26-ddfa-4700-bf06-ed25728912d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:07.279977 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8aabc26-ddfa-4700-bf06-ed25728912d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:07.280407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8aabc26-ddfa-4700-bf06-ed25728912d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:07.281110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8aabc26-ddfa-4700-bf06-ed25728912d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:07.281549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8aabc26-ddfa-4700-bf06-ed25728912d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:07.281960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8aabc26-ddfa-4700-bf06-ed25728912d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:07.306590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:23:07.311144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e8aabc26-ddfa-4700-bf06-ed25728912d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044375 Aug 24 06:23:07.311975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 449/904] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:07 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:08.226168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9d2c08e4-afcb-427f-8fbc-6be70d359048 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:08.228242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9d2c08e4-afcb-427f-8fbc-6be70d359048 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:08.234670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d2c08e4-afcb-427f-8fbc-6be70d359048 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:08.235140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d2c08e4-afcb-427f-8fbc-6be70d359048 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:08.235571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d2c08e4-afcb-427f-8fbc-6be70d359048 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:08.236252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d2c08e4-afcb-427f-8fbc-6be70d359048 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:08.236733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d2c08e4-afcb-427f-8fbc-6be70d359048 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:08.237153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d2c08e4-afcb-427f-8fbc-6be70d359048 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:08.265928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9d2c08e4-afcb-427f-8fbc-6be70d359048 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Aug 24 06:23:08.266479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 456/905] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:08.324051 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c91aaa97-8252-447a-a0ac-d50c330a27ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:08.326230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c91aaa97-8252-447a-a0ac-d50c330a27ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:08.333239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c91aaa97-8252-447a-a0ac-d50c330a27ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:08.334349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c91aaa97-8252-447a-a0ac-d50c330a27ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:08.334781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c91aaa97-8252-447a-a0ac-d50c330a27ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:08.335463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c91aaa97-8252-447a-a0ac-d50c330a27ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:08.335910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c91aaa97-8252-447a-a0ac-d50c330a27ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:08.336325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c91aaa97-8252-447a-a0ac-d50c330a27ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:08.364594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c91aaa97-8252-447a-a0ac-d50c330a27ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044769 Aug 24 06:23:08.365152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 450/906] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:09.278434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-be9f9040-cb34-4f22-987f-d6faf4262e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:09.280604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-be9f9040-cb34-4f22-987f-d6faf4262e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:09.287702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be9f9040-cb34-4f22-987f-d6faf4262e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:09.288176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be9f9040-cb34-4f22-987f-d6faf4262e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:09.288639 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be9f9040-cb34-4f22-987f-d6faf4262e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:09.289329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be9f9040-cb34-4f22-987f-d6faf4262e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:09.289780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be9f9040-cb34-4f22-987f-d6faf4262e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:09.290200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be9f9040-cb34-4f22-987f-d6faf4262e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:09.293937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:23:09.319493 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-be9f9040-cb34-4f22-987f-d6faf4262e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Aug 24 06:23:09.319985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 457/907] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:09 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:09.376831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4d4a803d-0b75-48fe-9a1c-ebc60aaff0e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:09.379022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4d4a803d-0b75-48fe-9a1c-ebc60aaff0e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:09.385532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d4a803d-0b75-48fe-9a1c-ebc60aaff0e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:09.386008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d4a803d-0b75-48fe-9a1c-ebc60aaff0e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:09.386439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d4a803d-0b75-48fe-9a1c-ebc60aaff0e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:09.387123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d4a803d-0b75-48fe-9a1c-ebc60aaff0e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:09.387571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d4a803d-0b75-48fe-9a1c-ebc60aaff0e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:09.387990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d4a803d-0b75-48fe-9a1c-ebc60aaff0e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:09.417688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4d4a803d-0b75-48fe-9a1c-ebc60aaff0e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045001 Aug 24 06:23:09.418238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 451/908] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:10.331784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1b4868b0-6652-4ace-8b0b-f445e5ed6f50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:10.333954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1b4868b0-6652-4ace-8b0b-f445e5ed6f50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:10.340523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4868b0-6652-4ace-8b0b-f445e5ed6f50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:10.340985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4868b0-6652-4ace-8b0b-f445e5ed6f50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:10.341415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4868b0-6652-4ace-8b0b-f445e5ed6f50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:10.342107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4868b0-6652-4ace-8b0b-f445e5ed6f50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:10.342557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4868b0-6652-4ace-8b0b-f445e5ed6f50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:10.343026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4868b0-6652-4ace-8b0b-f445e5ed6f50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:10.372544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1b4868b0-6652-4ace-8b0b-f445e5ed6f50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045105 Aug 24 06:23:10.373096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 458/909] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:10 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:10.430906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-94f77758-0307-48e1-8448-528996e07ec3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:10.433045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-94f77758-0307-48e1-8448-528996e07ec3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:10.439359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94f77758-0307-48e1-8448-528996e07ec3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:10.439824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94f77758-0307-48e1-8448-528996e07ec3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:10.440247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94f77758-0307-48e1-8448-528996e07ec3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:10.441013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94f77758-0307-48e1-8448-528996e07ec3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:10.441449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94f77758-0307-48e1-8448-528996e07ec3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:10.441859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94f77758-0307-48e1-8448-528996e07ec3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:10.469809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-94f77758-0307-48e1-8448-528996e07ec3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043802 Aug 24 06:23:10.470346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 452/910] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:10 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:11.385326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-59d68b3d-7f3a-4763-add5-a29883d4f12a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:11.387383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-59d68b3d-7f3a-4763-add5-a29883d4f12a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:11.393765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59d68b3d-7f3a-4763-add5-a29883d4f12a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:11.394271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59d68b3d-7f3a-4763-add5-a29883d4f12a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:11.394707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59d68b3d-7f3a-4763-add5-a29883d4f12a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:11.395391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59d68b3d-7f3a-4763-add5-a29883d4f12a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:11.395840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59d68b3d-7f3a-4763-add5-a29883d4f12a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:11.396940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59d68b3d-7f3a-4763-add5-a29883d4f12a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:11.426061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-59d68b3d-7f3a-4763-add5-a29883d4f12a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Aug 24 06:23:11.426616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 459/911] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:11.482472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-31b6b23f-2cda-4aeb-8439-c06afb619d24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:11.484662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-31b6b23f-2cda-4aeb-8439-c06afb619d24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:11.491552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31b6b23f-2cda-4aeb-8439-c06afb619d24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:11.492024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31b6b23f-2cda-4aeb-8439-c06afb619d24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:11.492459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31b6b23f-2cda-4aeb-8439-c06afb619d24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:11.493164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31b6b23f-2cda-4aeb-8439-c06afb619d24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:11.493607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31b6b23f-2cda-4aeb-8439-c06afb619d24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:11.494017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31b6b23f-2cda-4aeb-8439-c06afb619d24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:11.523157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-31b6b23f-2cda-4aeb-8439-c06afb619d24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044626 Aug 24 06:23:11.523707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 453/912] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:12.437862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5b724de2-a863-4ec3-8d6d-f5e4bfb0981e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:12.439977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5b724de2-a863-4ec3-8d6d-f5e4bfb0981e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:12.446566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b724de2-a863-4ec3-8d6d-f5e4bfb0981e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:12.447039 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b724de2-a863-4ec3-8d6d-f5e4bfb0981e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:12.447471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b724de2-a863-4ec3-8d6d-f5e4bfb0981e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:12.448216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b724de2-a863-4ec3-8d6d-f5e4bfb0981e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:12.448715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b724de2-a863-4ec3-8d6d-f5e4bfb0981e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:12.449138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b724de2-a863-4ec3-8d6d-f5e4bfb0981e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:12.478581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5b724de2-a863-4ec3-8d6d-f5e4bfb0981e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Aug 24 06:23:12.479058 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 460/913] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:12.535626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1daed5cd-0d5d-42f8-b74d-29c5a1e26b95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:12.538384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1daed5cd-0d5d-42f8-b74d-29c5a1e26b95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:12.544919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1daed5cd-0d5d-42f8-b74d-29c5a1e26b95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:12.545400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1daed5cd-0d5d-42f8-b74d-29c5a1e26b95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:12.545851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1daed5cd-0d5d-42f8-b74d-29c5a1e26b95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:12.546663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1daed5cd-0d5d-42f8-b74d-29c5a1e26b95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:12.547115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1daed5cd-0d5d-42f8-b74d-29c5a1e26b95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:12.547534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1daed5cd-0d5d-42f8-b74d-29c5a1e26b95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:12.577887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1daed5cd-0d5d-42f8-b74d-29c5a1e26b95 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046335 Aug 24 06:23:12.578459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 454/914] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:13.490944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8b877a0c-7fc4-405b-96b8-73175829264c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:13.493116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8b877a0c-7fc4-405b-96b8-73175829264c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:13.499407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b877a0c-7fc4-405b-96b8-73175829264c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:13.499877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b877a0c-7fc4-405b-96b8-73175829264c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:13.500303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b877a0c-7fc4-405b-96b8-73175829264c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:13.501012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b877a0c-7fc4-405b-96b8-73175829264c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:13.501458 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b877a0c-7fc4-405b-96b8-73175829264c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:13.501874 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b877a0c-7fc4-405b-96b8-73175829264c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:13.531499 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8b877a0c-7fc4-405b-96b8-73175829264c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044566 Aug 24 06:23:13.532050 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 461/915] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:13.590638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6ebbe59b-b6f6-4db3-80a7-5bc7e6e21175 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:13.592807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6ebbe59b-b6f6-4db3-80a7-5bc7e6e21175 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:13.599283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ebbe59b-b6f6-4db3-80a7-5bc7e6e21175 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:13.599756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ebbe59b-b6f6-4db3-80a7-5bc7e6e21175 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:13.600187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ebbe59b-b6f6-4db3-80a7-5bc7e6e21175 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:13.600931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ebbe59b-b6f6-4db3-80a7-5bc7e6e21175 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:13.601383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ebbe59b-b6f6-4db3-80a7-5bc7e6e21175 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:13.601806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6ebbe59b-b6f6-4db3-80a7-5bc7e6e21175 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:13.631068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6ebbe59b-b6f6-4db3-80a7-5bc7e6e21175 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043945 Aug 24 06:23:13.631613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 455/916] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:13 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:14.543819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8905b535-3408-4c03-9d00-5aef9f93a492 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:14.545968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8905b535-3408-4c03-9d00-5aef9f93a492 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:14.552561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8905b535-3408-4c03-9d00-5aef9f93a492 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:14.553037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8905b535-3408-4c03-9d00-5aef9f93a492 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:14.553460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8905b535-3408-4c03-9d00-5aef9f93a492 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:14.554149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8905b535-3408-4c03-9d00-5aef9f93a492 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:14.554851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8905b535-3408-4c03-9d00-5aef9f93a492 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:14.555265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8905b535-3408-4c03-9d00-5aef9f93a492 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:14.584132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8905b535-3408-4c03-9d00-5aef9f93a492 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043784 Aug 24 06:23:14.584708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 462/917] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:14.643307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7b4b7e72-2757-4462-88c5-cc05d7c3421d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:14.645492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7b4b7e72-2757-4462-88c5-cc05d7c3421d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:14.652376 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b4b7e72-2757-4462-88c5-cc05d7c3421d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:14.652816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b4b7e72-2757-4462-88c5-cc05d7c3421d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:14.653241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b4b7e72-2757-4462-88c5-cc05d7c3421d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:14.653913 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b4b7e72-2757-4462-88c5-cc05d7c3421d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:14.654355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b4b7e72-2757-4462-88c5-cc05d7c3421d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:14.654766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7b4b7e72-2757-4462-88c5-cc05d7c3421d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:14.683871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7b4b7e72-2757-4462-88c5-cc05d7c3421d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044513 Aug 24 06:23:14.684426 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 456/918] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:15.596338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cff98429-3c27-4d57-841e-93cb48f47943 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:15.598473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cff98429-3c27-4d57-841e-93cb48f47943 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:15.605341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff98429-3c27-4d57-841e-93cb48f47943 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:15.605815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff98429-3c27-4d57-841e-93cb48f47943 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:15.606246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff98429-3c27-4d57-841e-93cb48f47943 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:15.606922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff98429-3c27-4d57-841e-93cb48f47943 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:15.607366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff98429-3c27-4d57-841e-93cb48f47943 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:15.607782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff98429-3c27-4d57-841e-93cb48f47943 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:15.636622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cff98429-3c27-4d57-841e-93cb48f47943 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Aug 24 06:23:15.637175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 463/919] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:15 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:15.695966 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-15fadf7c-cd7d-49ed-8053-8855a33b12e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:15.698177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-15fadf7c-cd7d-49ed-8053-8855a33b12e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:15.704665 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15fadf7c-cd7d-49ed-8053-8855a33b12e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:15.705147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15fadf7c-cd7d-49ed-8053-8855a33b12e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:15.705611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15fadf7c-cd7d-49ed-8053-8855a33b12e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:15.706296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15fadf7c-cd7d-49ed-8053-8855a33b12e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:15.706741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15fadf7c-cd7d-49ed-8053-8855a33b12e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:15.707157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15fadf7c-cd7d-49ed-8053-8855a33b12e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:15.736404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-15fadf7c-cd7d-49ed-8053-8855a33b12e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044363 Aug 24 06:23:15.737008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 457/920] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:16.649029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6ce3ae3a-7a43-4aa0-bece-4785e2adac38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:16.651062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6ce3ae3a-7a43-4aa0-bece-4785e2adac38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:16.657400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ce3ae3a-7a43-4aa0-bece-4785e2adac38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:16.657873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ce3ae3a-7a43-4aa0-bece-4785e2adac38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:16.658307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ce3ae3a-7a43-4aa0-bece-4785e2adac38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:16.658988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ce3ae3a-7a43-4aa0-bece-4785e2adac38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:16.659432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ce3ae3a-7a43-4aa0-bece-4785e2adac38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:16.659847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ce3ae3a-7a43-4aa0-bece-4785e2adac38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:16.689755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6ce3ae3a-7a43-4aa0-bece-4785e2adac38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044845 Aug 24 06:23:16.690318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 464/921] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:16.749539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1baec84f-4c54-4dcb-a2f4-6ccd4ca081da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:16.751661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1baec84f-4c54-4dcb-a2f4-6ccd4ca081da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:16.758213 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1baec84f-4c54-4dcb-a2f4-6ccd4ca081da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:16.758680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1baec84f-4c54-4dcb-a2f4-6ccd4ca081da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:16.759135 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1baec84f-4c54-4dcb-a2f4-6ccd4ca081da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:16.759810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1baec84f-4c54-4dcb-a2f4-6ccd4ca081da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:16.760264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1baec84f-4c54-4dcb-a2f4-6ccd4ca081da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:16.760750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1baec84f-4c54-4dcb-a2f4-6ccd4ca081da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:16.791356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1baec84f-4c54-4dcb-a2f4-6ccd4ca081da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045817 Aug 24 06:23:16.791913 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 458/922] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:16 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:17.701902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b759b1f6-2fc1-4713-9121-70b05de7d629 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:17.704077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b759b1f6-2fc1-4713-9121-70b05de7d629 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:17.710814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b759b1f6-2fc1-4713-9121-70b05de7d629 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:17.711295 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b759b1f6-2fc1-4713-9121-70b05de7d629 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:17.711730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b759b1f6-2fc1-4713-9121-70b05de7d629 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:17.712423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b759b1f6-2fc1-4713-9121-70b05de7d629 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:17.712902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b759b1f6-2fc1-4713-9121-70b05de7d629 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:17.713321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b759b1f6-2fc1-4713-9121-70b05de7d629 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:17.742198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b759b1f6-2fc1-4713-9121-70b05de7d629 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Aug 24 06:23:17.742755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 465/923] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:17 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:17.804108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fe90dad5-59b7-434c-935f-cc14cccb93e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:17.806545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fe90dad5-59b7-434c-935f-cc14cccb93e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:17.813303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe90dad5-59b7-434c-935f-cc14cccb93e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:17.813792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe90dad5-59b7-434c-935f-cc14cccb93e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:17.814226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe90dad5-59b7-434c-935f-cc14cccb93e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:17.814948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe90dad5-59b7-434c-935f-cc14cccb93e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:17.815388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe90dad5-59b7-434c-935f-cc14cccb93e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:17.815811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe90dad5-59b7-434c-935f-cc14cccb93e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:17.848850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fe90dad5-59b7-434c-935f-cc14cccb93e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048952 Aug 24 06:23:17.850039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 459/924] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:18.755678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-810dcaa3-c55a-4730-a6e5-0d4f31f263ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:18.757863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-810dcaa3-c55a-4730-a6e5-0d4f31f263ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:18.764284 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810dcaa3-c55a-4730-a6e5-0d4f31f263ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:18.764794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810dcaa3-c55a-4730-a6e5-0d4f31f263ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:18.765235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810dcaa3-c55a-4730-a6e5-0d4f31f263ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:18.765925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810dcaa3-c55a-4730-a6e5-0d4f31f263ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:18.766372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810dcaa3-c55a-4730-a6e5-0d4f31f263ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:18.766792 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810dcaa3-c55a-4730-a6e5-0d4f31f263ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:18.796334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-810dcaa3-c55a-4730-a6e5-0d4f31f263ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045407 Aug 24 06:23:18.796843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 466/925] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:18.863418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-61c25ed8-8c44-4db8-aab0-3634df986589 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:18.866122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-61c25ed8-8c44-4db8-aab0-3634df986589 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:18.869035 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=60 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:23:18.874290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c25ed8-8c44-4db8-aab0-3634df986589 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:18.874760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c25ed8-8c44-4db8-aab0-3634df986589 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:18.875185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c25ed8-8c44-4db8-aab0-3634df986589 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:18.875899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c25ed8-8c44-4db8-aab0-3634df986589 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:18.876344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c25ed8-8c44-4db8-aab0-3634df986589 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:18.876782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c25ed8-8c44-4db8-aab0-3634df986589 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:18.906671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-61c25ed8-8c44-4db8-aab0-3634df986589 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048542 Aug 24 06:23:18.907219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 460/926] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:19.809550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5ef05ff1-14ea-4148-92b3-363271f2b736 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:19.811695 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5ef05ff1-14ea-4148-92b3-363271f2b736 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:19.818959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ef05ff1-14ea-4148-92b3-363271f2b736 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:19.819429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ef05ff1-14ea-4148-92b3-363271f2b736 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:19.819855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ef05ff1-14ea-4148-92b3-363271f2b736 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:19.820561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ef05ff1-14ea-4148-92b3-363271f2b736 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:19.821006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ef05ff1-14ea-4148-92b3-363271f2b736 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:19.821419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ef05ff1-14ea-4148-92b3-363271f2b736 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:19.850031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5ef05ff1-14ea-4148-92b3-363271f2b736 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Aug 24 06:23:19.850587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 467/927] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:19.881565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:23:19.881835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:23:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:23:19.918350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e5bb6e37-e44d-4592-a682-5521b18c2782 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:19.920554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e5bb6e37-e44d-4592-a682-5521b18c2782 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:19.927573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5bb6e37-e44d-4592-a682-5521b18c2782 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:19.928081 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5bb6e37-e44d-4592-a682-5521b18c2782 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:19.928528 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5bb6e37-e44d-4592-a682-5521b18c2782 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:19.929202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5bb6e37-e44d-4592-a682-5521b18c2782 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:19.929897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5bb6e37-e44d-4592-a682-5521b18c2782 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:19.930306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5bb6e37-e44d-4592-a682-5521b18c2782 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:19.959859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e5bb6e37-e44d-4592-a682-5521b18c2782 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045385 Aug 24 06:23:19.960367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 461/928] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:20.862285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cdf828a8-fd39-491b-9950-0c3add745f6f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:20.864564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cdf828a8-fd39-491b-9950-0c3add745f6f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:20.871744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdf828a8-fd39-491b-9950-0c3add745f6f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:20.872229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdf828a8-fd39-491b-9950-0c3add745f6f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:20.872710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdf828a8-fd39-491b-9950-0c3add745f6f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:20.873397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdf828a8-fd39-491b-9950-0c3add745f6f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:20.873849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdf828a8-fd39-491b-9950-0c3add745f6f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:20.874271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdf828a8-fd39-491b-9950-0c3add745f6f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:20.904125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cdf828a8-fd39-491b-9950-0c3add745f6f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045804 Aug 24 06:23:20.904719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 468/929] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:20.971488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d721b0d3-8bfc-4823-b2b4-40e8137453ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:20.973539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d721b0d3-8bfc-4823-b2b4-40e8137453ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:20.979871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d721b0d3-8bfc-4823-b2b4-40e8137453ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:20.980339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d721b0d3-8bfc-4823-b2b4-40e8137453ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:20.980794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d721b0d3-8bfc-4823-b2b4-40e8137453ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:20.981480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d721b0d3-8bfc-4823-b2b4-40e8137453ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:20.981985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d721b0d3-8bfc-4823-b2b4-40e8137453ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:20.982396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d721b0d3-8bfc-4823-b2b4-40e8137453ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:21.011587 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d721b0d3-8bfc-4823-b2b4-40e8137453ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044182 Aug 24 06:23:21.012133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 462/930] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:20 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:21.922272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d80c54cb-73cc-4925-8bc0-ef2295ca6464 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:21.924444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d80c54cb-73cc-4925-8bc0-ef2295ca6464 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:21.931881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d80c54cb-73cc-4925-8bc0-ef2295ca6464 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:21.932358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d80c54cb-73cc-4925-8bc0-ef2295ca6464 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:21.932824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d80c54cb-73cc-4925-8bc0-ef2295ca6464 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:21.933746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d80c54cb-73cc-4925-8bc0-ef2295ca6464 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:21.934209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d80c54cb-73cc-4925-8bc0-ef2295ca6464 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:21.934641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d80c54cb-73cc-4925-8bc0-ef2295ca6464 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:21.964091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d80c54cb-73cc-4925-8bc0-ef2295ca6464 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045746 Aug 24 06:23:21.964688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 469/931] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:21 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:22.023734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b9385f08-adda-43c7-8a90-6b03fedf4155 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:22.025866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b9385f08-adda-43c7-8a90-6b03fedf4155 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:22.032159 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9385f08-adda-43c7-8a90-6b03fedf4155 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:22.032666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9385f08-adda-43c7-8a90-6b03fedf4155 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:22.033093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9385f08-adda-43c7-8a90-6b03fedf4155 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:22.033766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9385f08-adda-43c7-8a90-6b03fedf4155 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:22.034208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9385f08-adda-43c7-8a90-6b03fedf4155 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:22.034619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9385f08-adda-43c7-8a90-6b03fedf4155 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:22.063775 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b9385f08-adda-43c7-8a90-6b03fedf4155 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044511 Aug 24 06:23:22.064318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 463/932] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:22 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:22.977121 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-46c92f87-2eb5-4a8a-80a4-60cd7e6f876c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:22.979234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-46c92f87-2eb5-4a8a-80a4-60cd7e6f876c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:22.985568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46c92f87-2eb5-4a8a-80a4-60cd7e6f876c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:22.986037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46c92f87-2eb5-4a8a-80a4-60cd7e6f876c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:22.986464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46c92f87-2eb5-4a8a-80a4-60cd7e6f876c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:22.987143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46c92f87-2eb5-4a8a-80a4-60cd7e6f876c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:22.987588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46c92f87-2eb5-4a8a-80a4-60cd7e6f876c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:22.988004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46c92f87-2eb5-4a8a-80a4-60cd7e6f876c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:23.017439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-46c92f87-2eb5-4a8a-80a4-60cd7e6f876c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045023 Aug 24 06:23:23.017984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 470/933] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:23.076003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b503f95d-07d4-4192-a2f5-76556aafdcc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:23.078117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b503f95d-07d4-4192-a2f5-76556aafdcc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:23.084989 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b503f95d-07d4-4192-a2f5-76556aafdcc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:23.085471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b503f95d-07d4-4192-a2f5-76556aafdcc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:23.085929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b503f95d-07d4-4192-a2f5-76556aafdcc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:23.086636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b503f95d-07d4-4192-a2f5-76556aafdcc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:23.087075 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b503f95d-07d4-4192-a2f5-76556aafdcc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:23.087485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b503f95d-07d4-4192-a2f5-76556aafdcc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:23.116373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b503f95d-07d4-4192-a2f5-76556aafdcc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044443 Aug 24 06:23:23.116944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 464/934] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:24.030015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ade48849-8129-437e-88cd-308735a41478 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:24.032163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ade48849-8129-437e-88cd-308735a41478 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:24.038565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ade48849-8129-437e-88cd-308735a41478 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:24.039042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ade48849-8129-437e-88cd-308735a41478 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:24.039473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ade48849-8129-437e-88cd-308735a41478 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:24.040206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ade48849-8129-437e-88cd-308735a41478 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:24.040702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ade48849-8129-437e-88cd-308735a41478 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:24.041126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ade48849-8129-437e-88cd-308735a41478 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:24.070271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ade48849-8129-437e-88cd-308735a41478 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044268 Aug 24 06:23:24.070816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 471/935] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:24.128576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cfd23b9f-74c7-4b34-9d63-9dd6f075472b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:24.131392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cfd23b9f-74c7-4b34-9d63-9dd6f075472b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:24.137713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd23b9f-74c7-4b34-9d63-9dd6f075472b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:24.143640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd23b9f-74c7-4b34-9d63-9dd6f075472b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:24.143640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd23b9f-74c7-4b34-9d63-9dd6f075472b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:24.143640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd23b9f-74c7-4b34-9d63-9dd6f075472b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:24.143640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd23b9f-74c7-4b34-9d63-9dd6f075472b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:24.144003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd23b9f-74c7-4b34-9d63-9dd6f075472b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:24.169777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cfd23b9f-74c7-4b34-9d63-9dd6f075472b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045174 Aug 24 06:23:24.170334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 465/936] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:25.082781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d47568bb-4cb5-4be8-ba72-6570d10f22ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:25.085387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d47568bb-4cb5-4be8-ba72-6570d10f22ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:25.092000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d47568bb-4cb5-4be8-ba72-6570d10f22ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:25.092474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d47568bb-4cb5-4be8-ba72-6570d10f22ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:25.092942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d47568bb-4cb5-4be8-ba72-6570d10f22ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:25.093630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d47568bb-4cb5-4be8-ba72-6570d10f22ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:25.094079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d47568bb-4cb5-4be8-ba72-6570d10f22ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:25.094501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d47568bb-4cb5-4be8-ba72-6570d10f22ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:25.124888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d47568bb-4cb5-4be8-ba72-6570d10f22ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046218 Aug 24 06:23:25.125443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 472/937] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:25 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:25.182406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4a8f0f4f-11ce-4f8c-8015-051b718d5f65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:25.184521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4a8f0f4f-11ce-4f8c-8015-051b718d5f65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:25.190932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8f0f4f-11ce-4f8c-8015-051b718d5f65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:25.191399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8f0f4f-11ce-4f8c-8015-051b718d5f65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:25.191823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8f0f4f-11ce-4f8c-8015-051b718d5f65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:25.192513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8f0f4f-11ce-4f8c-8015-051b718d5f65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:25.192962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8f0f4f-11ce-4f8c-8015-051b718d5f65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:25.193398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8f0f4f-11ce-4f8c-8015-051b718d5f65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:25.209919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:23:25.222127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4a8f0f4f-11ce-4f8c-8015-051b718d5f65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044016 Aug 24 06:23:25.224385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 466/938] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:23:25.795206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:23:25.795447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:23:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:23:26.137366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cd4f08b3-dd27-4d31-acea-13c094368388 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:26.139516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cd4f08b3-dd27-4d31-acea-13c094368388 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:26.145933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd4f08b3-dd27-4d31-acea-13c094368388 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:26.146410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd4f08b3-dd27-4d31-acea-13c094368388 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:26.146839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd4f08b3-dd27-4d31-acea-13c094368388 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:26.147525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd4f08b3-dd27-4d31-acea-13c094368388 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:26.147976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd4f08b3-dd27-4d31-acea-13c094368388 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:26.148395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd4f08b3-dd27-4d31-acea-13c094368388 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:26.173254 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:23:26.180568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cd4f08b3-dd27-4d31-acea-13c094368388 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Aug 24 06:23:26.180568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 473/939] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:26.235118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-828864aa-2898-4647-8611-d945806e6f23 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:26.237274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-828864aa-2898-4647-8611-d945806e6f23 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:26.245729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-828864aa-2898-4647-8611-d945806e6f23 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:26.246209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-828864aa-2898-4647-8611-d945806e6f23 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:26.246635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-828864aa-2898-4647-8611-d945806e6f23 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:26.247322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-828864aa-2898-4647-8611-d945806e6f23 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:26.247772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-828864aa-2898-4647-8611-d945806e6f23 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:26.248191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-828864aa-2898-4647-8611-d945806e6f23 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:26.276436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-828864aa-2898-4647-8611-d945806e6f23 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045426 Aug 24 06:23:26.277018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 467/940] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:27.191568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a752bb34-30ec-44ed-ba18-e4d71fa2612f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:27.194576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a752bb34-30ec-44ed-ba18-e4d71fa2612f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:27.201176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a752bb34-30ec-44ed-ba18-e4d71fa2612f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:27.201650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a752bb34-30ec-44ed-ba18-e4d71fa2612f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:27.202114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a752bb34-30ec-44ed-ba18-e4d71fa2612f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:27.202798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a752bb34-30ec-44ed-ba18-e4d71fa2612f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:27.203242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a752bb34-30ec-44ed-ba18-e4d71fa2612f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:27.203656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a752bb34-30ec-44ed-ba18-e4d71fa2612f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:27.233989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a752bb34-30ec-44ed-ba18-e4d71fa2612f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046765 Aug 24 06:23:27.234545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 474/941] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:27.289473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-31787037-6903-4c61-88eb-b08b2e33e5c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:27.291597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-31787037-6903-4c61-88eb-b08b2e33e5c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:27.298320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31787037-6903-4c61-88eb-b08b2e33e5c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:27.298788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31787037-6903-4c61-88eb-b08b2e33e5c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:27.299212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31787037-6903-4c61-88eb-b08b2e33e5c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:27.299879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31787037-6903-4c61-88eb-b08b2e33e5c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:27.300320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31787037-6903-4c61-88eb-b08b2e33e5c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:27.300754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31787037-6903-4c61-88eb-b08b2e33e5c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:27.329595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-31787037-6903-4c61-88eb-b08b2e33e5c0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044758 Aug 24 06:23:27.330145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 468/942] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:28.246587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9a1b127d-2b2b-474f-973b-d13d4a74c7bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:28.248725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9a1b127d-2b2b-474f-973b-d13d4a74c7bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:28.255843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a1b127d-2b2b-474f-973b-d13d4a74c7bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:28.256318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a1b127d-2b2b-474f-973b-d13d4a74c7bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:28.256801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a1b127d-2b2b-474f-973b-d13d4a74c7bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:28.257482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a1b127d-2b2b-474f-973b-d13d4a74c7bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:28.257932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a1b127d-2b2b-474f-973b-d13d4a74c7bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:28.258355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a1b127d-2b2b-474f-973b-d13d4a74c7bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:28.287208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9a1b127d-2b2b-474f-973b-d13d4a74c7bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Aug 24 06:23:28.287771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 475/943] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:28 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:28.342398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-616a4c6b-6d4b-4f6b-ab01-4ed96d74a5d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:28.344574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-616a4c6b-6d4b-4f6b-ab01-4ed96d74a5d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:28.351467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-616a4c6b-6d4b-4f6b-ab01-4ed96d74a5d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:28.351940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-616a4c6b-6d4b-4f6b-ab01-4ed96d74a5d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:28.352370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-616a4c6b-6d4b-4f6b-ab01-4ed96d74a5d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:28.353084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-616a4c6b-6d4b-4f6b-ab01-4ed96d74a5d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:28.353534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-616a4c6b-6d4b-4f6b-ab01-4ed96d74a5d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:28.353957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-616a4c6b-6d4b-4f6b-ab01-4ed96d74a5d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:28.383265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-616a4c6b-6d4b-4f6b-ab01-4ed96d74a5d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044851 Aug 24 06:23:28.383818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 469/944] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:28 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:29.299469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-91b0de72-6acc-4622-ac86-0c239cd17e28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:29.301568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-91b0de72-6acc-4622-ac86-0c239cd17e28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:29.308753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b0de72-6acc-4622-ac86-0c239cd17e28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:29.309271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b0de72-6acc-4622-ac86-0c239cd17e28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:29.309696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b0de72-6acc-4622-ac86-0c239cd17e28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:29.310371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b0de72-6acc-4622-ac86-0c239cd17e28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:29.310816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b0de72-6acc-4622-ac86-0c239cd17e28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:29.311230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b0de72-6acc-4622-ac86-0c239cd17e28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:29.339356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-91b0de72-6acc-4622-ac86-0c239cd17e28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Aug 24 06:23:29.339896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 476/945] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:29.395862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-def72de0-07d6-4459-9692-8d4b691d240d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:29.398055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-def72de0-07d6-4459-9692-8d4b691d240d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:29.404419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def72de0-07d6-4459-9692-8d4b691d240d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:29.404928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def72de0-07d6-4459-9692-8d4b691d240d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:29.405363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def72de0-07d6-4459-9692-8d4b691d240d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:29.406039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def72de0-07d6-4459-9692-8d4b691d240d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:29.406484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def72de0-07d6-4459-9692-8d4b691d240d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:29.406901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-def72de0-07d6-4459-9692-8d4b691d240d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:29.437893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-def72de0-07d6-4459-9692-8d4b691d240d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046205 Aug 24 06:23:29.438460 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 470/946] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:29 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:30.351651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3ea9bb00-38b2-42d6-8d52-d510f6b67c12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:30.353731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3ea9bb00-38b2-42d6-8d52-d510f6b67c12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:30.360060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ea9bb00-38b2-42d6-8d52-d510f6b67c12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:30.360561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ea9bb00-38b2-42d6-8d52-d510f6b67c12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:30.360991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ea9bb00-38b2-42d6-8d52-d510f6b67c12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:30.361668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ea9bb00-38b2-42d6-8d52-d510f6b67c12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:30.362112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ea9bb00-38b2-42d6-8d52-d510f6b67c12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:30.362528 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ea9bb00-38b2-42d6-8d52-d510f6b67c12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:30.391698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3ea9bb00-38b2-42d6-8d52-d510f6b67c12 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044118 Aug 24 06:23:30.392246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 477/947] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:30.450201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ae4256d0-7aca-4877-a56c-353c347d114d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:30.452302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ae4256d0-7aca-4877-a56c-353c347d114d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:30.459332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4256d0-7aca-4877-a56c-353c347d114d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:30.459811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4256d0-7aca-4877-a56c-353c347d114d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:30.460240 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4256d0-7aca-4877-a56c-353c347d114d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:30.460955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4256d0-7aca-4877-a56c-353c347d114d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:30.467302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4256d0-7aca-4877-a56c-353c347d114d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:30.467302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4256d0-7aca-4877-a56c-353c347d114d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:30.491060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ae4256d0-7aca-4877-a56c-353c347d114d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044863 Aug 24 06:23:30.491628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 471/948] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:31.403426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-20501c82-2b0d-4fc3-9b28-de0c9334bd80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:31.405500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-20501c82-2b0d-4fc3-9b28-de0c9334bd80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:31.412447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20501c82-2b0d-4fc3-9b28-de0c9334bd80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:31.412958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20501c82-2b0d-4fc3-9b28-de0c9334bd80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:31.413385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20501c82-2b0d-4fc3-9b28-de0c9334bd80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:31.414066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20501c82-2b0d-4fc3-9b28-de0c9334bd80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:31.414513 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20501c82-2b0d-4fc3-9b28-de0c9334bd80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:31.414928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20501c82-2b0d-4fc3-9b28-de0c9334bd80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:31.443776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-20501c82-2b0d-4fc3-9b28-de0c9334bd80 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044502 Aug 24 06:23:31.444314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 478/949] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:31 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:31.503564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0a0f8bdb-8e62-4dce-a726-7639befa3806 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:31.505733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0a0f8bdb-8e62-4dce-a726-7639befa3806 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:31.512126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a0f8bdb-8e62-4dce-a726-7639befa3806 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:31.512655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a0f8bdb-8e62-4dce-a726-7639befa3806 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:31.513118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a0f8bdb-8e62-4dce-a726-7639befa3806 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:31.513801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a0f8bdb-8e62-4dce-a726-7639befa3806 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:31.514249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a0f8bdb-8e62-4dce-a726-7639befa3806 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:31.514665 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a0f8bdb-8e62-4dce-a726-7639befa3806 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:31.543456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0a0f8bdb-8e62-4dce-a726-7639befa3806 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043828 Aug 24 06:23:31.544009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 472/950] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:32.456003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9704fadd-5887-466d-8ffa-4d315cb75cfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:32.458872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9704fadd-5887-466d-8ffa-4d315cb75cfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:32.465375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9704fadd-5887-466d-8ffa-4d315cb75cfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:32.465853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9704fadd-5887-466d-8ffa-4d315cb75cfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:32.466296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9704fadd-5887-466d-8ffa-4d315cb75cfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:32.467022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9704fadd-5887-466d-8ffa-4d315cb75cfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:32.467474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9704fadd-5887-466d-8ffa-4d315cb75cfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:32.467898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9704fadd-5887-466d-8ffa-4d315cb75cfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:32.499136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9704fadd-5887-466d-8ffa-4d315cb75cfd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047157 Aug 24 06:23:32.499703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 479/951] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:32.555993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-899716ad-8f59-45fd-a094-5b50976c9991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:32.558137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-899716ad-8f59-45fd-a094-5b50976c9991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:32.564519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-899716ad-8f59-45fd-a094-5b50976c9991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:32.565021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-899716ad-8f59-45fd-a094-5b50976c9991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:32.565455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-899716ad-8f59-45fd-a094-5b50976c9991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:32.566144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-899716ad-8f59-45fd-a094-5b50976c9991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:32.566594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-899716ad-8f59-45fd-a094-5b50976c9991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:32.567017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-899716ad-8f59-45fd-a094-5b50976c9991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:32.607630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-899716ad-8f59-45fd-a094-5b50976c9991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056279 Aug 24 06:23:32.608374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 473/952] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:33.511709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6c592871-d9a2-4658-9160-b090f91fe11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:33.513889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6c592871-d9a2-4658-9160-b090f91fe11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:33.520772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c592871-d9a2-4658-9160-b090f91fe11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:33.521198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c592871-d9a2-4658-9160-b090f91fe11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:33.521624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c592871-d9a2-4658-9160-b090f91fe11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:33.522299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c592871-d9a2-4658-9160-b090f91fe11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:33.522745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c592871-d9a2-4658-9160-b090f91fe11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:33.523215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c592871-d9a2-4658-9160-b090f91fe11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:33.552408 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6c592871-d9a2-4658-9160-b090f91fe11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Aug 24 06:23:33.553028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 480/953] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:33.620339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6299625c-414c-4f39-b697-74f229af6a88 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:33.622546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6299625c-414c-4f39-b697-74f229af6a88 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:33.629092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6299625c-414c-4f39-b697-74f229af6a88 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:33.630064 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6299625c-414c-4f39-b697-74f229af6a88 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:33.630496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6299625c-414c-4f39-b697-74f229af6a88 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:33.631176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6299625c-414c-4f39-b697-74f229af6a88 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:33.631630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6299625c-414c-4f39-b697-74f229af6a88 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:33.632048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6299625c-414c-4f39-b697-74f229af6a88 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:33.663111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6299625c-414c-4f39-b697-74f229af6a88 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046850 Aug 24 06:23:33.663688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 474/954] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:34.565242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-80415fa7-209f-4147-968e-f390b5e5090c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:34.567903 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-80415fa7-209f-4147-968e-f390b5e5090c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:34.574326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80415fa7-209f-4147-968e-f390b5e5090c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:34.574807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80415fa7-209f-4147-968e-f390b5e5090c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:34.575252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80415fa7-209f-4147-968e-f390b5e5090c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:34.575941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80415fa7-209f-4147-968e-f390b5e5090c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:34.576396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80415fa7-209f-4147-968e-f390b5e5090c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:34.576849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80415fa7-209f-4147-968e-f390b5e5090c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:34.608348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-80415fa7-209f-4147-968e-f390b5e5090c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047133 Aug 24 06:23:34.608938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 481/955] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:34 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:34.675349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-075a2501-de4b-4a44-b45d-f471d6f1908a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:34.678084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-075a2501-de4b-4a44-b45d-f471d6f1908a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:34.685236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-075a2501-de4b-4a44-b45d-f471d6f1908a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:34.685721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-075a2501-de4b-4a44-b45d-f471d6f1908a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:34.686149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-075a2501-de4b-4a44-b45d-f471d6f1908a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:34.686848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-075a2501-de4b-4a44-b45d-f471d6f1908a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:34.687295 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-075a2501-de4b-4a44-b45d-f471d6f1908a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:34.687709 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-075a2501-de4b-4a44-b45d-f471d6f1908a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:34.719410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-075a2501-de4b-4a44-b45d-f471d6f1908a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047968 Aug 24 06:23:34.720224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 475/956] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:34 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:35.620806 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2f72aa8b-ae9e-488f-ad1e-2e6cca45ee7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:35.622849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2f72aa8b-ae9e-488f-ad1e-2e6cca45ee7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:35.629450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f72aa8b-ae9e-488f-ad1e-2e6cca45ee7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:35.629922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f72aa8b-ae9e-488f-ad1e-2e6cca45ee7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:35.630351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f72aa8b-ae9e-488f-ad1e-2e6cca45ee7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:35.631027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f72aa8b-ae9e-488f-ad1e-2e6cca45ee7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:35.631470 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f72aa8b-ae9e-488f-ad1e-2e6cca45ee7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:35.631885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f72aa8b-ae9e-488f-ad1e-2e6cca45ee7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:35.662477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2f72aa8b-ae9e-488f-ad1e-2e6cca45ee7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 Aug 24 06:23:35.663288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 482/957] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:35.731703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-36332280-68af-4a58-b9d6-93c9ea26106c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:35.733896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-36332280-68af-4a58-b9d6-93c9ea26106c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:35.740283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36332280-68af-4a58-b9d6-93c9ea26106c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:35.740785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36332280-68af-4a58-b9d6-93c9ea26106c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:35.741215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36332280-68af-4a58-b9d6-93c9ea26106c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:35.741895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36332280-68af-4a58-b9d6-93c9ea26106c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:35.742342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36332280-68af-4a58-b9d6-93c9ea26106c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:35.742758 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36332280-68af-4a58-b9d6-93c9ea26106c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:35.771820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-36332280-68af-4a58-b9d6-93c9ea26106c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044091 Aug 24 06:23:35.772380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 476/958] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:36.676150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1b4a0d9e-7f95-4d8a-b5ec-65f7380dd94c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:36.678797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1b4a0d9e-7f95-4d8a-b5ec-65f7380dd94c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:36.681810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=60 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:23:36.687557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4a0d9e-7f95-4d8a-b5ec-65f7380dd94c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:36.688233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4a0d9e-7f95-4d8a-b5ec-65f7380dd94c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:36.688769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4a0d9e-7f95-4d8a-b5ec-65f7380dd94c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:36.689624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4a0d9e-7f95-4d8a-b5ec-65f7380dd94c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:36.690144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4a0d9e-7f95-4d8a-b5ec-65f7380dd94c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:36.690673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b4a0d9e-7f95-4d8a-b5ec-65f7380dd94c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:36.725953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1b4a0d9e-7f95-4d8a-b5ec-65f7380dd94c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054425 Aug 24 06:23:36.726611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 483/959] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:36 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:36.784184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ada206d6-0db7-46dc-b0a7-c8400edd34a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:36.786468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ada206d6-0db7-46dc-b0a7-c8400edd34a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:36.792995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ada206d6-0db7-46dc-b0a7-c8400edd34a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:36.793467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ada206d6-0db7-46dc-b0a7-c8400edd34a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:36.793895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ada206d6-0db7-46dc-b0a7-c8400edd34a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:36.794566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ada206d6-0db7-46dc-b0a7-c8400edd34a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:36.795011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ada206d6-0db7-46dc-b0a7-c8400edd34a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:36.795417 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ada206d6-0db7-46dc-b0a7-c8400edd34a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:36.826829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ada206d6-0db7-46dc-b0a7-c8400edd34a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046514 Aug 24 06:23:36.827399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 477/960] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:37.738584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f1c470ac-ef8d-4144-899b-98fb4be5de01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:37.741226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f1c470ac-ef8d-4144-899b-98fb4be5de01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:37.747616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f1c470ac-ef8d-4144-899b-98fb4be5de01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:37.748093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f1c470ac-ef8d-4144-899b-98fb4be5de01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:37.748602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f1c470ac-ef8d-4144-899b-98fb4be5de01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:37.749289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f1c470ac-ef8d-4144-899b-98fb4be5de01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:37.749740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f1c470ac-ef8d-4144-899b-98fb4be5de01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:37.750163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f1c470ac-ef8d-4144-899b-98fb4be5de01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:37.779400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f1c470ac-ef8d-4144-899b-98fb4be5de01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Aug 24 06:23:37.780020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 484/961] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:37.838680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2aec7ae3-83b7-4e37-8aab-98ec1492437f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:37.840840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2aec7ae3-83b7-4e37-8aab-98ec1492437f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:37.847327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aec7ae3-83b7-4e37-8aab-98ec1492437f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:37.847796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aec7ae3-83b7-4e37-8aab-98ec1492437f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:37.848216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aec7ae3-83b7-4e37-8aab-98ec1492437f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:37.848931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aec7ae3-83b7-4e37-8aab-98ec1492437f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:37.849372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aec7ae3-83b7-4e37-8aab-98ec1492437f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:37.849780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aec7ae3-83b7-4e37-8aab-98ec1492437f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:37.879205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2aec7ae3-83b7-4e37-8aab-98ec1492437f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044682 Aug 24 06:23:37.880364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 478/962] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:38.791428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3fe1596f-a20d-4e86-b1fa-8e5c0d8617bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:38.793601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3fe1596f-a20d-4e86-b1fa-8e5c0d8617bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:38.800177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fe1596f-a20d-4e86-b1fa-8e5c0d8617bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:38.800700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fe1596f-a20d-4e86-b1fa-8e5c0d8617bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:38.801153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fe1596f-a20d-4e86-b1fa-8e5c0d8617bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:38.802325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fe1596f-a20d-4e86-b1fa-8e5c0d8617bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:38.802774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fe1596f-a20d-4e86-b1fa-8e5c0d8617bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:38.803199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fe1596f-a20d-4e86-b1fa-8e5c0d8617bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:38.835472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3fe1596f-a20d-4e86-b1fa-8e5c0d8617bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048033 Aug 24 06:23:38.836032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 485/963] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:38 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:38.892722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-72c91660-c11d-42fa-86ce-d4a5d4d91273 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:38.894831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-72c91660-c11d-42fa-86ce-d4a5d4d91273 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:38.901670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72c91660-c11d-42fa-86ce-d4a5d4d91273 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:38.902157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72c91660-c11d-42fa-86ce-d4a5d4d91273 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:38.902643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72c91660-c11d-42fa-86ce-d4a5d4d91273 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:38.903433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72c91660-c11d-42fa-86ce-d4a5d4d91273 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:38.903903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72c91660-c11d-42fa-86ce-d4a5d4d91273 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:38.904334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72c91660-c11d-42fa-86ce-d4a5d4d91273 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:38.934453 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-72c91660-c11d-42fa-86ce-d4a5d4d91273 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045743 Aug 24 06:23:38.935022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 479/964] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:39.453467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:23:39.453701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:23:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:23:39.847433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0c137d3e-2663-4c15-b005-b54b50e0ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:39.850403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0c137d3e-2663-4c15-b005-b54b50e0ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:39.856752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c137d3e-2663-4c15-b005-b54b50e0ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:39.857234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c137d3e-2663-4c15-b005-b54b50e0ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:39.857667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c137d3e-2663-4c15-b005-b54b50e0ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:39.858357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c137d3e-2663-4c15-b005-b54b50e0ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:39.858837 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c137d3e-2663-4c15-b005-b54b50e0ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:39.859261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c137d3e-2663-4c15-b005-b54b50e0ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:39.888820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0c137d3e-2663-4c15-b005-b54b50e0ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045338 Aug 24 06:23:39.889385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 486/965] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:39 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:39.946867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d7744d56-1b2e-48ab-b706-20c9cbbb58cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:39.949004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d7744d56-1b2e-48ab-b706-20c9cbbb58cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:39.955415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7744d56-1b2e-48ab-b706-20c9cbbb58cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:39.955895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7744d56-1b2e-48ab-b706-20c9cbbb58cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:39.956327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7744d56-1b2e-48ab-b706-20c9cbbb58cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:39.957050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7744d56-1b2e-48ab-b706-20c9cbbb58cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:39.957992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7744d56-1b2e-48ab-b706-20c9cbbb58cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:39.958411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7744d56-1b2e-48ab-b706-20c9cbbb58cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:39.987874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d7744d56-1b2e-48ab-b706-20c9cbbb58cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045011 Aug 24 06:23:39.988350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 480/966] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:40.901129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a89c6358-9c1a-4af2-990e-e56558f8edf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:40.903438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a89c6358-9c1a-4af2-990e-e56558f8edf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:40.910067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89c6358-9c1a-4af2-990e-e56558f8edf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:40.910553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89c6358-9c1a-4af2-990e-e56558f8edf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:40.910989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89c6358-9c1a-4af2-990e-e56558f8edf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:40.911684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89c6358-9c1a-4af2-990e-e56558f8edf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:40.912246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89c6358-9c1a-4af2-990e-e56558f8edf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:40.912725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a89c6358-9c1a-4af2-990e-e56558f8edf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:40.944843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a89c6358-9c1a-4af2-990e-e56558f8edf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047604 Aug 24 06:23:40.945413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 487/967] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:40 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:41.000394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-38137e69-f65a-479b-9172-b5b7e1959938 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:41.002533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-38137e69-f65a-479b-9172-b5b7e1959938 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:41.009738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38137e69-f65a-479b-9172-b5b7e1959938 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:41.010214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38137e69-f65a-479b-9172-b5b7e1959938 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:41.010639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38137e69-f65a-479b-9172-b5b7e1959938 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:41.011324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38137e69-f65a-479b-9172-b5b7e1959938 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:41.011760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38137e69-f65a-479b-9172-b5b7e1959938 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:41.012174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38137e69-f65a-479b-9172-b5b7e1959938 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:41.042468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-38137e69-f65a-479b-9172-b5b7e1959938 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046139 Aug 24 06:23:41.043030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 481/968] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:41.959102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d5ee6312-ed11-4156-944e-b800be840a25 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:41.961387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d5ee6312-ed11-4156-944e-b800be840a25 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:41.967921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5ee6312-ed11-4156-944e-b800be840a25 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:41.968399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5ee6312-ed11-4156-944e-b800be840a25 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:41.968870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5ee6312-ed11-4156-944e-b800be840a25 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:41.969613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5ee6312-ed11-4156-944e-b800be840a25 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:41.970133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5ee6312-ed11-4156-944e-b800be840a25 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:41.970560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5ee6312-ed11-4156-944e-b800be840a25 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:41.999196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d5ee6312-ed11-4156-944e-b800be840a25 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044835 Aug 24 06:23:41.999782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 488/969] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:41 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:42.055375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bfb28883-a6ff-45ae-ad0a-70c0b194bd2d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:42.057570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bfb28883-a6ff-45ae-ad0a-70c0b194bd2d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:42.064179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfb28883-a6ff-45ae-ad0a-70c0b194bd2d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:42.064777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfb28883-a6ff-45ae-ad0a-70c0b194bd2d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:42.065209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfb28883-a6ff-45ae-ad0a-70c0b194bd2d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:42.065882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfb28883-a6ff-45ae-ad0a-70c0b194bd2d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:42.066318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfb28883-a6ff-45ae-ad0a-70c0b194bd2d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:42.067221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bfb28883-a6ff-45ae-ad0a-70c0b194bd2d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:42.096557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bfb28883-a6ff-45ae-ad0a-70c0b194bd2d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045255 Aug 24 06:23:42.097105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 482/970] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:43.011668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8bb93161-8330-42dd-a2ec-4e0b511828d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:43.013836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8bb93161-8330-42dd-a2ec-4e0b511828d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:43.020201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bb93161-8330-42dd-a2ec-4e0b511828d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:43.020720 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bb93161-8330-42dd-a2ec-4e0b511828d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:43.021148 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bb93161-8330-42dd-a2ec-4e0b511828d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:43.021838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bb93161-8330-42dd-a2ec-4e0b511828d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:43.022285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bb93161-8330-42dd-a2ec-4e0b511828d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:43.022701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8bb93161-8330-42dd-a2ec-4e0b511828d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:43.056631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8bb93161-8330-42dd-a2ec-4e0b511828d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048846 Aug 24 06:23:43.057197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 489/971] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:43 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:43.109649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-819132c0-2291-4e13-a57f-78e553e0b3ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:43.111778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-819132c0-2291-4e13-a57f-78e553e0b3ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:43.118705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819132c0-2291-4e13-a57f-78e553e0b3ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:43.119173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819132c0-2291-4e13-a57f-78e553e0b3ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:43.119597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819132c0-2291-4e13-a57f-78e553e0b3ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:43.120352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819132c0-2291-4e13-a57f-78e553e0b3ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:43.120819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819132c0-2291-4e13-a57f-78e553e0b3ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:43.121233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819132c0-2291-4e13-a57f-78e553e0b3ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:43.124893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:23:43.150942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-819132c0-2291-4e13-a57f-78e553e0b3ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045289 Aug 24 06:23:43.151490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 483/972] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:44.069664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3a7ae8d5-3805-4a0d-a1d0-6b9b9cd53fbb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:44.071737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3a7ae8d5-3805-4a0d-a1d0-6b9b9cd53fbb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:44.078732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a7ae8d5-3805-4a0d-a1d0-6b9b9cd53fbb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:44.079213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a7ae8d5-3805-4a0d-a1d0-6b9b9cd53fbb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:44.079644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a7ae8d5-3805-4a0d-a1d0-6b9b9cd53fbb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:44.080340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a7ae8d5-3805-4a0d-a1d0-6b9b9cd53fbb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:44.080972 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a7ae8d5-3805-4a0d-a1d0-6b9b9cd53fbb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:44.081522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a7ae8d5-3805-4a0d-a1d0-6b9b9cd53fbb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:44.099929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:23:44.114331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3a7ae8d5-3805-4a0d-a1d0-6b9b9cd53fbb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048704 Aug 24 06:23:44.114889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 490/973] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:44 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:44.164435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7d7d151f-85c6-4df3-b3b7-97144452b858 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:44.166762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7d7d151f-85c6-4df3-b3b7-97144452b858 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:44.173843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d7d151f-85c6-4df3-b3b7-97144452b858 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:44.174322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d7d151f-85c6-4df3-b3b7-97144452b858 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:44.174755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d7d151f-85c6-4df3-b3b7-97144452b858 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:44.175447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d7d151f-85c6-4df3-b3b7-97144452b858 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:44.175897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d7d151f-85c6-4df3-b3b7-97144452b858 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:44.176983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d7d151f-85c6-4df3-b3b7-97144452b858 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:44.207216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7d7d151f-85c6-4df3-b3b7-97144452b858 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047498 Aug 24 06:23:44.207775 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 484/974] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:45.128602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fb3f6b11-2397-45fc-bbbe-6af06310ccb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:45.131610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fb3f6b11-2397-45fc-bbbe-6af06310ccb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:45.139849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb3f6b11-2397-45fc-bbbe-6af06310ccb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:45.140326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb3f6b11-2397-45fc-bbbe-6af06310ccb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:45.140788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb3f6b11-2397-45fc-bbbe-6af06310ccb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:45.141472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb3f6b11-2397-45fc-bbbe-6af06310ccb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:45.141950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb3f6b11-2397-45fc-bbbe-6af06310ccb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:45.142371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb3f6b11-2397-45fc-bbbe-6af06310ccb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:45.179934 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fb3f6b11-2397-45fc-bbbe-6af06310ccb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056158 Aug 24 06:23:45.180501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 491/975] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:45 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:45.219682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-eb48fca8-4462-40c8-83a6-8c6feb7335fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:45.221859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-eb48fca8-4462-40c8-83a6-8c6feb7335fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:45.230316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb48fca8-4462-40c8-83a6-8c6feb7335fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:45.230316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb48fca8-4462-40c8-83a6-8c6feb7335fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:45.230316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb48fca8-4462-40c8-83a6-8c6feb7335fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:45.230316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb48fca8-4462-40c8-83a6-8c6feb7335fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:45.230697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb48fca8-4462-40c8-83a6-8c6feb7335fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:45.230794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb48fca8-4462-40c8-83a6-8c6feb7335fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:45.260450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-eb48fca8-4462-40c8-83a6-8c6feb7335fd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044748 Aug 24 06:23:45.261025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 485/976] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:23:46.193131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2c7c3555-2ebd-48e3-8938-1610658de834 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:46.195385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2c7c3555-2ebd-48e3-8938-1610658de834 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:46.201953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c7c3555-2ebd-48e3-8938-1610658de834 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:46.202427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c7c3555-2ebd-48e3-8938-1610658de834 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:46.202860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c7c3555-2ebd-48e3-8938-1610658de834 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:46.203538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c7c3555-2ebd-48e3-8938-1610658de834 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:46.203985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c7c3555-2ebd-48e3-8938-1610658de834 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:46.204402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c7c3555-2ebd-48e3-8938-1610658de834 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:46.233964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2c7c3555-2ebd-48e3-8938-1610658de834 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044820 Aug 24 06:23:46.234451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 492/977] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:46.272883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d8fd8686-3be3-4f47-a76a-ef2f89989019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:46.275051 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d8fd8686-3be3-4f47-a76a-ef2f89989019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:46.281456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d8fd8686-3be3-4f47-a76a-ef2f89989019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:46.281935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d8fd8686-3be3-4f47-a76a-ef2f89989019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:46.282369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d8fd8686-3be3-4f47-a76a-ef2f89989019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:46.283079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d8fd8686-3be3-4f47-a76a-ef2f89989019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:46.283529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d8fd8686-3be3-4f47-a76a-ef2f89989019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:46.283946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d8fd8686-3be3-4f47-a76a-ef2f89989019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:46.313740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d8fd8686-3be3-4f47-a76a-ef2f89989019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045340 Aug 24 06:23:46.314301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 486/978] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:47.247339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2115540f-eef0-4fd9-9bd9-dd907536dd5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:47.249425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2115540f-eef0-4fd9-9bd9-dd907536dd5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:47.255347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2115540f-eef0-4fd9-9bd9-dd907536dd5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:47.255871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2115540f-eef0-4fd9-9bd9-dd907536dd5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:47.256318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2115540f-eef0-4fd9-9bd9-dd907536dd5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:47.257033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2115540f-eef0-4fd9-9bd9-dd907536dd5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:47.257476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2115540f-eef0-4fd9-9bd9-dd907536dd5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:47.257894 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2115540f-eef0-4fd9-9bd9-dd907536dd5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:47.285928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2115540f-eef0-4fd9-9bd9-dd907536dd5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042799 Aug 24 06:23:47.286475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 493/979] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:47.327059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c80ca537-fe2f-4c16-8567-d3646b25dee3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:47.329223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c80ca537-fe2f-4c16-8567-d3646b25dee3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:47.335613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80ca537-fe2f-4c16-8567-d3646b25dee3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:47.336088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80ca537-fe2f-4c16-8567-d3646b25dee3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:47.336541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80ca537-fe2f-4c16-8567-d3646b25dee3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:47.337303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80ca537-fe2f-4c16-8567-d3646b25dee3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:47.337759 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80ca537-fe2f-4c16-8567-d3646b25dee3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:47.338176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c80ca537-fe2f-4c16-8567-d3646b25dee3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:47.368790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c80ca537-fe2f-4c16-8567-d3646b25dee3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045985 Aug 24 06:23:47.369349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 487/980] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:48.298620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0c894de2-8239-4eb9-b283-bc2ad2e7b9c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:48.300774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0c894de2-8239-4eb9-b283-bc2ad2e7b9c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:48.307793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c894de2-8239-4eb9-b283-bc2ad2e7b9c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:48.308316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c894de2-8239-4eb9-b283-bc2ad2e7b9c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:48.308789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c894de2-8239-4eb9-b283-bc2ad2e7b9c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:48.309481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c894de2-8239-4eb9-b283-bc2ad2e7b9c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:48.309930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c894de2-8239-4eb9-b283-bc2ad2e7b9c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:48.310356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c894de2-8239-4eb9-b283-bc2ad2e7b9c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:48.340339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0c894de2-8239-4eb9-b283-bc2ad2e7b9c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Aug 24 06:23:48.340999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 494/981] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:48.381768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-260c4d1a-0d99-4880-99d3-0f1f5ec0eb4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:48.383883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-260c4d1a-0d99-4880-99d3-0f1f5ec0eb4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:48.390291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-260c4d1a-0d99-4880-99d3-0f1f5ec0eb4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:48.390765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-260c4d1a-0d99-4880-99d3-0f1f5ec0eb4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:48.391204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-260c4d1a-0d99-4880-99d3-0f1f5ec0eb4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:48.391885 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-260c4d1a-0d99-4880-99d3-0f1f5ec0eb4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:48.392336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-260c4d1a-0d99-4880-99d3-0f1f5ec0eb4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:48.392909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-260c4d1a-0d99-4880-99d3-0f1f5ec0eb4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:48.420902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-260c4d1a-0d99-4880-99d3-0f1f5ec0eb4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043795 Aug 24 06:23:48.421450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 488/982] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:49.353001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2ba784c6-cd85-4ae6-b937-d08679431ef1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:49.355534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2ba784c6-cd85-4ae6-b937-d08679431ef1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:49.362197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ba784c6-cd85-4ae6-b937-d08679431ef1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:49.362678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ba784c6-cd85-4ae6-b937-d08679431ef1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:49.363116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ba784c6-cd85-4ae6-b937-d08679431ef1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:49.363811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ba784c6-cd85-4ae6-b937-d08679431ef1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:49.364271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ba784c6-cd85-4ae6-b937-d08679431ef1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:49.365317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ba784c6-cd85-4ae6-b937-d08679431ef1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:49.394610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2ba784c6-cd85-4ae6-b937-d08679431ef1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046616 Aug 24 06:23:49.395171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 495/983] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:49 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:49.437433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-578e0fcb-f59d-437e-9bea-2b43a37b9081 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:49.440654 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-578e0fcb-f59d-437e-9bea-2b43a37b9081 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:49.444631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=58 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:23:49.451683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-578e0fcb-f59d-437e-9bea-2b43a37b9081 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:49.453585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-578e0fcb-f59d-437e-9bea-2b43a37b9081 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:49.453585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-578e0fcb-f59d-437e-9bea-2b43a37b9081 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:49.454153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-578e0fcb-f59d-437e-9bea-2b43a37b9081 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:49.454614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-578e0fcb-f59d-437e-9bea-2b43a37b9081 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:49.455040 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-578e0fcb-f59d-437e-9bea-2b43a37b9081 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:49.496360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-578e0fcb-f59d-437e-9bea-2b43a37b9081 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065378 Aug 24 06:23:49.497260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 489/984] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:23:50.406370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-638ca14d-8a99-43ac-af5f-adf6079c8390 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:50.408398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-638ca14d-8a99-43ac-af5f-adf6079c8390 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:50.414796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-638ca14d-8a99-43ac-af5f-adf6079c8390 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:50.415266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-638ca14d-8a99-43ac-af5f-adf6079c8390 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:50.415694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-638ca14d-8a99-43ac-af5f-adf6079c8390 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:50.416375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-638ca14d-8a99-43ac-af5f-adf6079c8390 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:50.416854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-638ca14d-8a99-43ac-af5f-adf6079c8390 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:50.417276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-638ca14d-8a99-43ac-af5f-adf6079c8390 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:50.448057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-638ca14d-8a99-43ac-af5f-adf6079c8390 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045674 Aug 24 06:23:50.448819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 496/985] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:50.509554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c8625f19-360d-4757-94e4-8785169cc8d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:50.511679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c8625f19-360d-4757-94e4-8785169cc8d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:50.518030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8625f19-360d-4757-94e4-8785169cc8d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:50.518507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8625f19-360d-4757-94e4-8785169cc8d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:50.518937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8625f19-360d-4757-94e4-8785169cc8d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:50.519613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8625f19-360d-4757-94e4-8785169cc8d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:50.520060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8625f19-360d-4757-94e4-8785169cc8d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:50.520475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8625f19-360d-4757-94e4-8785169cc8d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:50.548778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c8625f19-360d-4757-94e4-8785169cc8d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043858 Aug 24 06:23:50.549341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 490/986] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:51.461282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cd914e18-85e7-4392-8151-1fe90589b316 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:51.463453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cd914e18-85e7-4392-8151-1fe90589b316 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:51.469944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd914e18-85e7-4392-8151-1fe90589b316 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:51.470412 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd914e18-85e7-4392-8151-1fe90589b316 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:51.470843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd914e18-85e7-4392-8151-1fe90589b316 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:51.471522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd914e18-85e7-4392-8151-1fe90589b316 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:51.471971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd914e18-85e7-4392-8151-1fe90589b316 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:51.472395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd914e18-85e7-4392-8151-1fe90589b316 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:51.501987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cd914e18-85e7-4392-8151-1fe90589b316 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Aug 24 06:23:51.502599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 497/987] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:51.561915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-28023b72-17df-4ae5-89e1-64e312dcf6ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:51.564058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-28023b72-17df-4ae5-89e1-64e312dcf6ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:51.571231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28023b72-17df-4ae5-89e1-64e312dcf6ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:51.571705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28023b72-17df-4ae5-89e1-64e312dcf6ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:51.572134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28023b72-17df-4ae5-89e1-64e312dcf6ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:51.572853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28023b72-17df-4ae5-89e1-64e312dcf6ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:51.573307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28023b72-17df-4ae5-89e1-64e312dcf6ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:51.573723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28023b72-17df-4ae5-89e1-64e312dcf6ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:51.602825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-28023b72-17df-4ae5-89e1-64e312dcf6ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044890 Aug 24 06:23:51.603380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 491/988] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:51 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:52.515079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4a944b92-1755-4549-9b06-8e8c0166c1bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:52.517259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4a944b92-1755-4549-9b06-8e8c0166c1bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:52.523711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a944b92-1755-4549-9b06-8e8c0166c1bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:52.524189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a944b92-1755-4549-9b06-8e8c0166c1bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:52.524653 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a944b92-1755-4549-9b06-8e8c0166c1bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:52.525338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a944b92-1755-4549-9b06-8e8c0166c1bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:52.525787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a944b92-1755-4549-9b06-8e8c0166c1bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:52.526208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4a944b92-1755-4549-9b06-8e8c0166c1bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:52.555758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4a944b92-1755-4549-9b06-8e8c0166c1bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Aug 24 06:23:52.556311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 498/989] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:52 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:52.616207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8cfa1c0a-3b33-44b1-83de-47ae9d6d4379 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:52.618398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8cfa1c0a-3b33-44b1-83de-47ae9d6d4379 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:52.624777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8cfa1c0a-3b33-44b1-83de-47ae9d6d4379 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:52.625248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8cfa1c0a-3b33-44b1-83de-47ae9d6d4379 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:52.625676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8cfa1c0a-3b33-44b1-83de-47ae9d6d4379 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:52.626360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8cfa1c0a-3b33-44b1-83de-47ae9d6d4379 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:52.626803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8cfa1c0a-3b33-44b1-83de-47ae9d6d4379 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:52.627219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8cfa1c0a-3b33-44b1-83de-47ae9d6d4379 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:52.655710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8cfa1c0a-3b33-44b1-83de-47ae9d6d4379 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044190 Aug 24 06:23:52.656262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 492/990] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:53.568088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b1c12fd8-fcfd-46bc-97e3-549f6080bf0c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:53.570150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b1c12fd8-fcfd-46bc-97e3-549f6080bf0c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:53.576879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1c12fd8-fcfd-46bc-97e3-549f6080bf0c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:53.577359 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1c12fd8-fcfd-46bc-97e3-549f6080bf0c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:53.577790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1c12fd8-fcfd-46bc-97e3-549f6080bf0c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:53.578479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1c12fd8-fcfd-46bc-97e3-549f6080bf0c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:53.578927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1c12fd8-fcfd-46bc-97e3-549f6080bf0c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:53.579344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1c12fd8-fcfd-46bc-97e3-549f6080bf0c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:53.609508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b1c12fd8-fcfd-46bc-97e3-549f6080bf0c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045418 Aug 24 06:23:53.610076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 499/991] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:53.668904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-11b1a0ec-801a-430e-8247-7e6985687248 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:53.671000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-11b1a0ec-801a-430e-8247-7e6985687248 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:53.677351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11b1a0ec-801a-430e-8247-7e6985687248 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:53.677915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11b1a0ec-801a-430e-8247-7e6985687248 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:53.678345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11b1a0ec-801a-430e-8247-7e6985687248 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:53.679082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11b1a0ec-801a-430e-8247-7e6985687248 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:53.679534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11b1a0ec-801a-430e-8247-7e6985687248 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:53.680215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11b1a0ec-801a-430e-8247-7e6985687248 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:53.710702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-11b1a0ec-801a-430e-8247-7e6985687248 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045714 Aug 24 06:23:53.711278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 493/992] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:54.621984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6336868a-05b0-4fc9-84d1-32e4bcecfde2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:54.624024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6336868a-05b0-4fc9-84d1-32e4bcecfde2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:54.630951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6336868a-05b0-4fc9-84d1-32e4bcecfde2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:54.631426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6336868a-05b0-4fc9-84d1-32e4bcecfde2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:54.631858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6336868a-05b0-4fc9-84d1-32e4bcecfde2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:54.632638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6336868a-05b0-4fc9-84d1-32e4bcecfde2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:54.633090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6336868a-05b0-4fc9-84d1-32e4bcecfde2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:54.633525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6336868a-05b0-4fc9-84d1-32e4bcecfde2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:54.662382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6336868a-05b0-4fc9-84d1-32e4bcecfde2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044609 Aug 24 06:23:54.662935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 500/993] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:54.722989 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b7ecb59d-8fcd-4ce9-9b03-48bbca1bdcea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:54.725115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b7ecb59d-8fcd-4ce9-9b03-48bbca1bdcea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:54.731510 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7ecb59d-8fcd-4ce9-9b03-48bbca1bdcea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:54.731985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7ecb59d-8fcd-4ce9-9b03-48bbca1bdcea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:54.732411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7ecb59d-8fcd-4ce9-9b03-48bbca1bdcea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:54.733114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7ecb59d-8fcd-4ce9-9b03-48bbca1bdcea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:54.733562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7ecb59d-8fcd-4ce9-9b03-48bbca1bdcea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:54.733973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7ecb59d-8fcd-4ce9-9b03-48bbca1bdcea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:54.763525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b7ecb59d-8fcd-4ce9-9b03-48bbca1bdcea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044512 Aug 24 06:23:54.764091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 494/994] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:54 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:55.674611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-61008e46-1265-4a42-84b3-84e1429c3578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:55.676831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-61008e46-1265-4a42-84b3-84e1429c3578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:55.684063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61008e46-1265-4a42-84b3-84e1429c3578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:55.684576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61008e46-1265-4a42-84b3-84e1429c3578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:55.685018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61008e46-1265-4a42-84b3-84e1429c3578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:55.685769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61008e46-1265-4a42-84b3-84e1429c3578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:55.686225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61008e46-1265-4a42-84b3-84e1429c3578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:55.686649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61008e46-1265-4a42-84b3-84e1429c3578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:55.716737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-61008e46-1265-4a42-84b3-84e1429c3578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046027 Aug 24 06:23:55.717301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 501/995] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:55 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:55.776763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f1e61ac9-59b8-4ac7-944c-03d77d13f77e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:55.778897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f1e61ac9-59b8-4ac7-944c-03d77d13f77e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:55.785327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1e61ac9-59b8-4ac7-944c-03d77d13f77e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:55.785796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1e61ac9-59b8-4ac7-944c-03d77d13f77e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:55.786221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1e61ac9-59b8-4ac7-944c-03d77d13f77e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:55.786896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1e61ac9-59b8-4ac7-944c-03d77d13f77e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:55.787339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1e61ac9-59b8-4ac7-944c-03d77d13f77e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:55.787751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1e61ac9-59b8-4ac7-944c-03d77d13f77e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:55.817009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f1e61ac9-59b8-4ac7-944c-03d77d13f77e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044202 Aug 24 06:23:55.817549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 495/996] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:56.729109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-54e80bec-cd21-4da1-91d0-29b58c91f7be tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:56.731256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-54e80bec-cd21-4da1-91d0-29b58c91f7be tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:56.737960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54e80bec-cd21-4da1-91d0-29b58c91f7be tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:56.738442 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54e80bec-cd21-4da1-91d0-29b58c91f7be tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:56.738880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54e80bec-cd21-4da1-91d0-29b58c91f7be tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:56.739570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54e80bec-cd21-4da1-91d0-29b58c91f7be tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:56.740022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54e80bec-cd21-4da1-91d0-29b58c91f7be tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:56.740446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54e80bec-cd21-4da1-91d0-29b58c91f7be tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:56.768917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-54e80bec-cd21-4da1-91d0-29b58c91f7be tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043864 Aug 24 06:23:56.769469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 502/997] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:56.829876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3d614927-111e-4831-abcd-ddc626c95b0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:56.832087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3d614927-111e-4831-abcd-ddc626c95b0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:56.839163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d614927-111e-4831-abcd-ddc626c95b0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:56.839628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d614927-111e-4831-abcd-ddc626c95b0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:56.840053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d614927-111e-4831-abcd-ddc626c95b0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:56.840760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d614927-111e-4831-abcd-ddc626c95b0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:56.841202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d614927-111e-4831-abcd-ddc626c95b0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:56.841609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d614927-111e-4831-abcd-ddc626c95b0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:56.870174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3d614927-111e-4831-abcd-ddc626c95b0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044328 Aug 24 06:23:56.870732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 496/998] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:57.781697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9edd6ec0-a5ba-4daf-850d-a36b4780e78e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:57.783820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9edd6ec0-a5ba-4daf-850d-a36b4780e78e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:57.790242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9edd6ec0-a5ba-4daf-850d-a36b4780e78e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:57.790717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9edd6ec0-a5ba-4daf-850d-a36b4780e78e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:57.791149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9edd6ec0-a5ba-4daf-850d-a36b4780e78e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:57.791831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9edd6ec0-a5ba-4daf-850d-a36b4780e78e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:57.792274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9edd6ec0-a5ba-4daf-850d-a36b4780e78e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:57.792732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9edd6ec0-a5ba-4daf-850d-a36b4780e78e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:57.822255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9edd6ec0-a5ba-4daf-850d-a36b4780e78e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044463 Aug 24 06:23:57.822814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 503/999] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:57 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:57.883048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5f5bab36-b4b9-4d39-8307-15831e322359 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:57.885409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5f5bab36-b4b9-4d39-8307-15831e322359 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:57.891896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5bab36-b4b9-4d39-8307-15831e322359 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:57.892375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5bab36-b4b9-4d39-8307-15831e322359 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:57.892840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5bab36-b4b9-4d39-8307-15831e322359 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:57.893527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5bab36-b4b9-4d39-8307-15831e322359 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:57.894007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5bab36-b4b9-4d39-8307-15831e322359 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:57.894424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5f5bab36-b4b9-4d39-8307-15831e322359 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:57.923993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5f5bab36-b4b9-4d39-8307-15831e322359 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045535 Aug 24 06:23:57.924574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 497/1000] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:57 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:58.834767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2b0b22ea-1ee9-4898-b327-bb15044606f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:58.836884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2b0b22ea-1ee9-4898-b327-bb15044606f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:58.843492 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b0b22ea-1ee9-4898-b327-bb15044606f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:58.843970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b0b22ea-1ee9-4898-b327-bb15044606f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:58.844402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b0b22ea-1ee9-4898-b327-bb15044606f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:58.845149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b0b22ea-1ee9-4898-b327-bb15044606f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:58.845596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b0b22ea-1ee9-4898-b327-bb15044606f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:58.846016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b0b22ea-1ee9-4898-b327-bb15044606f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:58.875678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2b0b22ea-1ee9-4898-b327-bb15044606f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045043 Aug 24 06:23:58.876224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 504/1001] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:58.936836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dbf785d2-4d7a-4a53-b6c8-5ccd184fc36c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:58.938942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dbf785d2-4d7a-4a53-b6c8-5ccd184fc36c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:58.945338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbf785d2-4d7a-4a53-b6c8-5ccd184fc36c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:58.945809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbf785d2-4d7a-4a53-b6c8-5ccd184fc36c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:58.946268 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbf785d2-4d7a-4a53-b6c8-5ccd184fc36c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:58.946942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbf785d2-4d7a-4a53-b6c8-5ccd184fc36c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:58.947390 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbf785d2-4d7a-4a53-b6c8-5ccd184fc36c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:58.947804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbf785d2-4d7a-4a53-b6c8-5ccd184fc36c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:58.977748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dbf785d2-4d7a-4a53-b6c8-5ccd184fc36c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044652 Aug 24 06:23:58.978488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 498/1002] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:58 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:23:59.888171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-746d21bc-3b9a-4f72-915d-6265c5559e57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:59.890279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-746d21bc-3b9a-4f72-915d-6265c5559e57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:59.896667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-746d21bc-3b9a-4f72-915d-6265c5559e57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:59.897138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-746d21bc-3b9a-4f72-915d-6265c5559e57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:59.897567 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-746d21bc-3b9a-4f72-915d-6265c5559e57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:59.898241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-746d21bc-3b9a-4f72-915d-6265c5559e57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:23:59.898686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-746d21bc-3b9a-4f72-915d-6265c5559e57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:23:59.899099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-746d21bc-3b9a-4f72-915d-6265c5559e57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:23:59.928536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-746d21bc-3b9a-4f72-915d-6265c5559e57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Aug 24 06:23:59.929093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 505/1003] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:23:59 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:23:59.991184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-13513910-98dc-4f07-b1c9-6847e9c01ebc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:23:59.993412 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-13513910-98dc-4f07-b1c9-6847e9c01ebc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:23:59.999644 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13513910-98dc-4f07-b1c9-6847e9c01ebc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:00.000147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13513910-98dc-4f07-b1c9-6847e9c01ebc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:00.000573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13513910-98dc-4f07-b1c9-6847e9c01ebc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:00.001253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13513910-98dc-4f07-b1c9-6847e9c01ebc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:00.001699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13513910-98dc-4f07-b1c9-6847e9c01ebc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:00.002112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-13513910-98dc-4f07-b1c9-6847e9c01ebc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:00.026912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:00.031496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-13513910-98dc-4f07-b1c9-6847e9c01ebc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044812 Aug 24 06:24:00.032048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 499/1004] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:23:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:00.941199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-968d609d-9c7d-4ec2-a138-60515980e508 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:00.944008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-968d609d-9c7d-4ec2-a138-60515980e508 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:00.951532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968d609d-9c7d-4ec2-a138-60515980e508 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:00.952023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968d609d-9c7d-4ec2-a138-60515980e508 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:00.952461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968d609d-9c7d-4ec2-a138-60515980e508 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:00.953192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968d609d-9c7d-4ec2-a138-60515980e508 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:00.953730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968d609d-9c7d-4ec2-a138-60515980e508 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:00.954326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968d609d-9c7d-4ec2-a138-60515980e508 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:00.986383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-968d609d-9c7d-4ec2-a138-60515980e508 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049129 Aug 24 06:24:00.986962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 506/1005] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:24:01.044145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-37c894fa-b8da-418f-9b6f-d24b44d3c296 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:01.046377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-37c894fa-b8da-418f-9b6f-d24b44d3c296 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:01.053441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37c894fa-b8da-418f-9b6f-d24b44d3c296 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:01.053914 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37c894fa-b8da-418f-9b6f-d24b44d3c296 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:01.054344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37c894fa-b8da-418f-9b6f-d24b44d3c296 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:01.055346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37c894fa-b8da-418f-9b6f-d24b44d3c296 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:01.055795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37c894fa-b8da-418f-9b6f-d24b44d3c296 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:01.056210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37c894fa-b8da-418f-9b6f-d24b44d3c296 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:01.084548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-37c894fa-b8da-418f-9b6f-d24b44d3c296 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044663 Aug 24 06:24:01.085107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 500/1006] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:01.999414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-47077a78-06db-4f28-ba1b-667af6b9f752 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:02.001635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-47077a78-06db-4f28-ba1b-667af6b9f752 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:02.008651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47077a78-06db-4f28-ba1b-667af6b9f752 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:02.009130 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47077a78-06db-4f28-ba1b-667af6b9f752 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:02.009560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47077a78-06db-4f28-ba1b-667af6b9f752 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:02.010252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47077a78-06db-4f28-ba1b-667af6b9f752 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:02.010701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47077a78-06db-4f28-ba1b-667af6b9f752 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:02.011154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47077a78-06db-4f28-ba1b-667af6b9f752 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:02.014813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:02.040793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-47077a78-06db-4f28-ba1b-667af6b9f752 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045295 Aug 24 06:24:02.041355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 507/1007] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:02.096067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e7838028-40ed-4d26-b8da-7ed55beec5b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:02.098257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e7838028-40ed-4d26-b8da-7ed55beec5b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:02.104871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7838028-40ed-4d26-b8da-7ed55beec5b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:02.105342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7838028-40ed-4d26-b8da-7ed55beec5b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:02.105770 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7838028-40ed-4d26-b8da-7ed55beec5b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:02.106447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7838028-40ed-4d26-b8da-7ed55beec5b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:02.106889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7838028-40ed-4d26-b8da-7ed55beec5b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:02.107303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7838028-40ed-4d26-b8da-7ed55beec5b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:02.136357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e7838028-40ed-4d26-b8da-7ed55beec5b1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044354 Aug 24 06:24:02.136927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 501/1008] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:03.053542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f6730697-1989-4422-b474-6680de3fa021 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:03.055943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f6730697-1989-4422-b474-6680de3fa021 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:03.062426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6730697-1989-4422-b474-6680de3fa021 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:03.062897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6730697-1989-4422-b474-6680de3fa021 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:03.063326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6730697-1989-4422-b474-6680de3fa021 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:03.064007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6730697-1989-4422-b474-6680de3fa021 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:03.064447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6730697-1989-4422-b474-6680de3fa021 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:03.064884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6730697-1989-4422-b474-6680de3fa021 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:03.093783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f6730697-1989-4422-b474-6680de3fa021 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 Aug 24 06:24:03.094329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 508/1009] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:03 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:03.149424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ace3bb84-a377-4609-84d0-704d4e2cfd8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:03.151669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ace3bb84-a377-4609-84d0-704d4e2cfd8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:03.158015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ace3bb84-a377-4609-84d0-704d4e2cfd8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:03.158499 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ace3bb84-a377-4609-84d0-704d4e2cfd8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:03.158932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ace3bb84-a377-4609-84d0-704d4e2cfd8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:03.159627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ace3bb84-a377-4609-84d0-704d4e2cfd8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:03.160075 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ace3bb84-a377-4609-84d0-704d4e2cfd8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:03.160520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ace3bb84-a377-4609-84d0-704d4e2cfd8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:03.190101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ace3bb84-a377-4609-84d0-704d4e2cfd8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045233 Aug 24 06:24:03.190648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 502/1010] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:04.106518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f27289c1-49d3-4080-a1ef-3f7b051aa829 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:04.108599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f27289c1-49d3-4080-a1ef-3f7b051aa829 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:04.115059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27289c1-49d3-4080-a1ef-3f7b051aa829 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:04.115535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27289c1-49d3-4080-a1ef-3f7b051aa829 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:04.115969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27289c1-49d3-4080-a1ef-3f7b051aa829 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:04.117376 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27289c1-49d3-4080-a1ef-3f7b051aa829 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:04.117829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27289c1-49d3-4080-a1ef-3f7b051aa829 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:04.118247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27289c1-49d3-4080-a1ef-3f7b051aa829 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:04.146499 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f27289c1-49d3-4080-a1ef-3f7b051aa829 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Aug 24 06:24:04.147047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 509/1011] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:04.205804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-525aa118-4949-4b2a-b205-ccba75e95ddd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:04.207960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-525aa118-4949-4b2a-b205-ccba75e95ddd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:04.214478 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-525aa118-4949-4b2a-b205-ccba75e95ddd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:04.214954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-525aa118-4949-4b2a-b205-ccba75e95ddd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:04.215383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-525aa118-4949-4b2a-b205-ccba75e95ddd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:04.216072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-525aa118-4949-4b2a-b205-ccba75e95ddd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:04.216550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-525aa118-4949-4b2a-b205-ccba75e95ddd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:04.216973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-525aa118-4949-4b2a-b205-ccba75e95ddd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:04.247097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-525aa118-4949-4b2a-b205-ccba75e95ddd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045366 Aug 24 06:24:04.247644 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 503/1012] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:04 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:05.158763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-60d118ad-0f27-44ec-a27e-3a01e3bc3c67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:05.160899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-60d118ad-0f27-44ec-a27e-3a01e3bc3c67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:05.167215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60d118ad-0f27-44ec-a27e-3a01e3bc3c67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:05.167686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60d118ad-0f27-44ec-a27e-3a01e3bc3c67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:05.168114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60d118ad-0f27-44ec-a27e-3a01e3bc3c67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:05.168823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60d118ad-0f27-44ec-a27e-3a01e3bc3c67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:05.169272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60d118ad-0f27-44ec-a27e-3a01e3bc3c67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:05.169689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60d118ad-0f27-44ec-a27e-3a01e3bc3c67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:05.199146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-60d118ad-0f27-44ec-a27e-3a01e3bc3c67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 Aug 24 06:24:05.199688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 510/1013] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:05.260015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-60373c0a-a4e8-42ad-9df0-3a3ef699e164 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:05.262092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-60373c0a-a4e8-42ad-9df0-3a3ef699e164 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:05.268581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60373c0a-a4e8-42ad-9df0-3a3ef699e164 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:05.269063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60373c0a-a4e8-42ad-9df0-3a3ef699e164 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:05.269494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60373c0a-a4e8-42ad-9df0-3a3ef699e164 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:05.270178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60373c0a-a4e8-42ad-9df0-3a3ef699e164 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:05.270630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60373c0a-a4e8-42ad-9df0-3a3ef699e164 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:05.271066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-60373c0a-a4e8-42ad-9df0-3a3ef699e164 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:05.300007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-60373c0a-a4e8-42ad-9df0-3a3ef699e164 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044697 Aug 24 06:24:05.300578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 504/1014] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:06.211895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-11751269-63ac-4e34-97f6-d5023abc55cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:06.214146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-11751269-63ac-4e34-97f6-d5023abc55cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:06.220454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11751269-63ac-4e34-97f6-d5023abc55cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:06.220963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11751269-63ac-4e34-97f6-d5023abc55cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:06.221398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11751269-63ac-4e34-97f6-d5023abc55cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:06.222096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11751269-63ac-4e34-97f6-d5023abc55cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:06.222543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11751269-63ac-4e34-97f6-d5023abc55cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:06.222995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-11751269-63ac-4e34-97f6-d5023abc55cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:06.251270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-11751269-63ac-4e34-97f6-d5023abc55cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043950 Aug 24 06:24:06.251823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 511/1015] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:06.313237 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-41a5c7ef-2ade-4031-b738-d7395be6b1a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:06.315422 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-41a5c7ef-2ade-4031-b738-d7395be6b1a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:06.322420 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41a5c7ef-2ade-4031-b738-d7395be6b1a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:06.322899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41a5c7ef-2ade-4031-b738-d7395be6b1a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:06.323331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41a5c7ef-2ade-4031-b738-d7395be6b1a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:06.324013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41a5c7ef-2ade-4031-b738-d7395be6b1a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:06.324464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41a5c7ef-2ade-4031-b738-d7395be6b1a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:06.324918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41a5c7ef-2ade-4031-b738-d7395be6b1a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:06.355338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-41a5c7ef-2ade-4031-b738-d7395be6b1a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046072 Aug 24 06:24:06.355954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 505/1016] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:07.263447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9ba22409-9231-4e92-9b66-077d0cf00f03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:07.265601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9ba22409-9231-4e92-9b66-077d0cf00f03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:07.272005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ba22409-9231-4e92-9b66-077d0cf00f03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:07.272480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ba22409-9231-4e92-9b66-077d0cf00f03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:07.273443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ba22409-9231-4e92-9b66-077d0cf00f03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:07.274116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ba22409-9231-4e92-9b66-077d0cf00f03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:07.274557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ba22409-9231-4e92-9b66-077d0cf00f03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:07.274970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ba22409-9231-4e92-9b66-077d0cf00f03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:07.303538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9ba22409-9231-4e92-9b66-077d0cf00f03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 Aug 24 06:24:07.304121 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 512/1017] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:07.367462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-10979002-d38e-4276-b39c-b7a016af83f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:07.369616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-10979002-d38e-4276-b39c-b7a016af83f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:07.375878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10979002-d38e-4276-b39c-b7a016af83f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:07.376344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10979002-d38e-4276-b39c-b7a016af83f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:07.376822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10979002-d38e-4276-b39c-b7a016af83f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:07.377489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10979002-d38e-4276-b39c-b7a016af83f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:07.377957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10979002-d38e-4276-b39c-b7a016af83f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:07.378365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10979002-d38e-4276-b39c-b7a016af83f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:07.406844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-10979002-d38e-4276-b39c-b7a016af83f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043554 Aug 24 06:24:07.407381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 506/1018] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:07 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:08.316509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7bc9047d-cf3b-49ba-a90b-115103148491 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:08.318557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7bc9047d-cf3b-49ba-a90b-115103148491 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:08.321436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=60 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:08.326140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bc9047d-cf3b-49ba-a90b-115103148491 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:08.326619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bc9047d-cf3b-49ba-a90b-115103148491 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:08.327051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bc9047d-cf3b-49ba-a90b-115103148491 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:08.327736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bc9047d-cf3b-49ba-a90b-115103148491 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:08.328188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bc9047d-cf3b-49ba-a90b-115103148491 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:08.328634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bc9047d-cf3b-49ba-a90b-115103148491 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:08.357557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7bc9047d-cf3b-49ba-a90b-115103148491 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045108 Aug 24 06:24:08.358120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 513/1019] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:08.419672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-75445f03-5d7e-4723-a83f-96e499770a22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:08.421821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-75445f03-5d7e-4723-a83f-96e499770a22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:08.428368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75445f03-5d7e-4723-a83f-96e499770a22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:08.429517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75445f03-5d7e-4723-a83f-96e499770a22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:08.430206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75445f03-5d7e-4723-a83f-96e499770a22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:08.430897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75445f03-5d7e-4723-a83f-96e499770a22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:08.431340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75445f03-5d7e-4723-a83f-96e499770a22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:08.431755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-75445f03-5d7e-4723-a83f-96e499770a22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:08.460932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-75445f03-5d7e-4723-a83f-96e499770a22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045117 Aug 24 06:24:08.461491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 507/1020] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:09.370909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-78e8dd22-aa98-4137-961e-384df21ab2f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:09.373003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-78e8dd22-aa98-4137-961e-384df21ab2f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:09.379349 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78e8dd22-aa98-4137-961e-384df21ab2f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:09.379816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78e8dd22-aa98-4137-961e-384df21ab2f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:09.380242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78e8dd22-aa98-4137-961e-384df21ab2f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:09.380944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78e8dd22-aa98-4137-961e-384df21ab2f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:09.381388 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78e8dd22-aa98-4137-961e-384df21ab2f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:09.381802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78e8dd22-aa98-4137-961e-384df21ab2f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:09.409706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-78e8dd22-aa98-4137-961e-384df21ab2f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043838 Aug 24 06:24:09.410240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 514/1021] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:09 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:09.472355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-288a31b9-b746-4dbe-8108-8b288f5a85b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:09.474512 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-288a31b9-b746-4dbe-8108-8b288f5a85b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:09.481530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-288a31b9-b746-4dbe-8108-8b288f5a85b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:09.482002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-288a31b9-b746-4dbe-8108-8b288f5a85b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:09.482426 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-288a31b9-b746-4dbe-8108-8b288f5a85b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:09.483107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-288a31b9-b746-4dbe-8108-8b288f5a85b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:09.483548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-288a31b9-b746-4dbe-8108-8b288f5a85b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:09.483959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-288a31b9-b746-4dbe-8108-8b288f5a85b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:09.512929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-288a31b9-b746-4dbe-8108-8b288f5a85b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044400 Aug 24 06:24:09.513486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 508/1022] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:10.422480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-15d63e11-ff9e-4faf-97b0-ea16b23ce29c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:10.424595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-15d63e11-ff9e-4faf-97b0-ea16b23ce29c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:10.431685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15d63e11-ff9e-4faf-97b0-ea16b23ce29c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:10.432152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15d63e11-ff9e-4faf-97b0-ea16b23ce29c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:10.432606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15d63e11-ff9e-4faf-97b0-ea16b23ce29c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:10.433286 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15d63e11-ff9e-4faf-97b0-ea16b23ce29c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:10.433732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15d63e11-ff9e-4faf-97b0-ea16b23ce29c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:10.434144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-15d63e11-ff9e-4faf-97b0-ea16b23ce29c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:10.463953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-15d63e11-ff9e-4faf-97b0-ea16b23ce29c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045373 Aug 24 06:24:10.464521 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 515/1023] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:10 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:10.525207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-74d16a2f-70b9-444e-9be5-ae990f009396 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:10.527309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-74d16a2f-70b9-444e-9be5-ae990f009396 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:10.533715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74d16a2f-70b9-444e-9be5-ae990f009396 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:10.534182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74d16a2f-70b9-444e-9be5-ae990f009396 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:10.534601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74d16a2f-70b9-444e-9be5-ae990f009396 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:10.535275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74d16a2f-70b9-444e-9be5-ae990f009396 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:10.535709 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74d16a2f-70b9-444e-9be5-ae990f009396 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:10.536117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74d16a2f-70b9-444e-9be5-ae990f009396 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:10.564804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-74d16a2f-70b9-444e-9be5-ae990f009396 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043533 Aug 24 06:24:10.565346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 509/1024] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:10 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:11.475379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-95b85d38-615f-4976-8878-676786b7168a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:11.477446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-95b85d38-615f-4976-8878-676786b7168a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:11.483868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95b85d38-615f-4976-8878-676786b7168a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:11.484348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95b85d38-615f-4976-8878-676786b7168a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:11.484820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95b85d38-615f-4976-8878-676786b7168a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:11.485508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95b85d38-615f-4976-8878-676786b7168a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:11.485959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95b85d38-615f-4976-8878-676786b7168a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:11.486379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95b85d38-615f-4976-8878-676786b7168a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:11.515534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-95b85d38-615f-4976-8878-676786b7168a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044153 Aug 24 06:24:11.516083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 516/1025] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:11.577037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a4040081-c77b-4181-9e06-e0e36a98fd26 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:11.579144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a4040081-c77b-4181-9e06-e0e36a98fd26 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:11.586239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4040081-c77b-4181-9e06-e0e36a98fd26 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:11.586724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4040081-c77b-4181-9e06-e0e36a98fd26 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:11.587152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4040081-c77b-4181-9e06-e0e36a98fd26 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:11.587840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4040081-c77b-4181-9e06-e0e36a98fd26 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:11.588287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4040081-c77b-4181-9e06-e0e36a98fd26 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:11.588731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4040081-c77b-4181-9e06-e0e36a98fd26 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:11.617285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a4040081-c77b-4181-9e06-e0e36a98fd26 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044171 Aug 24 06:24:11.617843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 510/1026] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:12.527839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ca211819-18ba-438d-ae44-27dc3a828a8d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:12.529994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ca211819-18ba-438d-ae44-27dc3a828a8d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:12.536446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca211819-18ba-438d-ae44-27dc3a828a8d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:12.536959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca211819-18ba-438d-ae44-27dc3a828a8d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:12.537392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca211819-18ba-438d-ae44-27dc3a828a8d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:12.538739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca211819-18ba-438d-ae44-27dc3a828a8d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:12.539192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca211819-18ba-438d-ae44-27dc3a828a8d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:12.539619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca211819-18ba-438d-ae44-27dc3a828a8d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:12.568386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ca211819-18ba-438d-ae44-27dc3a828a8d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044383 Aug 24 06:24:12.568889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 517/1027] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:12.630227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-26172012-0811-4842-ba66-ea45bf1bd9e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:12.632357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-26172012-0811-4842-ba66-ea45bf1bd9e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:12.638854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26172012-0811-4842-ba66-ea45bf1bd9e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:12.639438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26172012-0811-4842-ba66-ea45bf1bd9e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:12.639743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26172012-0811-4842-ba66-ea45bf1bd9e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:12.640425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26172012-0811-4842-ba66-ea45bf1bd9e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:12.640898 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26172012-0811-4842-ba66-ea45bf1bd9e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:12.641317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26172012-0811-4842-ba66-ea45bf1bd9e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:12.673618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-26172012-0811-4842-ba66-ea45bf1bd9e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047506 Aug 24 06:24:12.674189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 511/1028] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:13.580584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3fb6d6ca-c958-4ee4-9c40-78fd32ba6701 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:13.582619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3fb6d6ca-c958-4ee4-9c40-78fd32ba6701 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:13.589601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fb6d6ca-c958-4ee4-9c40-78fd32ba6701 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:13.590069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fb6d6ca-c958-4ee4-9c40-78fd32ba6701 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:13.590493 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fb6d6ca-c958-4ee4-9c40-78fd32ba6701 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:13.591169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fb6d6ca-c958-4ee4-9c40-78fd32ba6701 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:13.591614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fb6d6ca-c958-4ee4-9c40-78fd32ba6701 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:13.592027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fb6d6ca-c958-4ee4-9c40-78fd32ba6701 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:13.623968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3fb6d6ca-c958-4ee4-9c40-78fd32ba6701 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047326 Aug 24 06:24:13.624561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 518/1029] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:13.686986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8b979160-52e5-4c6a-9da8-bc402774373a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:13.689212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8b979160-52e5-4c6a-9da8-bc402774373a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:13.696596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b979160-52e5-4c6a-9da8-bc402774373a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:13.697077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b979160-52e5-4c6a-9da8-bc402774373a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:13.697513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b979160-52e5-4c6a-9da8-bc402774373a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:13.698199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b979160-52e5-4c6a-9da8-bc402774373a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:13.698653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b979160-52e5-4c6a-9da8-bc402774373a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:13.699152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b979160-52e5-4c6a-9da8-bc402774373a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:13.729229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8b979160-52e5-4c6a-9da8-bc402774373a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046880 Aug 24 06:24:13.729776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 512/1030] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:13 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:14.636264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2f098af3-20ff-431b-b85b-bafa4cf13ba0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:14.638374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2f098af3-20ff-431b-b85b-bafa4cf13ba0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:14.644756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f098af3-20ff-431b-b85b-bafa4cf13ba0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:14.645230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f098af3-20ff-431b-b85b-bafa4cf13ba0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:14.645662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f098af3-20ff-431b-b85b-bafa4cf13ba0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:14.646343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f098af3-20ff-431b-b85b-bafa4cf13ba0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:14.646788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f098af3-20ff-431b-b85b-bafa4cf13ba0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:14.647221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f098af3-20ff-431b-b85b-bafa4cf13ba0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:14.676085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2f098af3-20ff-431b-b85b-bafa4cf13ba0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043887 Aug 24 06:24:14.676670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 519/1031] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:14.742250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-da72fce5-f791-4786-9160-23a398309ce8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:14.744412 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-da72fce5-f791-4786-9160-23a398309ce8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:14.750856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da72fce5-f791-4786-9160-23a398309ce8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:14.751346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da72fce5-f791-4786-9160-23a398309ce8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:14.751778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da72fce5-f791-4786-9160-23a398309ce8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:14.752458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da72fce5-f791-4786-9160-23a398309ce8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:14.752924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da72fce5-f791-4786-9160-23a398309ce8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:14.753341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da72fce5-f791-4786-9160-23a398309ce8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:14.782541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-da72fce5-f791-4786-9160-23a398309ce8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044858 Aug 24 06:24:14.783087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 513/1032] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:24:15.688759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-908b4bb7-956b-4aae-80ec-327c2c8c2783 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:15.690916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-908b4bb7-956b-4aae-80ec-327c2c8c2783 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:15.698547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-908b4bb7-956b-4aae-80ec-327c2c8c2783 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:15.699023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-908b4bb7-956b-4aae-80ec-327c2c8c2783 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:15.699450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-908b4bb7-956b-4aae-80ec-327c2c8c2783 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:15.700140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-908b4bb7-956b-4aae-80ec-327c2c8c2783 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:15.700617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-908b4bb7-956b-4aae-80ec-327c2c8c2783 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:15.701034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-908b4bb7-956b-4aae-80ec-327c2c8c2783 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:15.731544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-908b4bb7-956b-4aae-80ec-327c2c8c2783 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046726 Aug 24 06:24:15.732103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 520/1033] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:15 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:15.794953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2cbb2fb6-2f78-410c-832a-38d4076dcbf6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:15.797148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2cbb2fb6-2f78-410c-832a-38d4076dcbf6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:15.803472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cbb2fb6-2f78-410c-832a-38d4076dcbf6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:15.803944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cbb2fb6-2f78-410c-832a-38d4076dcbf6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:15.804371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cbb2fb6-2f78-410c-832a-38d4076dcbf6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:15.805802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cbb2fb6-2f78-410c-832a-38d4076dcbf6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:15.806242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cbb2fb6-2f78-410c-832a-38d4076dcbf6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:15.806657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cbb2fb6-2f78-410c-832a-38d4076dcbf6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:15.836231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2cbb2fb6-2f78-410c-832a-38d4076dcbf6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045247 Aug 24 06:24:15.836843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 514/1034] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:16.744008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7044d5d4-a861-4231-acf8-0defeba858df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:16.752886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7044d5d4-a861-4231-acf8-0defeba858df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:16.759516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7044d5d4-a861-4231-acf8-0defeba858df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:16.759967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7044d5d4-a861-4231-acf8-0defeba858df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:16.760396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7044d5d4-a861-4231-acf8-0defeba858df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:16.761144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7044d5d4-a861-4231-acf8-0defeba858df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:16.761587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7044d5d4-a861-4231-acf8-0defeba858df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:16.762005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7044d5d4-a861-4231-acf8-0defeba858df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:16.790984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7044d5d4-a861-4231-acf8-0defeba858df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051592 Aug 24 06:24:16.791532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 521/1035] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:16.848657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-745a527c-78e4-4847-8615-244b7c45426b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:16.853602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-745a527c-78e4-4847-8615-244b7c45426b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:16.857663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-745a527c-78e4-4847-8615-244b7c45426b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:16.858132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-745a527c-78e4-4847-8615-244b7c45426b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:16.858556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-745a527c-78e4-4847-8615-244b7c45426b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:16.859231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-745a527c-78e4-4847-8615-244b7c45426b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:16.859670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-745a527c-78e4-4847-8615-244b7c45426b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:16.860082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-745a527c-78e4-4847-8615-244b7c45426b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:16.890068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-745a527c-78e4-4847-8615-244b7c45426b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045464 Aug 24 06:24:16.890625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 515/1036] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:16 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:17.803362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2c910c48-cd81-44b7-ba1d-c3d734cbd303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:17.805693 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2c910c48-cd81-44b7-ba1d-c3d734cbd303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:17.811839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c910c48-cd81-44b7-ba1d-c3d734cbd303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:17.812315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c910c48-cd81-44b7-ba1d-c3d734cbd303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:17.812788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c910c48-cd81-44b7-ba1d-c3d734cbd303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:17.813472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c910c48-cd81-44b7-ba1d-c3d734cbd303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:17.813923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c910c48-cd81-44b7-ba1d-c3d734cbd303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:17.814350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c910c48-cd81-44b7-ba1d-c3d734cbd303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:17.843700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2c910c48-cd81-44b7-ba1d-c3d734cbd303 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Aug 24 06:24:17.844258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 522/1037] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:17 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:17.903406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-491fe953-0050-460b-9c38-38234e22b38c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:17.905553 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-491fe953-0050-460b-9c38-38234e22b38c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:17.911989 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-491fe953-0050-460b-9c38-38234e22b38c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:17.912471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-491fe953-0050-460b-9c38-38234e22b38c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:17.912936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-491fe953-0050-460b-9c38-38234e22b38c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:17.913624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-491fe953-0050-460b-9c38-38234e22b38c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:17.914704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-491fe953-0050-460b-9c38-38234e22b38c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:17.915125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-491fe953-0050-460b-9c38-38234e22b38c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:17.931869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:17.944769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-491fe953-0050-460b-9c38-38234e22b38c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045426 Aug 24 06:24:17.947274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 516/1038] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:18.855354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-04926350-6c4b-4a7e-924e-e4a3e60fecf7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:18.857479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-04926350-6c4b-4a7e-924e-e4a3e60fecf7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:18.863890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04926350-6c4b-4a7e-924e-e4a3e60fecf7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:18.864363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04926350-6c4b-4a7e-924e-e4a3e60fecf7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:18.864837 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04926350-6c4b-4a7e-924e-e4a3e60fecf7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:18.865520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04926350-6c4b-4a7e-924e-e4a3e60fecf7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:18.865969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04926350-6c4b-4a7e-924e-e4a3e60fecf7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:18.866387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-04926350-6c4b-4a7e-924e-e4a3e60fecf7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:18.891006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:18.895654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-04926350-6c4b-4a7e-924e-e4a3e60fecf7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Aug 24 06:24:18.896206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 523/1039] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:18.957621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b8af84fa-60d5-4415-9eee-bf1441218fbb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:18.959773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b8af84fa-60d5-4415-9eee-bf1441218fbb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:18.967153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8af84fa-60d5-4415-9eee-bf1441218fbb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:18.967653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8af84fa-60d5-4415-9eee-bf1441218fbb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:18.968076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8af84fa-60d5-4415-9eee-bf1441218fbb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:18.968777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8af84fa-60d5-4415-9eee-bf1441218fbb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:18.969221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8af84fa-60d5-4415-9eee-bf1441218fbb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:18.969634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8af84fa-60d5-4415-9eee-bf1441218fbb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:18.999348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b8af84fa-60d5-4415-9eee-bf1441218fbb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045595 Aug 24 06:24:18.999930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 517/1040] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:19.909107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f94efd26-9340-48d8-9f31-3cf615d81c73 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:19.911882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f94efd26-9340-48d8-9f31-3cf615d81c73 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:19.919362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f94efd26-9340-48d8-9f31-3cf615d81c73 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:19.919834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f94efd26-9340-48d8-9f31-3cf615d81c73 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:19.920263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f94efd26-9340-48d8-9f31-3cf615d81c73 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:19.920995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f94efd26-9340-48d8-9f31-3cf615d81c73 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:19.921444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f94efd26-9340-48d8-9f31-3cf615d81c73 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:19.921877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f94efd26-9340-48d8-9f31-3cf615d81c73 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:19.951454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f94efd26-9340-48d8-9f31-3cf615d81c73 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046358 Aug 24 06:24:19.952022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 524/1041] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:20.011581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a6b7715c-cd17-4361-a89d-dd48c0f36ea6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:20.013743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a6b7715c-cd17-4361-a89d-dd48c0f36ea6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:20.016043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=58 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:20.020639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6b7715c-cd17-4361-a89d-dd48c0f36ea6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:20.021211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6b7715c-cd17-4361-a89d-dd48c0f36ea6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:20.021638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6b7715c-cd17-4361-a89d-dd48c0f36ea6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:20.022320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6b7715c-cd17-4361-a89d-dd48c0f36ea6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:20.026380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6b7715c-cd17-4361-a89d-dd48c0f36ea6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:20.026380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6b7715c-cd17-4361-a89d-dd48c0f36ea6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:20.055617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a6b7715c-cd17-4361-a89d-dd48c0f36ea6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047837 Aug 24 06:24:20.056215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 518/1042] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:20 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:20.964306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-27b4fde7-bd97-4651-be44-0d43b5ba6891 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:20.966383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-27b4fde7-bd97-4651-be44-0d43b5ba6891 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:20.972890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27b4fde7-bd97-4651-be44-0d43b5ba6891 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:20.973367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27b4fde7-bd97-4651-be44-0d43b5ba6891 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:20.973800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27b4fde7-bd97-4651-be44-0d43b5ba6891 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:20.974486 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27b4fde7-bd97-4651-be44-0d43b5ba6891 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:20.974936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27b4fde7-bd97-4651-be44-0d43b5ba6891 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:20.975355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27b4fde7-bd97-4651-be44-0d43b5ba6891 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:21.004308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-27b4fde7-bd97-4651-be44-0d43b5ba6891 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 24 06:24:21.004890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 525/1043] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:21.067848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9f5e44c2-e08c-4b06-92ab-b38d9e75c750 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:21.069962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9f5e44c2-e08c-4b06-92ab-b38d9e75c750 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:21.076869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5e44c2-e08c-4b06-92ab-b38d9e75c750 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:21.077353 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5e44c2-e08c-4b06-92ab-b38d9e75c750 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:21.077785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5e44c2-e08c-4b06-92ab-b38d9e75c750 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:21.078474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5e44c2-e08c-4b06-92ab-b38d9e75c750 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:21.078924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5e44c2-e08c-4b06-92ab-b38d9e75c750 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:21.079342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5e44c2-e08c-4b06-92ab-b38d9e75c750 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:21.108259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9f5e44c2-e08c-4b06-92ab-b38d9e75c750 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044312 Aug 24 06:24:21.108837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 519/1044] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:22.017184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cff905d0-40fe-4a2e-a6b4-66b40437f666 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:22.019243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cff905d0-40fe-4a2e-a6b4-66b40437f666 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:22.025782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff905d0-40fe-4a2e-a6b4-66b40437f666 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:22.026262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff905d0-40fe-4a2e-a6b4-66b40437f666 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:22.027367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff905d0-40fe-4a2e-a6b4-66b40437f666 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:22.028069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff905d0-40fe-4a2e-a6b4-66b40437f666 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:22.028552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff905d0-40fe-4a2e-a6b4-66b40437f666 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:22.028982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cff905d0-40fe-4a2e-a6b4-66b40437f666 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:22.061796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cff905d0-40fe-4a2e-a6b4-66b40437f666 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045016 Aug 24 06:24:22.062425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 526/1045] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:22.119611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bc8c0ed1-5e3c-4f4a-baa0-2bc8b2d05f55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:22.121958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bc8c0ed1-5e3c-4f4a-baa0-2bc8b2d05f55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:22.128411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc8c0ed1-5e3c-4f4a-baa0-2bc8b2d05f55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:22.128924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc8c0ed1-5e3c-4f4a-baa0-2bc8b2d05f55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:22.129377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc8c0ed1-5e3c-4f4a-baa0-2bc8b2d05f55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:22.130058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc8c0ed1-5e3c-4f4a-baa0-2bc8b2d05f55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:22.130503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc8c0ed1-5e3c-4f4a-baa0-2bc8b2d05f55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:22.130921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc8c0ed1-5e3c-4f4a-baa0-2bc8b2d05f55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:22.160776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bc8c0ed1-5e3c-4f4a-baa0-2bc8b2d05f55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045084 Aug 24 06:24:22.161327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 520/1046] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:22 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:23.075163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f4ad619c-faf1-4be3-a12e-291d96db8120 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:23.077290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f4ad619c-faf1-4be3-a12e-291d96db8120 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:23.083721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4ad619c-faf1-4be3-a12e-291d96db8120 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:23.084194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4ad619c-faf1-4be3-a12e-291d96db8120 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:23.084655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4ad619c-faf1-4be3-a12e-291d96db8120 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:23.085337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4ad619c-faf1-4be3-a12e-291d96db8120 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:23.085776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4ad619c-faf1-4be3-a12e-291d96db8120 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:23.086189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4ad619c-faf1-4be3-a12e-291d96db8120 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:23.115878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f4ad619c-faf1-4be3-a12e-291d96db8120 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045706 Aug 24 06:24:23.116422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 527/1047] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:23 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:23.173559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ffdac8c0-4c69-4b51-8d71-4f0e97fd4fc9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:23.175657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ffdac8c0-4c69-4b51-8d71-4f0e97fd4fc9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:23.182311 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ffdac8c0-4c69-4b51-8d71-4f0e97fd4fc9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:23.182781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ffdac8c0-4c69-4b51-8d71-4f0e97fd4fc9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:23.183232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ffdac8c0-4c69-4b51-8d71-4f0e97fd4fc9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:23.183910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ffdac8c0-4c69-4b51-8d71-4f0e97fd4fc9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:23.184354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ffdac8c0-4c69-4b51-8d71-4f0e97fd4fc9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:23.184907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ffdac8c0-4c69-4b51-8d71-4f0e97fd4fc9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:23.212853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ffdac8c0-4c69-4b51-8d71-4f0e97fd4fc9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043176 Aug 24 06:24:23.213409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 521/1048] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:24.127243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ce7c60f5-7fec-440a-acf3-0fe0666eb9eb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:24.129380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ce7c60f5-7fec-440a-acf3-0fe0666eb9eb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:24.135778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce7c60f5-7fec-440a-acf3-0fe0666eb9eb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:24.136248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce7c60f5-7fec-440a-acf3-0fe0666eb9eb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:24.136775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce7c60f5-7fec-440a-acf3-0fe0666eb9eb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:24.137953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce7c60f5-7fec-440a-acf3-0fe0666eb9eb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:24.138399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce7c60f5-7fec-440a-acf3-0fe0666eb9eb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:24.138811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce7c60f5-7fec-440a-acf3-0fe0666eb9eb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:24.167562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ce7c60f5-7fec-440a-acf3-0fe0666eb9eb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Aug 24 06:24:24.168108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 528/1049] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:24.225714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8afe59d7-6979-4935-a0b1-729c6685cec7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:24.227825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8afe59d7-6979-4935-a0b1-729c6685cec7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:24.234294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8afe59d7-6979-4935-a0b1-729c6685cec7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:24.234774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8afe59d7-6979-4935-a0b1-729c6685cec7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:24.235204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8afe59d7-6979-4935-a0b1-729c6685cec7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:24.235878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8afe59d7-6979-4935-a0b1-729c6685cec7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:24.236327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8afe59d7-6979-4935-a0b1-729c6685cec7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:24.236769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8afe59d7-6979-4935-a0b1-729c6685cec7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:24.266350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8afe59d7-6979-4935-a0b1-729c6685cec7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044692 Aug 24 06:24:24.266937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 522/1050] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:25.180654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fddc0333-b68e-4fe7-aafe-dd9c30dcb097 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:25.182774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fddc0333-b68e-4fe7-aafe-dd9c30dcb097 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:25.189226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fddc0333-b68e-4fe7-aafe-dd9c30dcb097 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:25.189694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fddc0333-b68e-4fe7-aafe-dd9c30dcb097 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:25.190129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fddc0333-b68e-4fe7-aafe-dd9c30dcb097 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:25.190814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fddc0333-b68e-4fe7-aafe-dd9c30dcb097 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:25.191265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fddc0333-b68e-4fe7-aafe-dd9c30dcb097 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:25.191684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fddc0333-b68e-4fe7-aafe-dd9c30dcb097 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:25.220386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fddc0333-b68e-4fe7-aafe-dd9c30dcb097 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043953 Aug 24 06:24:25.220894 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 529/1051] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:25 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:25.279013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c6991e7f-0fc7-45d3-8382-23e3b855b818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:25.281195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c6991e7f-0fc7-45d3-8382-23e3b855b818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:25.287434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6991e7f-0fc7-45d3-8382-23e3b855b818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:25.287900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6991e7f-0fc7-45d3-8382-23e3b855b818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:25.288324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6991e7f-0fc7-45d3-8382-23e3b855b818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:25.289141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6991e7f-0fc7-45d3-8382-23e3b855b818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:25.289609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6991e7f-0fc7-45d3-8382-23e3b855b818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:25.290022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6991e7f-0fc7-45d3-8382-23e3b855b818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:25.319256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c6991e7f-0fc7-45d3-8382-23e3b855b818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044657 Aug 24 06:24:25.319797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 523/1052] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:26.232726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bec3e15b-0f2a-4507-9f00-ef403a343f32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:26.234781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bec3e15b-0f2a-4507-9f00-ef403a343f32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:26.241261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec3e15b-0f2a-4507-9f00-ef403a343f32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:26.241732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec3e15b-0f2a-4507-9f00-ef403a343f32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:26.242168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec3e15b-0f2a-4507-9f00-ef403a343f32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:26.242855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec3e15b-0f2a-4507-9f00-ef403a343f32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:26.243301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec3e15b-0f2a-4507-9f00-ef403a343f32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:26.243720 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec3e15b-0f2a-4507-9f00-ef403a343f32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:26.273927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bec3e15b-0f2a-4507-9f00-ef403a343f32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045257 Aug 24 06:24:26.274488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 530/1053] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:26.331379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e084c52e-9b59-4126-92cf-02394b80f4b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:26.333491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e084c52e-9b59-4126-92cf-02394b80f4b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:26.339874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e084c52e-9b59-4126-92cf-02394b80f4b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:26.340342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e084c52e-9b59-4126-92cf-02394b80f4b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:26.340812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e084c52e-9b59-4126-92cf-02394b80f4b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:26.341481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e084c52e-9b59-4126-92cf-02394b80f4b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:26.341920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e084c52e-9b59-4126-92cf-02394b80f4b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:26.342386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e084c52e-9b59-4126-92cf-02394b80f4b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:26.371971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e084c52e-9b59-4126-92cf-02394b80f4b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044132 Aug 24 06:24:26.372527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 524/1054] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:27.285806 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2f0fe558-2ec5-4b53-97f9-206fac646644 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:27.287859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2f0fe558-2ec5-4b53-97f9-206fac646644 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:27.294368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f0fe558-2ec5-4b53-97f9-206fac646644 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:27.295160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f0fe558-2ec5-4b53-97f9-206fac646644 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:27.295317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f0fe558-2ec5-4b53-97f9-206fac646644 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:27.296011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f0fe558-2ec5-4b53-97f9-206fac646644 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:27.296509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f0fe558-2ec5-4b53-97f9-206fac646644 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:27.296928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f0fe558-2ec5-4b53-97f9-206fac646644 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:27.326547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2f0fe558-2ec5-4b53-97f9-206fac646644 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Aug 24 06:24:27.327092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 531/1055] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:27.383430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1840c9c3-d4ff-4c87-8b6b-7886d2428658 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:27.385578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1840c9c3-d4ff-4c87-8b6b-7886d2428658 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:27.392688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1840c9c3-d4ff-4c87-8b6b-7886d2428658 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:27.393156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1840c9c3-d4ff-4c87-8b6b-7886d2428658 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:27.393578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1840c9c3-d4ff-4c87-8b6b-7886d2428658 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:27.394300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1840c9c3-d4ff-4c87-8b6b-7886d2428658 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:27.394742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1840c9c3-d4ff-4c87-8b6b-7886d2428658 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:27.395180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1840c9c3-d4ff-4c87-8b6b-7886d2428658 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:27.423184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1840c9c3-d4ff-4c87-8b6b-7886d2428658 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043810 Aug 24 06:24:27.423732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 525/1056] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:28.338876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8e27d75f-8b2f-4b0b-8cc2-e925422391fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:28.341450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8e27d75f-8b2f-4b0b-8cc2-e925422391fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:28.347880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e27d75f-8b2f-4b0b-8cc2-e925422391fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:28.348355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e27d75f-8b2f-4b0b-8cc2-e925422391fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:28.348815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e27d75f-8b2f-4b0b-8cc2-e925422391fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:28.349500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e27d75f-8b2f-4b0b-8cc2-e925422391fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:28.349942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e27d75f-8b2f-4b0b-8cc2-e925422391fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:28.350353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e27d75f-8b2f-4b0b-8cc2-e925422391fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:28.378950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8e27d75f-8b2f-4b0b-8cc2-e925422391fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Aug 24 06:24:28.379489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 532/1057] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:28 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:28.435089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b13e6356-0a1b-4091-8ee3-b6b682515ecf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:28.437320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b13e6356-0a1b-4091-8ee3-b6b682515ecf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:28.443613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b13e6356-0a1b-4091-8ee3-b6b682515ecf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:28.444118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b13e6356-0a1b-4091-8ee3-b6b682515ecf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:28.444569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b13e6356-0a1b-4091-8ee3-b6b682515ecf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:28.445248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b13e6356-0a1b-4091-8ee3-b6b682515ecf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:28.445696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b13e6356-0a1b-4091-8ee3-b6b682515ecf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:28.446150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b13e6356-0a1b-4091-8ee3-b6b682515ecf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:28.475491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b13e6356-0a1b-4091-8ee3-b6b682515ecf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044432 Aug 24 06:24:28.476069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 526/1058] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:28 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:29.391285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3017861d-7820-4829-92b9-6836952e5971 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:29.393716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3017861d-7820-4829-92b9-6836952e5971 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:29.400175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3017861d-7820-4829-92b9-6836952e5971 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:29.400689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3017861d-7820-4829-92b9-6836952e5971 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:29.401116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3017861d-7820-4829-92b9-6836952e5971 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:29.401797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3017861d-7820-4829-92b9-6836952e5971 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:29.402243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3017861d-7820-4829-92b9-6836952e5971 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:29.402659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3017861d-7820-4829-92b9-6836952e5971 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:29.432157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3017861d-7820-4829-92b9-6836952e5971 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Aug 24 06:24:29.432741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 533/1059] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:29.488549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e12edf29-7f1b-4302-8144-458aa60134e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:29.490681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e12edf29-7f1b-4302-8144-458aa60134e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:29.497744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12edf29-7f1b-4302-8144-458aa60134e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:29.498206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12edf29-7f1b-4302-8144-458aa60134e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:29.498625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12edf29-7f1b-4302-8144-458aa60134e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:29.499297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12edf29-7f1b-4302-8144-458aa60134e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:29.499745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12edf29-7f1b-4302-8144-458aa60134e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:29.500153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12edf29-7f1b-4302-8144-458aa60134e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:29.528402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e12edf29-7f1b-4302-8144-458aa60134e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044016 Aug 24 06:24:29.528974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 527/1060] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:29 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:30.445235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-286920dd-c365-483b-b9c9-465505360768 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:30.447290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-286920dd-c365-483b-b9c9-465505360768 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:30.455137 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-286920dd-c365-483b-b9c9-465505360768 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:30.455640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-286920dd-c365-483b-b9c9-465505360768 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:30.456070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-286920dd-c365-483b-b9c9-465505360768 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:30.456782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-286920dd-c365-483b-b9c9-465505360768 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:30.457227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-286920dd-c365-483b-b9c9-465505360768 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:30.457642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-286920dd-c365-483b-b9c9-465505360768 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:30.485932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-286920dd-c365-483b-b9c9-465505360768 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 Aug 24 06:24:30.486476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 534/1061] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:30.541664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1eb4e16e-31df-4200-8424-ee6c52d28ad2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:30.543844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1eb4e16e-31df-4200-8424-ee6c52d28ad2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:30.550286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1eb4e16e-31df-4200-8424-ee6c52d28ad2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:30.550754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1eb4e16e-31df-4200-8424-ee6c52d28ad2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:30.551177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1eb4e16e-31df-4200-8424-ee6c52d28ad2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:30.551856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1eb4e16e-31df-4200-8424-ee6c52d28ad2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:30.552294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1eb4e16e-31df-4200-8424-ee6c52d28ad2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:30.552729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1eb4e16e-31df-4200-8424-ee6c52d28ad2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:30.582010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1eb4e16e-31df-4200-8424-ee6c52d28ad2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045328 Aug 24 06:24:30.582564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 528/1062] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:31.498177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2f2b0043-379c-4db3-a747-70fbb9a8f3de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:31.500236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2f2b0043-379c-4db3-a747-70fbb9a8f3de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:31.506695 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f2b0043-379c-4db3-a747-70fbb9a8f3de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:31.507172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f2b0043-379c-4db3-a747-70fbb9a8f3de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:31.507606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f2b0043-379c-4db3-a747-70fbb9a8f3de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:31.508284 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f2b0043-379c-4db3-a747-70fbb9a8f3de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:31.508764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f2b0043-379c-4db3-a747-70fbb9a8f3de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:31.509187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f2b0043-379c-4db3-a747-70fbb9a8f3de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:31.538939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2f2b0043-379c-4db3-a747-70fbb9a8f3de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044776 Aug 24 06:24:31.539487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 535/1063] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:31 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:31.595432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c8b8cbb1-0aba-4ff3-a2fa-100dd8bad744 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:31.597599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c8b8cbb1-0aba-4ff3-a2fa-100dd8bad744 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:31.603997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8b8cbb1-0aba-4ff3-a2fa-100dd8bad744 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:31.604468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8b8cbb1-0aba-4ff3-a2fa-100dd8bad744 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:31.604924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8b8cbb1-0aba-4ff3-a2fa-100dd8bad744 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:31.605606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8b8cbb1-0aba-4ff3-a2fa-100dd8bad744 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:31.606049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8b8cbb1-0aba-4ff3-a2fa-100dd8bad744 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:31.606462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8b8cbb1-0aba-4ff3-a2fa-100dd8bad744 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:31.635365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c8b8cbb1-0aba-4ff3-a2fa-100dd8bad744 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045060 Aug 24 06:24:31.635920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 529/1064] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:32.551891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-444bc4a1-5112-4845-a467-a6ad56d1866e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:32.554079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-444bc4a1-5112-4845-a467-a6ad56d1866e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:32.561458 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-444bc4a1-5112-4845-a467-a6ad56d1866e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:32.561932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-444bc4a1-5112-4845-a467-a6ad56d1866e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:32.562362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-444bc4a1-5112-4845-a467-a6ad56d1866e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:32.563036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-444bc4a1-5112-4845-a467-a6ad56d1866e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:32.563496 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-444bc4a1-5112-4845-a467-a6ad56d1866e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:32.563888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-444bc4a1-5112-4845-a467-a6ad56d1866e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:32.593174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-444bc4a1-5112-4845-a467-a6ad56d1866e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Aug 24 06:24:32.593741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 536/1065] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:32.649061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-016b86bd-afd1-4fe8-9726-31bc9a06c2bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:32.651636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-016b86bd-afd1-4fe8-9726-31bc9a06c2bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:32.658906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-016b86bd-afd1-4fe8-9726-31bc9a06c2bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:32.659392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-016b86bd-afd1-4fe8-9726-31bc9a06c2bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:32.659829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-016b86bd-afd1-4fe8-9726-31bc9a06c2bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:32.660593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-016b86bd-afd1-4fe8-9726-31bc9a06c2bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:32.661050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-016b86bd-afd1-4fe8-9726-31bc9a06c2bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:32.661449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-016b86bd-afd1-4fe8-9726-31bc9a06c2bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:32.692792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-016b86bd-afd1-4fe8-9726-31bc9a06c2bb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048005 Aug 24 06:24:32.693357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 530/1066] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:33.605737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e70a8fbd-8eaa-4aa8-b2cf-ff25c19c9fce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:33.608379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e70a8fbd-8eaa-4aa8-b2cf-ff25c19c9fce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:33.614744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e70a8fbd-8eaa-4aa8-b2cf-ff25c19c9fce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:33.615214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e70a8fbd-8eaa-4aa8-b2cf-ff25c19c9fce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:33.615642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e70a8fbd-8eaa-4aa8-b2cf-ff25c19c9fce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:33.616318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e70a8fbd-8eaa-4aa8-b2cf-ff25c19c9fce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:33.616785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e70a8fbd-8eaa-4aa8-b2cf-ff25c19c9fce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:33.617202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e70a8fbd-8eaa-4aa8-b2cf-ff25c19c9fce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:33.645749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e70a8fbd-8eaa-4aa8-b2cf-ff25c19c9fce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Aug 24 06:24:33.646304 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 537/1067] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:33.705912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f7675f92-fd58-4470-ab7d-174415d34010 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:33.708216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f7675f92-fd58-4470-ab7d-174415d34010 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:33.714753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7675f92-fd58-4470-ab7d-174415d34010 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:33.718450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7675f92-fd58-4470-ab7d-174415d34010 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:33.718450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7675f92-fd58-4470-ab7d-174415d34010 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:33.718450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7675f92-fd58-4470-ab7d-174415d34010 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:33.718450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7675f92-fd58-4470-ab7d-174415d34010 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:33.718849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7675f92-fd58-4470-ab7d-174415d34010 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:33.746856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f7675f92-fd58-4470-ab7d-174415d34010 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045744 Aug 24 06:24:33.747419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 531/1068] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:34.658819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f52d55e6-395b-40cb-b8fa-8c991e1511ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:34.660990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f52d55e6-395b-40cb-b8fa-8c991e1511ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:34.667509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f52d55e6-395b-40cb-b8fa-8c991e1511ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:34.668048 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f52d55e6-395b-40cb-b8fa-8c991e1511ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:34.668483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f52d55e6-395b-40cb-b8fa-8c991e1511ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:34.669202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f52d55e6-395b-40cb-b8fa-8c991e1511ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:34.669652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f52d55e6-395b-40cb-b8fa-8c991e1511ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:34.670096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f52d55e6-395b-40cb-b8fa-8c991e1511ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:34.700217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f52d55e6-395b-40cb-b8fa-8c991e1511ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046019 Aug 24 06:24:34.700824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 538/1069] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:34 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:34.759074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e2ab1cf6-0527-4c3a-8b8e-10bfe228e3fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:34.761332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e2ab1cf6-0527-4c3a-8b8e-10bfe228e3fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:34.768576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2ab1cf6-0527-4c3a-8b8e-10bfe228e3fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:34.769054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2ab1cf6-0527-4c3a-8b8e-10bfe228e3fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:34.769474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2ab1cf6-0527-4c3a-8b8e-10bfe228e3fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:34.770165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2ab1cf6-0527-4c3a-8b8e-10bfe228e3fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:34.770605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2ab1cf6-0527-4c3a-8b8e-10bfe228e3fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:34.771021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2ab1cf6-0527-4c3a-8b8e-10bfe228e3fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:34.802176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e2ab1cf6-0527-4c3a-8b8e-10bfe228e3fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046963 Aug 24 06:24:34.803349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 532/1070] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:34 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:35.713087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6a9367b6-7453-4f5f-99f6-e635eeffbaf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:35.715197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6a9367b6-7453-4f5f-99f6-e635eeffbaf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:35.721670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a9367b6-7453-4f5f-99f6-e635eeffbaf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:35.722144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a9367b6-7453-4f5f-99f6-e635eeffbaf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:35.722576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a9367b6-7453-4f5f-99f6-e635eeffbaf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:35.723279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a9367b6-7453-4f5f-99f6-e635eeffbaf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:35.723722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a9367b6-7453-4f5f-99f6-e635eeffbaf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:35.724138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a9367b6-7453-4f5f-99f6-e635eeffbaf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:35.753216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6a9367b6-7453-4f5f-99f6-e635eeffbaf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Aug 24 06:24:35.753774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 539/1071] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:35.814917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-96cac3aa-fb71-4afc-bd17-50eee73082c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:35.817222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-96cac3aa-fb71-4afc-bd17-50eee73082c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:35.823644 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96cac3aa-fb71-4afc-bd17-50eee73082c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:35.824118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96cac3aa-fb71-4afc-bd17-50eee73082c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:35.824573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96cac3aa-fb71-4afc-bd17-50eee73082c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:35.825261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96cac3aa-fb71-4afc-bd17-50eee73082c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:35.825707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96cac3aa-fb71-4afc-bd17-50eee73082c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:35.826122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96cac3aa-fb71-4afc-bd17-50eee73082c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:35.830531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:35.856061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-96cac3aa-fb71-4afc-bd17-50eee73082c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045698 Aug 24 06:24:35.856641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 533/1072] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:36.765602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-85db4e46-474c-4030-ab85-1e3c6bd857aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:36.767664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-85db4e46-474c-4030-ab85-1e3c6bd857aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:36.774064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85db4e46-474c-4030-ab85-1e3c6bd857aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:36.774538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85db4e46-474c-4030-ab85-1e3c6bd857aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:36.774969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85db4e46-474c-4030-ab85-1e3c6bd857aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:36.775649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85db4e46-474c-4030-ab85-1e3c6bd857aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:36.776093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85db4e46-474c-4030-ab85-1e3c6bd857aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:36.776560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85db4e46-474c-4030-ab85-1e3c6bd857aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:36.792639 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:36.805862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-85db4e46-474c-4030-ab85-1e3c6bd857aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044058 Aug 24 06:24:36.806405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 540/1073] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:36 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:36.867709 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3b9f1366-f0f3-477e-8241-584adb45bcdb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:36.869890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3b9f1366-f0f3-477e-8241-584adb45bcdb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:36.877282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b9f1366-f0f3-477e-8241-584adb45bcdb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:36.877755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b9f1366-f0f3-477e-8241-584adb45bcdb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:36.878184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b9f1366-f0f3-477e-8241-584adb45bcdb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:36.878866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b9f1366-f0f3-477e-8241-584adb45bcdb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:36.879318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b9f1366-f0f3-477e-8241-584adb45bcdb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:36.879735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b9f1366-f0f3-477e-8241-584adb45bcdb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:36.908179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3b9f1366-f0f3-477e-8241-584adb45bcdb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044413 Aug 24 06:24:36.908776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 534/1074] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:37.818329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-31217c9d-3a82-4e7f-a0f0-f584441d1879 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:37.820262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-31217c9d-3a82-4e7f-a0f0-f584441d1879 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:37.826703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31217c9d-3a82-4e7f-a0f0-f584441d1879 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:37.827180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31217c9d-3a82-4e7f-a0f0-f584441d1879 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:37.827611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31217c9d-3a82-4e7f-a0f0-f584441d1879 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:37.828365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31217c9d-3a82-4e7f-a0f0-f584441d1879 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:37.828839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31217c9d-3a82-4e7f-a0f0-f584441d1879 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:37.831834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31217c9d-3a82-4e7f-a0f0-f584441d1879 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:37.858286 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-31217c9d-3a82-4e7f-a0f0-f584441d1879 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Aug 24 06:24:37.858834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 541/1075] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:37.920555 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4ba2bdb3-713d-4c1d-becd-90e85f30fe4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:37.922689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4ba2bdb3-713d-4c1d-becd-90e85f30fe4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:37.929317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ba2bdb3-713d-4c1d-becd-90e85f30fe4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:37.929794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ba2bdb3-713d-4c1d-becd-90e85f30fe4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:37.930226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ba2bdb3-713d-4c1d-becd-90e85f30fe4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:37.931169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ba2bdb3-713d-4c1d-becd-90e85f30fe4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:37.931615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ba2bdb3-713d-4c1d-becd-90e85f30fe4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:37.932033 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ba2bdb3-713d-4c1d-becd-90e85f30fe4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:37.961559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4ba2bdb3-713d-4c1d-becd-90e85f30fe4d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045164 Aug 24 06:24:37.962104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 535/1076] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:38.870495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e8301136-4790-44a1-b149-25f72fbdb603 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:38.872612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e8301136-4790-44a1-b149-25f72fbdb603 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:38.879536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8301136-4790-44a1-b149-25f72fbdb603 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:38.880015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8301136-4790-44a1-b149-25f72fbdb603 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:38.880448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8301136-4790-44a1-b149-25f72fbdb603 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:38.881420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8301136-4790-44a1-b149-25f72fbdb603 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:38.881898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8301136-4790-44a1-b149-25f72fbdb603 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:38.882321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8301136-4790-44a1-b149-25f72fbdb603 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:38.914870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e8301136-4790-44a1-b149-25f72fbdb603 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048345 Aug 24 06:24:38.915428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 542/1077] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:38 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:38.973787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b2ddd0ba-0dd2-4c1e-b433-9a921a36d214 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:38.975864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b2ddd0ba-0dd2-4c1e-b433-9a921a36d214 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:38.982157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b2ddd0ba-0dd2-4c1e-b433-9a921a36d214 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:38.982625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b2ddd0ba-0dd2-4c1e-b433-9a921a36d214 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:38.983049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b2ddd0ba-0dd2-4c1e-b433-9a921a36d214 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:38.983721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b2ddd0ba-0dd2-4c1e-b433-9a921a36d214 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:38.984160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b2ddd0ba-0dd2-4c1e-b433-9a921a36d214 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:38.984670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b2ddd0ba-0dd2-4c1e-b433-9a921a36d214 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:39.013731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b2ddd0ba-0dd2-4c1e-b433-9a921a36d214 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043894 Aug 24 06:24:39.014276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 536/1078] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:39.927116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c5b4a012-0057-406f-92df-22a6fbc9145c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:39.929209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c5b4a012-0057-406f-92df-22a6fbc9145c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:39.931734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=60 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:39.936376 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c5b4a012-0057-406f-92df-22a6fbc9145c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:39.936883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c5b4a012-0057-406f-92df-22a6fbc9145c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:39.937316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c5b4a012-0057-406f-92df-22a6fbc9145c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:39.938000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c5b4a012-0057-406f-92df-22a6fbc9145c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:39.940052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c5b4a012-0057-406f-92df-22a6fbc9145c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:39.940052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c5b4a012-0057-406f-92df-22a6fbc9145c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:39.968462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c5b4a012-0057-406f-92df-22a6fbc9145c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045418 Aug 24 06:24:39.969025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 543/1079] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:39 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:40.025731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-09c7050c-a4e0-424d-a27e-232abf550531 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:40.027915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-09c7050c-a4e0-424d-a27e-232abf550531 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:40.034291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09c7050c-a4e0-424d-a27e-232abf550531 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:40.034765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09c7050c-a4e0-424d-a27e-232abf550531 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:40.035190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09c7050c-a4e0-424d-a27e-232abf550531 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:40.035864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09c7050c-a4e0-424d-a27e-232abf550531 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:40.036304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09c7050c-a4e0-424d-a27e-232abf550531 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:40.036743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09c7050c-a4e0-424d-a27e-232abf550531 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:40.065360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-09c7050c-a4e0-424d-a27e-232abf550531 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043020 Aug 24 06:24:40.065906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 537/1080] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:40.981279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5d22a3cf-3026-45d4-8173-9a108b6c5a9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:40.983340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5d22a3cf-3026-45d4-8173-9a108b6c5a9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:40.990332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d22a3cf-3026-45d4-8173-9a108b6c5a9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:40.990809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d22a3cf-3026-45d4-8173-9a108b6c5a9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:40.991237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d22a3cf-3026-45d4-8173-9a108b6c5a9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:40.991935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d22a3cf-3026-45d4-8173-9a108b6c5a9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:40.992365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d22a3cf-3026-45d4-8173-9a108b6c5a9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:40.992810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d22a3cf-3026-45d4-8173-9a108b6c5a9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:41.022391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5d22a3cf-3026-45d4-8173-9a108b6c5a9b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045097 Aug 24 06:24:41.023013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 544/1081] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:40 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:41.077501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d554b33c-e2a1-40f6-8469-f0e54b48086f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:41.079639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d554b33c-e2a1-40f6-8469-f0e54b48086f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:41.086000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d554b33c-e2a1-40f6-8469-f0e54b48086f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:41.086467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d554b33c-e2a1-40f6-8469-f0e54b48086f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:41.086891 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d554b33c-e2a1-40f6-8469-f0e54b48086f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:41.087565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d554b33c-e2a1-40f6-8469-f0e54b48086f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:41.088004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d554b33c-e2a1-40f6-8469-f0e54b48086f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:41.088419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d554b33c-e2a1-40f6-8469-f0e54b48086f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:41.123341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d554b33c-e2a1-40f6-8469-f0e54b48086f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049779 Aug 24 06:24:41.123907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 538/1082] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:41 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:42.035002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-be411af1-3c87-4422-9c98-f70f20371373 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:42.037099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-be411af1-3c87-4422-9c98-f70f20371373 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:42.043614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be411af1-3c87-4422-9c98-f70f20371373 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:42.044094 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be411af1-3c87-4422-9c98-f70f20371373 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:42.044558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be411af1-3c87-4422-9c98-f70f20371373 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:42.045270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be411af1-3c87-4422-9c98-f70f20371373 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:42.045744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be411af1-3c87-4422-9c98-f70f20371373 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:42.046172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be411af1-3c87-4422-9c98-f70f20371373 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:42.074853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-be411af1-3c87-4422-9c98-f70f20371373 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044647 Aug 24 06:24:42.075402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 545/1083] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:42 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:42.135604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4519f043-78b1-4ec4-9ba2-5804b57095f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:42.137752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4519f043-78b1-4ec4-9ba2-5804b57095f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:42.144641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4519f043-78b1-4ec4-9ba2-5804b57095f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:42.145118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4519f043-78b1-4ec4-9ba2-5804b57095f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:42.145549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4519f043-78b1-4ec4-9ba2-5804b57095f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:42.146233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4519f043-78b1-4ec4-9ba2-5804b57095f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:42.146682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4519f043-78b1-4ec4-9ba2-5804b57095f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:42.147100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4519f043-78b1-4ec4-9ba2-5804b57095f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:42.176152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4519f043-78b1-4ec4-9ba2-5804b57095f9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044493 Aug 24 06:24:42.176746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 539/1084] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:43.087026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cd66a022-a217-4bdb-a2d2-15d1e2de6d5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:43.089215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cd66a022-a217-4bdb-a2d2-15d1e2de6d5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:43.095559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd66a022-a217-4bdb-a2d2-15d1e2de6d5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:43.096559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd66a022-a217-4bdb-a2d2-15d1e2de6d5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:43.096998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd66a022-a217-4bdb-a2d2-15d1e2de6d5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:43.097719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd66a022-a217-4bdb-a2d2-15d1e2de6d5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:43.098173 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd66a022-a217-4bdb-a2d2-15d1e2de6d5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:43.098661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd66a022-a217-4bdb-a2d2-15d1e2de6d5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:43.127309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cd66a022-a217-4bdb-a2d2-15d1e2de6d5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Aug 24 06:24:43.127854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 546/1085] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:43 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:43.188752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6abd794a-c9a1-40a7-a6f1-dbc6b3f809d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:43.190856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6abd794a-c9a1-40a7-a6f1-dbc6b3f809d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:43.197295 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6abd794a-c9a1-40a7-a6f1-dbc6b3f809d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:43.197774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6abd794a-c9a1-40a7-a6f1-dbc6b3f809d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:43.198204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6abd794a-c9a1-40a7-a6f1-dbc6b3f809d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:43.198886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6abd794a-c9a1-40a7-a6f1-dbc6b3f809d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:43.199365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6abd794a-c9a1-40a7-a6f1-dbc6b3f809d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:43.199785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6abd794a-c9a1-40a7-a6f1-dbc6b3f809d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:43.228710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6abd794a-c9a1-40a7-a6f1-dbc6b3f809d1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043949 Aug 24 06:24:43.229322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 540/1086] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:44.139495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-acac944b-cbbf-48a2-bf60-d74025abe50e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:44.141681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-acac944b-cbbf-48a2-bf60-d74025abe50e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:44.148057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acac944b-cbbf-48a2-bf60-d74025abe50e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:44.148552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acac944b-cbbf-48a2-bf60-d74025abe50e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:44.148988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acac944b-cbbf-48a2-bf60-d74025abe50e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:44.149668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acac944b-cbbf-48a2-bf60-d74025abe50e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:44.150115 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acac944b-cbbf-48a2-bf60-d74025abe50e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:44.150532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acac944b-cbbf-48a2-bf60-d74025abe50e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:44.179466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-acac944b-cbbf-48a2-bf60-d74025abe50e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Aug 24 06:24:44.179942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 547/1087] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:44 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:44.241391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8551b6ec-8846-42d3-84b1-0dd5062a8bbe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:44.243505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8551b6ec-8846-42d3-84b1-0dd5062a8bbe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:44.249880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8551b6ec-8846-42d3-84b1-0dd5062a8bbe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:44.250348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8551b6ec-8846-42d3-84b1-0dd5062a8bbe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:44.250768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8551b6ec-8846-42d3-84b1-0dd5062a8bbe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:44.251436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8551b6ec-8846-42d3-84b1-0dd5062a8bbe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:44.251877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8551b6ec-8846-42d3-84b1-0dd5062a8bbe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:44.252940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8551b6ec-8846-42d3-84b1-0dd5062a8bbe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:44.281530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8551b6ec-8846-42d3-84b1-0dd5062a8bbe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044021 Aug 24 06:24:44.282086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 541/1088] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:45.191893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-80439933-768b-457e-8fcd-9d39aaede11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:45.194098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-80439933-768b-457e-8fcd-9d39aaede11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:45.200530 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80439933-768b-457e-8fcd-9d39aaede11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:45.201016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80439933-768b-457e-8fcd-9d39aaede11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:45.201450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80439933-768b-457e-8fcd-9d39aaede11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:45.202137 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80439933-768b-457e-8fcd-9d39aaede11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:45.202583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80439933-768b-457e-8fcd-9d39aaede11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:45.203001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80439933-768b-457e-8fcd-9d39aaede11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:45.232875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-80439933-768b-457e-8fcd-9d39aaede11a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Aug 24 06:24:45.233463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 548/1089] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:45 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:45.293812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6fa7bf2e-ee2b-4119-b884-e12cc903f5cc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:45.296058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6fa7bf2e-ee2b-4119-b884-e12cc903f5cc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:45.302471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa7bf2e-ee2b-4119-b884-e12cc903f5cc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:45.302947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa7bf2e-ee2b-4119-b884-e12cc903f5cc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:45.303372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa7bf2e-ee2b-4119-b884-e12cc903f5cc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:45.304107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa7bf2e-ee2b-4119-b884-e12cc903f5cc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:45.304581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa7bf2e-ee2b-4119-b884-e12cc903f5cc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:45.305002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fa7bf2e-ee2b-4119-b884-e12cc903f5cc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:45.334583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6fa7bf2e-ee2b-4119-b884-e12cc903f5cc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044803 Aug 24 06:24:45.335164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 542/1090] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:46.245177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2394a914-f0a1-463a-8054-fcb1ff452d08 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:46.247350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2394a914-f0a1-463a-8054-fcb1ff452d08 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:46.253773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2394a914-f0a1-463a-8054-fcb1ff452d08 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:46.254255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2394a914-f0a1-463a-8054-fcb1ff452d08 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:46.254690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2394a914-f0a1-463a-8054-fcb1ff452d08 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:46.255380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2394a914-f0a1-463a-8054-fcb1ff452d08 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:46.255858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2394a914-f0a1-463a-8054-fcb1ff452d08 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:46.256285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2394a914-f0a1-463a-8054-fcb1ff452d08 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:46.285822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2394a914-f0a1-463a-8054-fcb1ff452d08 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044513 Aug 24 06:24:46.286289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 549/1091] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:46.347226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fcb98464-e0ec-4b62-9e3c-fe6c3cad5d04 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:46.349399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fcb98464-e0ec-4b62-9e3c-fe6c3cad5d04 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:46.355783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcb98464-e0ec-4b62-9e3c-fe6c3cad5d04 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:46.356258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcb98464-e0ec-4b62-9e3c-fe6c3cad5d04 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:46.356725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcb98464-e0ec-4b62-9e3c-fe6c3cad5d04 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:46.357410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcb98464-e0ec-4b62-9e3c-fe6c3cad5d04 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:46.357861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcb98464-e0ec-4b62-9e3c-fe6c3cad5d04 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:46.358278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcb98464-e0ec-4b62-9e3c-fe6c3cad5d04 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:46.387535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fcb98464-e0ec-4b62-9e3c-fe6c3cad5d04 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044801 Aug 24 06:24:46.388089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 543/1092] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:47.298464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-23a2586f-843a-49fd-9c41-c1c9beb3d913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:47.301142 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-23a2586f-843a-49fd-9c41-c1c9beb3d913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:47.307765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-23a2586f-843a-49fd-9c41-c1c9beb3d913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:47.308246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-23a2586f-843a-49fd-9c41-c1c9beb3d913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:47.308706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-23a2586f-843a-49fd-9c41-c1c9beb3d913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:47.309402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-23a2586f-843a-49fd-9c41-c1c9beb3d913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:47.309846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-23a2586f-843a-49fd-9c41-c1c9beb3d913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:47.310261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-23a2586f-843a-49fd-9c41-c1c9beb3d913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:47.340131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-23a2586f-843a-49fd-9c41-c1c9beb3d913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045763 Aug 24 06:24:47.340623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 550/1093] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:47.399409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c6632e36-1ed5-4bf4-97e7-c416322e9fcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:47.401452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c6632e36-1ed5-4bf4-97e7-c416322e9fcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:47.407883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6632e36-1ed5-4bf4-97e7-c416322e9fcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:47.408339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6632e36-1ed5-4bf4-97e7-c416322e9fcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:47.408804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6632e36-1ed5-4bf4-97e7-c416322e9fcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:47.409479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6632e36-1ed5-4bf4-97e7-c416322e9fcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:47.409921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6632e36-1ed5-4bf4-97e7-c416322e9fcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:47.410338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6632e36-1ed5-4bf4-97e7-c416322e9fcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:47.440765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c6632e36-1ed5-4bf4-97e7-c416322e9fcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045338 Aug 24 06:24:47.441319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 544/1094] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:48.351820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-32e75710-70db-4a9f-a3aa-da570dafb679 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:48.353977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-32e75710-70db-4a9f-a3aa-da570dafb679 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:48.360382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e75710-70db-4a9f-a3aa-da570dafb679 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:48.360953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e75710-70db-4a9f-a3aa-da570dafb679 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:48.361382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e75710-70db-4a9f-a3aa-da570dafb679 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:48.362057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e75710-70db-4a9f-a3aa-da570dafb679 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:48.362501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e75710-70db-4a9f-a3aa-da570dafb679 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:48.362915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e75710-70db-4a9f-a3aa-da570dafb679 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:48.391641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-32e75710-70db-4a9f-a3aa-da570dafb679 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043581 Aug 24 06:24:48.392064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 551/1095] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:48.453235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c255d420-c80c-4fcc-b653-9acb8ebc1113 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:48.456084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c255d420-c80c-4fcc-b653-9acb8ebc1113 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:48.462681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c255d420-c80c-4fcc-b653-9acb8ebc1113 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:48.463153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c255d420-c80c-4fcc-b653-9acb8ebc1113 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:48.463578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c255d420-c80c-4fcc-b653-9acb8ebc1113 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:48.464309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c255d420-c80c-4fcc-b653-9acb8ebc1113 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:48.464887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c255d420-c80c-4fcc-b653-9acb8ebc1113 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:48.465306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c255d420-c80c-4fcc-b653-9acb8ebc1113 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:48.494274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c255d420-c80c-4fcc-b653-9acb8ebc1113 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045071 Aug 24 06:24:48.494840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 545/1096] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:49.404223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-28a83875-11dd-43f4-b637-d8047b861f8e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:49.406484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-28a83875-11dd-43f4-b637-d8047b861f8e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:49.412973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a83875-11dd-43f4-b637-d8047b861f8e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:49.413444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a83875-11dd-43f4-b637-d8047b861f8e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:49.413869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a83875-11dd-43f4-b637-d8047b861f8e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:49.414551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a83875-11dd-43f4-b637-d8047b861f8e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:49.414991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a83875-11dd-43f4-b637-d8047b861f8e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:49.415404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a83875-11dd-43f4-b637-d8047b861f8e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:49.445746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-28a83875-11dd-43f4-b637-d8047b861f8e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045455 Aug 24 06:24:49.446296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 552/1097] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:49 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:49.506801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f9d9df2f-efcf-49fa-810f-61ed983d0ea9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:49.508963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f9d9df2f-efcf-49fa-810f-61ed983d0ea9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:49.515307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9d9df2f-efcf-49fa-810f-61ed983d0ea9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:49.515781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9d9df2f-efcf-49fa-810f-61ed983d0ea9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:49.516212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9d9df2f-efcf-49fa-810f-61ed983d0ea9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:49.516988 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9d9df2f-efcf-49fa-810f-61ed983d0ea9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:49.517436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9d9df2f-efcf-49fa-810f-61ed983d0ea9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:49.517852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9d9df2f-efcf-49fa-810f-61ed983d0ea9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:49.546190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f9d9df2f-efcf-49fa-810f-61ed983d0ea9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043900 Aug 24 06:24:49.546672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 546/1098] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:50.458214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-842d7236-9371-4308-9e64-c01e0dea9eb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:50.460420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-842d7236-9371-4308-9e64-c01e0dea9eb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:50.467253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-842d7236-9371-4308-9e64-c01e0dea9eb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:50.467723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-842d7236-9371-4308-9e64-c01e0dea9eb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:50.468147 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-842d7236-9371-4308-9e64-c01e0dea9eb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:50.468858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-842d7236-9371-4308-9e64-c01e0dea9eb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:50.469298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-842d7236-9371-4308-9e64-c01e0dea9eb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:50.469715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-842d7236-9371-4308-9e64-c01e0dea9eb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:50.499034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-842d7236-9371-4308-9e64-c01e0dea9eb4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045093 Aug 24 06:24:50.499512 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 553/1099] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:50.560034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-317438c8-46c3-4110-9a58-13a5e8d9974f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:50.562237 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-317438c8-46c3-4110-9a58-13a5e8d9974f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:50.565164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=58 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:50.569822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-317438c8-46c3-4110-9a58-13a5e8d9974f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:50.576693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-317438c8-46c3-4110-9a58-13a5e8d9974f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:50.576693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-317438c8-46c3-4110-9a58-13a5e8d9974f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:50.576693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-317438c8-46c3-4110-9a58-13a5e8d9974f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:50.576693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-317438c8-46c3-4110-9a58-13a5e8d9974f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:50.577068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-317438c8-46c3-4110-9a58-13a5e8d9974f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:50.601101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-317438c8-46c3-4110-9a58-13a5e8d9974f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045883 Aug 24 06:24:50.601652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 547/1100] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:51.511503 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8759e6ff-64f6-41bf-a5a2-d63f0aed1bbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:51.513682 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8759e6ff-64f6-41bf-a5a2-d63f0aed1bbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:51.520119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8759e6ff-64f6-41bf-a5a2-d63f0aed1bbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:51.520626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8759e6ff-64f6-41bf-a5a2-d63f0aed1bbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:51.521061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8759e6ff-64f6-41bf-a5a2-d63f0aed1bbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:51.521741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8759e6ff-64f6-41bf-a5a2-d63f0aed1bbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:51.522183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8759e6ff-64f6-41bf-a5a2-d63f0aed1bbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:51.522597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8759e6ff-64f6-41bf-a5a2-d63f0aed1bbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:51.560604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8759e6ff-64f6-41bf-a5a2-d63f0aed1bbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052873 Aug 24 06:24:51.565219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 554/1101] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:51.614725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d3977ff5-26ae-402a-931d-a95c4c0c2d65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:51.616859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d3977ff5-26ae-402a-931d-a95c4c0c2d65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:51.623793 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3977ff5-26ae-402a-931d-a95c4c0c2d65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:51.624271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3977ff5-26ae-402a-931d-a95c4c0c2d65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:51.624734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3977ff5-26ae-402a-931d-a95c4c0c2d65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:51.625427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3977ff5-26ae-402a-931d-a95c4c0c2d65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:51.625872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3977ff5-26ae-402a-931d-a95c4c0c2d65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:51.626292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3977ff5-26ae-402a-931d-a95c4c0c2d65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:51.656641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d3977ff5-26ae-402a-931d-a95c4c0c2d65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046980 Aug 24 06:24:51.657467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 548/1102] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:51 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:52.572670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-354b73cd-4a92-4af8-9453-082689d0a952 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:52.574790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-354b73cd-4a92-4af8-9453-082689d0a952 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:52.583659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-354b73cd-4a92-4af8-9453-082689d0a952 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:52.584142 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-354b73cd-4a92-4af8-9453-082689d0a952 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:52.584615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-354b73cd-4a92-4af8-9453-082689d0a952 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:52.585317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-354b73cd-4a92-4af8-9453-082689d0a952 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:52.585767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-354b73cd-4a92-4af8-9453-082689d0a952 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:52.586187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-354b73cd-4a92-4af8-9453-082689d0a952 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:52.669976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-48a33bef-5c96-4779-8f30-5c386fc4f4c6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:52.672190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-48a33bef-5c96-4779-8f30-5c386fc4f4c6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:52.680227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48a33bef-5c96-4779-8f30-5c386fc4f4c6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:52.685225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48a33bef-5c96-4779-8f30-5c386fc4f4c6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:52.685225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48a33bef-5c96-4779-8f30-5c386fc4f4c6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:52.685225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48a33bef-5c96-4779-8f30-5c386fc4f4c6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:52.685225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48a33bef-5c96-4779-8f30-5c386fc4f4c6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:52.685636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48a33bef-5c96-4779-8f30-5c386fc4f4c6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:52.719916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:52.725760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-48a33bef-5c96-4779-8f30-5c386fc4f4c6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059899 Aug 24 06:24:52.726338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 549/1103] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:24:52.779457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-354b73cd-4a92-4af8-9453-082689d0a952 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210638 Aug 24 06:24:52.780045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 555/1104] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:52 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:53.742310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8c0a8f8e-07a5-4bab-b7a3-e8644fa88717 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:53.744445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8c0a8f8e-07a5-4bab-b7a3-e8644fa88717 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:53.751058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0a8f8e-07a5-4bab-b7a3-e8644fa88717 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:53.751534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0a8f8e-07a5-4bab-b7a3-e8644fa88717 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:53.751966 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0a8f8e-07a5-4bab-b7a3-e8644fa88717 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:53.752687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0a8f8e-07a5-4bab-b7a3-e8644fa88717 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:53.753141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0a8f8e-07a5-4bab-b7a3-e8644fa88717 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:53.753556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c0a8f8e-07a5-4bab-b7a3-e8644fa88717 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:53.781943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8c0a8f8e-07a5-4bab-b7a3-e8644fa88717 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044695 Aug 24 06:24:53.782498 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 550/1105] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:53.795339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9219f6e1-7866-4152-a6fe-502414a481ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:53.797459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9219f6e1-7866-4152-a6fe-502414a481ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:53.804712 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9219f6e1-7866-4152-a6fe-502414a481ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:53.805191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9219f6e1-7866-4152-a6fe-502414a481ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:53.805893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9219f6e1-7866-4152-a6fe-502414a481ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:53.806582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9219f6e1-7866-4152-a6fe-502414a481ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:53.807033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9219f6e1-7866-4152-a6fe-502414a481ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:53.807455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9219f6e1-7866-4152-a6fe-502414a481ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:53.836426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9219f6e1-7866-4152-a6fe-502414a481ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045211 Aug 24 06:24:53.837000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 556/1106] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:54.794889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3fb05e2b-2e85-4d2e-a29b-b1cf0f347414 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:54.796929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3fb05e2b-2e85-4d2e-a29b-b1cf0f347414 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:54.803801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fb05e2b-2e85-4d2e-a29b-b1cf0f347414 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:54.804274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fb05e2b-2e85-4d2e-a29b-b1cf0f347414 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:54.804735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fb05e2b-2e85-4d2e-a29b-b1cf0f347414 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:54.805664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fb05e2b-2e85-4d2e-a29b-b1cf0f347414 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:54.806113 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fb05e2b-2e85-4d2e-a29b-b1cf0f347414 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:54.806522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fb05e2b-2e85-4d2e-a29b-b1cf0f347414 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:54.837857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3fb05e2b-2e85-4d2e-a29b-b1cf0f347414 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047066 Aug 24 06:24:54.838403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 551/1107] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:54 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:54.847546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2672fde4-c9a4-4548-925a-3e4bc0d03af7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:54.849787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2672fde4-c9a4-4548-925a-3e4bc0d03af7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:54.856088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2672fde4-c9a4-4548-925a-3e4bc0d03af7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:54.856663 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2672fde4-c9a4-4548-925a-3e4bc0d03af7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:54.857215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2672fde4-c9a4-4548-925a-3e4bc0d03af7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:54.858095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2672fde4-c9a4-4548-925a-3e4bc0d03af7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:54.858542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2672fde4-c9a4-4548-925a-3e4bc0d03af7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:54.858954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2672fde4-c9a4-4548-925a-3e4bc0d03af7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:54.863153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:24:54.888568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2672fde4-c9a4-4548-925a-3e4bc0d03af7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 Aug 24 06:24:54.889114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 557/1108] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:55.849872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-47a7992b-8f7b-4fe7-a8fc-7cfcd0b64e7b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:55.851930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-47a7992b-8f7b-4fe7-a8fc-7cfcd0b64e7b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:55.858538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47a7992b-8f7b-4fe7-a8fc-7cfcd0b64e7b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:55.859018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47a7992b-8f7b-4fe7-a8fc-7cfcd0b64e7b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:55.859446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47a7992b-8f7b-4fe7-a8fc-7cfcd0b64e7b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:55.860128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47a7992b-8f7b-4fe7-a8fc-7cfcd0b64e7b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:55.860605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47a7992b-8f7b-4fe7-a8fc-7cfcd0b64e7b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:55.861028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47a7992b-8f7b-4fe7-a8fc-7cfcd0b64e7b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:55.891766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-47a7992b-8f7b-4fe7-a8fc-7cfcd0b64e7b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045868 Aug 24 06:24:55.892324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 552/1109] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:55.901189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f247e42e-3ba1-4e2c-b05e-5cac1b48759b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:55.903293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f247e42e-3ba1-4e2c-b05e-5cac1b48759b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:55.910314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f247e42e-3ba1-4e2c-b05e-5cac1b48759b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:55.910782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f247e42e-3ba1-4e2c-b05e-5cac1b48759b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:55.911209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f247e42e-3ba1-4e2c-b05e-5cac1b48759b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:55.911891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f247e42e-3ba1-4e2c-b05e-5cac1b48759b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:55.912332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f247e42e-3ba1-4e2c-b05e-5cac1b48759b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:55.912773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f247e42e-3ba1-4e2c-b05e-5cac1b48759b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:55.941607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f247e42e-3ba1-4e2c-b05e-5cac1b48759b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 Aug 24 06:24:55.942149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 558/1110] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:55 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:56.904798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f5c77778-18de-43a9-94eb-dcae75dd0619 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:56.906871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f5c77778-18de-43a9-94eb-dcae75dd0619 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:56.913893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5c77778-18de-43a9-94eb-dcae75dd0619 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:56.914361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5c77778-18de-43a9-94eb-dcae75dd0619 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:56.914786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5c77778-18de-43a9-94eb-dcae75dd0619 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:56.915458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5c77778-18de-43a9-94eb-dcae75dd0619 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:56.915894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5c77778-18de-43a9-94eb-dcae75dd0619 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:56.916303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5c77778-18de-43a9-94eb-dcae75dd0619 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:56.948277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f5c77778-18de-43a9-94eb-dcae75dd0619 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047340 Aug 24 06:24:56.950379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 553/1111] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:56.954656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ca447cdf-c3f5-4917-85da-15f9b96480c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:56.957361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ca447cdf-c3f5-4917-85da-15f9b96480c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:56.963715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca447cdf-c3f5-4917-85da-15f9b96480c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:56.964190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca447cdf-c3f5-4917-85da-15f9b96480c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:56.964678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca447cdf-c3f5-4917-85da-15f9b96480c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:56.965398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca447cdf-c3f5-4917-85da-15f9b96480c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:56.965849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca447cdf-c3f5-4917-85da-15f9b96480c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:56.966274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca447cdf-c3f5-4917-85da-15f9b96480c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:56.995708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ca447cdf-c3f5-4917-85da-15f9b96480c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Aug 24 06:24:56.996267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 559/1112] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:57.960270 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-89e41758-03df-4053-bf8a-6e864c153d30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:57.962394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-89e41758-03df-4053-bf8a-6e864c153d30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:57.968905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e41758-03df-4053-bf8a-6e864c153d30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:57.969379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e41758-03df-4053-bf8a-6e864c153d30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:57.969808 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e41758-03df-4053-bf8a-6e864c153d30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:57.970491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e41758-03df-4053-bf8a-6e864c153d30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:57.970962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e41758-03df-4053-bf8a-6e864c153d30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:57.971372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e41758-03df-4053-bf8a-6e864c153d30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:58.001726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-89e41758-03df-4053-bf8a-6e864c153d30 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045405 Aug 24 06:24:58.002281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 554/1113] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:57 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:58.008414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-49030990-b922-4595-9565-7c8f07b63f7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:58.010909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-49030990-b922-4595-9565-7c8f07b63f7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:58.017268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49030990-b922-4595-9565-7c8f07b63f7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:58.017738 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49030990-b922-4595-9565-7c8f07b63f7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:58.018165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49030990-b922-4595-9565-7c8f07b63f7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:58.018845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49030990-b922-4595-9565-7c8f07b63f7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:58.019279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49030990-b922-4595-9565-7c8f07b63f7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:58.019692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-49030990-b922-4595-9565-7c8f07b63f7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:58.048996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-49030990-b922-4595-9565-7c8f07b63f7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045246 Aug 24 06:24:58.049537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 560/1114] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:24:59.018183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b7c3a2e2-14ed-4c77-a897-33800648d7a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:59.020893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b7c3a2e2-14ed-4c77-a897-33800648d7a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:59.027208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7c3a2e2-14ed-4c77-a897-33800648d7a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:59.027683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7c3a2e2-14ed-4c77-a897-33800648d7a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:59.028110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7c3a2e2-14ed-4c77-a897-33800648d7a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:59.028823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7c3a2e2-14ed-4c77-a897-33800648d7a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:59.029268 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7c3a2e2-14ed-4c77-a897-33800648d7a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:59.029677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b7c3a2e2-14ed-4c77-a897-33800648d7a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:59.062271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b7c3a2e2-14ed-4c77-a897-33800648d7a6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048080 Aug 24 06:24:59.062495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d01d126b-4c4d-46fe-b7f3-945052e4ccc1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:24:59.062969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 555/1115] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:24:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:24:59.064460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d01d126b-4c4d-46fe-b7f3-945052e4ccc1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:24:59.071436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d01d126b-4c4d-46fe-b7f3-945052e4ccc1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:59.071902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d01d126b-4c4d-46fe-b7f3-945052e4ccc1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:59.072330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d01d126b-4c4d-46fe-b7f3-945052e4ccc1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:59.073040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d01d126b-4c4d-46fe-b7f3-945052e4ccc1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:24:59.073481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d01d126b-4c4d-46fe-b7f3-945052e4ccc1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:24:59.073921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d01d126b-4c4d-46fe-b7f3-945052e4ccc1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:24:59.103007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d01d126b-4c4d-46fe-b7f3-945052e4ccc1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044619 Aug 24 06:24:59.103544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 561/1116] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:24:59 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:00.074479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0dbd8cb4-f3a3-4eff-a968-449c34885dc1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:00.076505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0dbd8cb4-f3a3-4eff-a968-449c34885dc1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:00.082982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0dbd8cb4-f3a3-4eff-a968-449c34885dc1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:00.083456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0dbd8cb4-f3a3-4eff-a968-449c34885dc1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:00.083885 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0dbd8cb4-f3a3-4eff-a968-449c34885dc1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:00.084586 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0dbd8cb4-f3a3-4eff-a968-449c34885dc1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:00.085032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0dbd8cb4-f3a3-4eff-a968-449c34885dc1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:00.085443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0dbd8cb4-f3a3-4eff-a968-449c34885dc1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:00.115549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2be3d052-b3e5-41b3-ab88-afbcaa66ecba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:00.117251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0dbd8cb4-f3a3-4eff-a968-449c34885dc1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046804 Aug 24 06:25:00.117805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 556/1117] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:00 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:00.117943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2be3d052-b3e5-41b3-ab88-afbcaa66ecba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:00.124176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2be3d052-b3e5-41b3-ab88-afbcaa66ecba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:00.124682 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2be3d052-b3e5-41b3-ab88-afbcaa66ecba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:00.125108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2be3d052-b3e5-41b3-ab88-afbcaa66ecba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:00.125786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2be3d052-b3e5-41b3-ab88-afbcaa66ecba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:00.126241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2be3d052-b3e5-41b3-ab88-afbcaa66ecba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:00.126657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2be3d052-b3e5-41b3-ab88-afbcaa66ecba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:00.155222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2be3d052-b3e5-41b3-ab88-afbcaa66ecba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044048 Aug 24 06:25:00.155759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 562/1118] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:01.129786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dd31631b-a55a-4530-b6ab-77d8740d6492 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:01.131795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dd31631b-a55a-4530-b6ab-77d8740d6492 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:01.138160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd31631b-a55a-4530-b6ab-77d8740d6492 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:01.138628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd31631b-a55a-4530-b6ab-77d8740d6492 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:01.139048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd31631b-a55a-4530-b6ab-77d8740d6492 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:01.139724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd31631b-a55a-4530-b6ab-77d8740d6492 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:01.140164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd31631b-a55a-4530-b6ab-77d8740d6492 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:01.140605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd31631b-a55a-4530-b6ab-77d8740d6492 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:01.167421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0d0b4da4-d04f-4e14-991d-aabca559cc62 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:01.169626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0d0b4da4-d04f-4e14-991d-aabca559cc62 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:01.169782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dd31631b-a55a-4530-b6ab-77d8740d6492 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044389 Aug 24 06:25:01.170247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 557/1119] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:25:01.175907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d0b4da4-d04f-4e14-991d-aabca559cc62 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:01.176384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d0b4da4-d04f-4e14-991d-aabca559cc62 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:01.176867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d0b4da4-d04f-4e14-991d-aabca559cc62 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:01.177556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d0b4da4-d04f-4e14-991d-aabca559cc62 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:01.178002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d0b4da4-d04f-4e14-991d-aabca559cc62 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:01.178420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d0b4da4-d04f-4e14-991d-aabca559cc62 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:01.208202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0d0b4da4-d04f-4e14-991d-aabca559cc62 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Aug 24 06:25:01.208798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 563/1120] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:02.182841 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f9b57213-fde1-492d-b02f-229408b2de0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:02.185015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f9b57213-fde1-492d-b02f-229408b2de0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:02.191439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9b57213-fde1-492d-b02f-229408b2de0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:02.192584 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9b57213-fde1-492d-b02f-229408b2de0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:02.193013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9b57213-fde1-492d-b02f-229408b2de0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:02.193684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9b57213-fde1-492d-b02f-229408b2de0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:02.194128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9b57213-fde1-492d-b02f-229408b2de0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:02.194536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9b57213-fde1-492d-b02f-229408b2de0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:02.220120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f575c14c-d00e-463c-8a52-ba3deeb5d07f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:02.222265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f575c14c-d00e-463c-8a52-ba3deeb5d07f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:02.223458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f9b57213-fde1-492d-b02f-229408b2de0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044821 Aug 24 06:25:02.224029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 558/1121] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:02.228943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f575c14c-d00e-463c-8a52-ba3deeb5d07f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:02.229425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f575c14c-d00e-463c-8a52-ba3deeb5d07f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:02.229872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f575c14c-d00e-463c-8a52-ba3deeb5d07f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:02.230573 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f575c14c-d00e-463c-8a52-ba3deeb5d07f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:02.231030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f575c14c-d00e-463c-8a52-ba3deeb5d07f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:02.231450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f575c14c-d00e-463c-8a52-ba3deeb5d07f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:02.261656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f575c14c-d00e-463c-8a52-ba3deeb5d07f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045568 Aug 24 06:25:02.262228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 564/1122] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:02 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:03.237287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0d47dd17-3f04-4717-bae4-57527b592e40 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:03.239411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0d47dd17-3f04-4717-bae4-57527b592e40 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:03.245485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d47dd17-3f04-4717-bae4-57527b592e40 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:03.245958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d47dd17-3f04-4717-bae4-57527b592e40 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:03.246389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d47dd17-3f04-4717-bae4-57527b592e40 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:03.247062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d47dd17-3f04-4717-bae4-57527b592e40 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:03.247506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d47dd17-3f04-4717-bae4-57527b592e40 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:03.247921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d47dd17-3f04-4717-bae4-57527b592e40 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:03.275080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5055b4a2-6dcb-45b9-86ad-f98513819c94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:03.277238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5055b4a2-6dcb-45b9-86ad-f98513819c94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:03.279150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0d47dd17-3f04-4717-bae4-57527b592e40 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045866 Aug 24 06:25:03.279715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 559/1123] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:03.283626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5055b4a2-6dcb-45b9-86ad-f98513819c94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:03.284159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5055b4a2-6dcb-45b9-86ad-f98513819c94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:03.284618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5055b4a2-6dcb-45b9-86ad-f98513819c94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:03.285304 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5055b4a2-6dcb-45b9-86ad-f98513819c94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:03.285745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5055b4a2-6dcb-45b9-86ad-f98513819c94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:03.286158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5055b4a2-6dcb-45b9-86ad-f98513819c94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:03.314567 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5055b4a2-6dcb-45b9-86ad-f98513819c94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043338 Aug 24 06:25:03.315126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 565/1124] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:03 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:04.291464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f89ddb80-28df-4fdc-a596-b4ef6ba52eb1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:04.293511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f89ddb80-28df-4fdc-a596-b4ef6ba52eb1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:04.299985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89ddb80-28df-4fdc-a596-b4ef6ba52eb1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:04.300459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89ddb80-28df-4fdc-a596-b4ef6ba52eb1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:04.300921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89ddb80-28df-4fdc-a596-b4ef6ba52eb1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:04.302117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89ddb80-28df-4fdc-a596-b4ef6ba52eb1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:04.302579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89ddb80-28df-4fdc-a596-b4ef6ba52eb1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:04.303020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89ddb80-28df-4fdc-a596-b4ef6ba52eb1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:04.329446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-78cbcefe-eb68-4798-b2bc-dbf20d5bfef4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:04.331702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-78cbcefe-eb68-4798-b2bc-dbf20d5bfef4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:04.334243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f89ddb80-28df-4fdc-a596-b4ef6ba52eb1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046804 Aug 24 06:25:04.335030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 560/1125] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:04 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:04.338737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78cbcefe-eb68-4798-b2bc-dbf20d5bfef4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:04.339220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78cbcefe-eb68-4798-b2bc-dbf20d5bfef4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:04.339649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78cbcefe-eb68-4798-b2bc-dbf20d5bfef4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:04.340345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78cbcefe-eb68-4798-b2bc-dbf20d5bfef4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:04.340823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78cbcefe-eb68-4798-b2bc-dbf20d5bfef4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:04.341247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78cbcefe-eb68-4798-b2bc-dbf20d5bfef4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:04.370593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-78cbcefe-eb68-4798-b2bc-dbf20d5bfef4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045016 Aug 24 06:25:04.371142 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 566/1126] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:05.346721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d686538c-38b6-4b15-b693-3f992e678f1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:05.348809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d686538c-38b6-4b15-b693-3f992e678f1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:05.355260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d686538c-38b6-4b15-b693-3f992e678f1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:05.355738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d686538c-38b6-4b15-b693-3f992e678f1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:05.356175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d686538c-38b6-4b15-b693-3f992e678f1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:05.356887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d686538c-38b6-4b15-b693-3f992e678f1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:05.357336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d686538c-38b6-4b15-b693-3f992e678f1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:05.357756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d686538c-38b6-4b15-b693-3f992e678f1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:05.383290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b6843f88-ebda-4b0b-a36b-76e2d0a321a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:05.385409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b6843f88-ebda-4b0b-a36b-76e2d0a321a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:05.387810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d686538c-38b6-4b15-b693-3f992e678f1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045198 Aug 24 06:25:05.388379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 561/1127] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:05.391552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b6843f88-ebda-4b0b-a36b-76e2d0a321a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:05.392024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b6843f88-ebda-4b0b-a36b-76e2d0a321a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:05.392450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b6843f88-ebda-4b0b-a36b-76e2d0a321a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:05.393160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b6843f88-ebda-4b0b-a36b-76e2d0a321a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:05.393600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b6843f88-ebda-4b0b-a36b-76e2d0a321a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:05.394014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b6843f88-ebda-4b0b-a36b-76e2d0a321a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:05.423729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b6843f88-ebda-4b0b-a36b-76e2d0a321a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Aug 24 06:25:05.424293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 567/1128] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:06.400781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6d631f61-84b5-4c34-a2e7-bcd28170a759 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:06.402822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6d631f61-84b5-4c34-a2e7-bcd28170a759 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:06.409418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d631f61-84b5-4c34-a2e7-bcd28170a759 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:06.409890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d631f61-84b5-4c34-a2e7-bcd28170a759 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:06.410317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d631f61-84b5-4c34-a2e7-bcd28170a759 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:06.411000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d631f61-84b5-4c34-a2e7-bcd28170a759 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:06.411445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d631f61-84b5-4c34-a2e7-bcd28170a759 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:06.411860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d631f61-84b5-4c34-a2e7-bcd28170a759 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:06.440235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-eaab5eee-b2b4-4bca-972e-99d2cf5cee03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:06.441941 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6d631f61-84b5-4c34-a2e7-bcd28170a759 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045229 Aug 24 06:25:06.444599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-eaab5eee-b2b4-4bca-972e-99d2cf5cee03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:06.445163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 562/1129] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:06.455499 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eaab5eee-b2b4-4bca-972e-99d2cf5cee03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:06.455991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eaab5eee-b2b4-4bca-972e-99d2cf5cee03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:06.456428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eaab5eee-b2b4-4bca-972e-99d2cf5cee03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:06.457263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eaab5eee-b2b4-4bca-972e-99d2cf5cee03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:06.457805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eaab5eee-b2b4-4bca-972e-99d2cf5cee03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:06.458827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eaab5eee-b2b4-4bca-972e-99d2cf5cee03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:06.489066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-eaab5eee-b2b4-4bca-972e-99d2cf5cee03 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056026 Aug 24 06:25:06.489620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 568/1130] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:07.454864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-df6f3201-f9ac-41a8-aaf0-94394c70cdaf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:07.456982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-df6f3201-f9ac-41a8-aaf0-94394c70cdaf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:07.463855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df6f3201-f9ac-41a8-aaf0-94394c70cdaf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:07.464337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df6f3201-f9ac-41a8-aaf0-94394c70cdaf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:07.464800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df6f3201-f9ac-41a8-aaf0-94394c70cdaf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:07.465487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df6f3201-f9ac-41a8-aaf0-94394c70cdaf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:07.465933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df6f3201-f9ac-41a8-aaf0-94394c70cdaf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:07.466349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df6f3201-f9ac-41a8-aaf0-94394c70cdaf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:07.495566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-df6f3201-f9ac-41a8-aaf0-94394c70cdaf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044623 Aug 24 06:25:07.496122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 563/1131] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:07 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:07.500570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5f863c64-6923-4727-af6a-ffd2e3926886 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:07.502684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5f863c64-6923-4727-af6a-ffd2e3926886 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:07.509033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f863c64-6923-4727-af6a-ffd2e3926886 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:07.509500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f863c64-6923-4727-af6a-ffd2e3926886 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:07.509927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f863c64-6923-4727-af6a-ffd2e3926886 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:07.510600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f863c64-6923-4727-af6a-ffd2e3926886 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:07.511065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f863c64-6923-4727-af6a-ffd2e3926886 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:07.511482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f863c64-6923-4727-af6a-ffd2e3926886 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:07.541452 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5f863c64-6923-4727-af6a-ffd2e3926886 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044910 Aug 24 06:25:07.541988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 569/1132] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:08.516786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-72e0b761-da59-49b9-a907-777f12e58edd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:08.516786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-72e0b761-da59-49b9-a907-777f12e58edd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:08.516786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72e0b761-da59-49b9-a907-777f12e58edd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:08.516786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72e0b761-da59-49b9-a907-777f12e58edd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:08.517645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72e0b761-da59-49b9-a907-777f12e58edd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:08.517645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72e0b761-da59-49b9-a907-777f12e58edd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:08.517834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72e0b761-da59-49b9-a907-777f12e58edd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:08.518118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72e0b761-da59-49b9-a907-777f12e58edd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:08.546595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-72e0b761-da59-49b9-a907-777f12e58edd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043212 Aug 24 06:25:08.547137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 564/1133] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:08.554376 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-937999b2-2c02-4b36-9f49-903756c10950 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:08.556757 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-937999b2-2c02-4b36-9f49-903756c10950 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:08.563054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937999b2-2c02-4b36-9f49-903756c10950 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:08.597079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937999b2-2c02-4b36-9f49-903756c10950 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:08.597079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937999b2-2c02-4b36-9f49-903756c10950 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:08.597079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937999b2-2c02-4b36-9f49-903756c10950 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:08.597079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937999b2-2c02-4b36-9f49-903756c10950 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:08.597505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937999b2-2c02-4b36-9f49-903756c10950 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:08.597505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-937999b2-2c02-4b36-9f49-903756c10950 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Aug 24 06:25:08.597505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 570/1134] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:09.559097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-df195f5d-3e82-49d9-8b07-826c99daaea7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:09.561121 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-df195f5d-3e82-49d9-8b07-826c99daaea7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:09.567491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df195f5d-3e82-49d9-8b07-826c99daaea7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:09.567965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df195f5d-3e82-49d9-8b07-826c99daaea7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:09.568387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df195f5d-3e82-49d9-8b07-826c99daaea7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:09.569078 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df195f5d-3e82-49d9-8b07-826c99daaea7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:09.569515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df195f5d-3e82-49d9-8b07-826c99daaea7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:09.569924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-df195f5d-3e82-49d9-8b07-826c99daaea7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:09.601154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-df195f5d-3e82-49d9-8b07-826c99daaea7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046319 Aug 24 06:25:09.601719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 565/1135] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:09.607278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-70b70b57-df55-44ad-bb6a-4ec50caad645 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:09.609412 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-70b70b57-df55-44ad-bb6a-4ec50caad645 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:09.615802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70b70b57-df55-44ad-bb6a-4ec50caad645 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:09.616276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70b70b57-df55-44ad-bb6a-4ec50caad645 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:09.616746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70b70b57-df55-44ad-bb6a-4ec50caad645 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:09.617469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70b70b57-df55-44ad-bb6a-4ec50caad645 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:09.617879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70b70b57-df55-44ad-bb6a-4ec50caad645 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:09.618295 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70b70b57-df55-44ad-bb6a-4ec50caad645 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:09.647222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-70b70b57-df55-44ad-bb6a-4ec50caad645 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Aug 24 06:25:09.647773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 571/1136] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:09 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:10.613486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-04008f52-c644-4b04-858e-bf06fd99a377 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:10.615496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-04008f52-c644-4b04-858e-bf06fd99a377 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:10.622544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04008f52-c644-4b04-858e-bf06fd99a377 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:10.623019 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04008f52-c644-4b04-858e-bf06fd99a377 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:10.623446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04008f52-c644-4b04-858e-bf06fd99a377 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:10.624139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04008f52-c644-4b04-858e-bf06fd99a377 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:10.624644 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04008f52-c644-4b04-858e-bf06fd99a377 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:10.625062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04008f52-c644-4b04-858e-bf06fd99a377 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:10.642389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:25:10.655352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-04008f52-c644-4b04-858e-bf06fd99a377 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045939 Aug 24 06:25:10.662495 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 566/1137] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:10 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:10.662630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5c489f33-9ebc-452f-a9a9-02e6f4731a51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:10.662630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5c489f33-9ebc-452f-a9a9-02e6f4731a51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:10.665071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=58 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:25:10.669799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c489f33-9ebc-452f-a9a9-02e6f4731a51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:10.670275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c489f33-9ebc-452f-a9a9-02e6f4731a51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:10.670698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c489f33-9ebc-452f-a9a9-02e6f4731a51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:10.671384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c489f33-9ebc-452f-a9a9-02e6f4731a51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:10.671830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c489f33-9ebc-452f-a9a9-02e6f4731a51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:10.672242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c489f33-9ebc-452f-a9a9-02e6f4731a51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:10.704050 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5c489f33-9ebc-452f-a9a9-02e6f4731a51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047968 Aug 24 06:25:10.704650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 572/1138] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:10 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:11.674013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b78aa744-b6c4-4f29-89d9-4a7fc555e116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:11.676358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b78aa744-b6c4-4f29-89d9-4a7fc555e116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:11.683771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b78aa744-b6c4-4f29-89d9-4a7fc555e116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:11.684297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b78aa744-b6c4-4f29-89d9-4a7fc555e116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:11.684697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b78aa744-b6c4-4f29-89d9-4a7fc555e116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:11.685376 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b78aa744-b6c4-4f29-89d9-4a7fc555e116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:11.685816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b78aa744-b6c4-4f29-89d9-4a7fc555e116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:11.686225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b78aa744-b6c4-4f29-89d9-4a7fc555e116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:11.716035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-da7268c8-d9e2-42a5-a364-92487ef72f88 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:11.716578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b78aa744-b6c4-4f29-89d9-4a7fc555e116 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046742 Aug 24 06:25:11.717076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 567/1139] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:11.718251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-da7268c8-d9e2-42a5-a364-92487ef72f88 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:11.724678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da7268c8-d9e2-42a5-a364-92487ef72f88 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:11.725156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da7268c8-d9e2-42a5-a364-92487ef72f88 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:11.725590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da7268c8-d9e2-42a5-a364-92487ef72f88 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:11.726949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da7268c8-d9e2-42a5-a364-92487ef72f88 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:11.727401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da7268c8-d9e2-42a5-a364-92487ef72f88 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:11.727820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da7268c8-d9e2-42a5-a364-92487ef72f88 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:11.751951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:25:11.756583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-da7268c8-d9e2-42a5-a364-92487ef72f88 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Aug 24 06:25:11.757135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 573/1140] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:12.728765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dc257fa1-6337-4519-bbda-b1971f2a9f32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:12.730974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dc257fa1-6337-4519-bbda-b1971f2a9f32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:12.737458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc257fa1-6337-4519-bbda-b1971f2a9f32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:12.737925 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc257fa1-6337-4519-bbda-b1971f2a9f32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:12.738351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc257fa1-6337-4519-bbda-b1971f2a9f32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:12.739029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc257fa1-6337-4519-bbda-b1971f2a9f32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:12.739467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc257fa1-6337-4519-bbda-b1971f2a9f32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:12.739874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc257fa1-6337-4519-bbda-b1971f2a9f32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:12.769357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-62163bbb-11ff-4f55-b549-ffaeca06fa63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:12.769918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dc257fa1-6337-4519-bbda-b1971f2a9f32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044930 Aug 24 06:25:12.770106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 568/1141] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:12.771472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-62163bbb-11ff-4f55-b549-ffaeca06fa63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:12.778213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62163bbb-11ff-4f55-b549-ffaeca06fa63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:12.778690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62163bbb-11ff-4f55-b549-ffaeca06fa63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:12.779126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62163bbb-11ff-4f55-b549-ffaeca06fa63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:12.779814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62163bbb-11ff-4f55-b549-ffaeca06fa63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:12.780263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62163bbb-11ff-4f55-b549-ffaeca06fa63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:12.780728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62163bbb-11ff-4f55-b549-ffaeca06fa63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:12.810004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-62163bbb-11ff-4f55-b549-ffaeca06fa63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045012 Aug 24 06:25:12.810566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 574/1142] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:13.781911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3d87cc87-d454-4379-87fe-d78bfb9b70be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:13.783960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3d87cc87-d454-4379-87fe-d78bfb9b70be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:13.790781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d87cc87-d454-4379-87fe-d78bfb9b70be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:13.791253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d87cc87-d454-4379-87fe-d78bfb9b70be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:13.791678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d87cc87-d454-4379-87fe-d78bfb9b70be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:13.792351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d87cc87-d454-4379-87fe-d78bfb9b70be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:13.792817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d87cc87-d454-4379-87fe-d78bfb9b70be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:13.793255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d87cc87-d454-4379-87fe-d78bfb9b70be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:13.821908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7407320b-6da5-4bf4-87f6-9e24c665b060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:13.823154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3d87cc87-d454-4379-87fe-d78bfb9b70be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045183 Aug 24 06:25:13.823728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 569/1143] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:13 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:13.824161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7407320b-6da5-4bf4-87f6-9e24c665b060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:13.830733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7407320b-6da5-4bf4-87f6-9e24c665b060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:13.831208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7407320b-6da5-4bf4-87f6-9e24c665b060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:13.831641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7407320b-6da5-4bf4-87f6-9e24c665b060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:13.832333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7407320b-6da5-4bf4-87f6-9e24c665b060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:13.832875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7407320b-6da5-4bf4-87f6-9e24c665b060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:13.833298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7407320b-6da5-4bf4-87f6-9e24c665b060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:13.862022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7407320b-6da5-4bf4-87f6-9e24c665b060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044112 Aug 24 06:25:13.862571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 575/1144] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:14.835651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3d79d336-2603-442f-a54d-2500333731c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:14.837899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3d79d336-2603-442f-a54d-2500333731c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:14.844277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d79d336-2603-442f-a54d-2500333731c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:14.844790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d79d336-2603-442f-a54d-2500333731c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:14.845221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d79d336-2603-442f-a54d-2500333731c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:14.845905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d79d336-2603-442f-a54d-2500333731c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:14.846349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d79d336-2603-442f-a54d-2500333731c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:14.846763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d79d336-2603-442f-a54d-2500333731c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:14.874657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c66789be-054c-4996-a89b-2ea6dc68190c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:14.875774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3d79d336-2603-442f-a54d-2500333731c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044075 Aug 24 06:25:14.876558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 570/1145] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:14.876927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c66789be-054c-4996-a89b-2ea6dc68190c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:14.884459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c66789be-054c-4996-a89b-2ea6dc68190c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:14.884942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c66789be-054c-4996-a89b-2ea6dc68190c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:14.885372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c66789be-054c-4996-a89b-2ea6dc68190c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:14.886052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c66789be-054c-4996-a89b-2ea6dc68190c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:14.886495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c66789be-054c-4996-a89b-2ea6dc68190c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:14.886907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c66789be-054c-4996-a89b-2ea6dc68190c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:14.915849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c66789be-054c-4996-a89b-2ea6dc68190c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Aug 24 06:25:14.916329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 576/1146] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:15.887847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9fdd8dc2-7e0b-421b-a330-e3458eafc67e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:15.889876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9fdd8dc2-7e0b-421b-a330-e3458eafc67e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:15.896554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fdd8dc2-7e0b-421b-a330-e3458eafc67e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:15.897026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fdd8dc2-7e0b-421b-a330-e3458eafc67e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:15.897455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fdd8dc2-7e0b-421b-a330-e3458eafc67e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:15.898137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fdd8dc2-7e0b-421b-a330-e3458eafc67e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:15.898576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fdd8dc2-7e0b-421b-a330-e3458eafc67e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:15.898986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fdd8dc2-7e0b-421b-a330-e3458eafc67e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:15.927830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9fdd8dc2-7e0b-421b-a330-e3458eafc67e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044470 Aug 24 06:25:15.928383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 571/1147] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:15.929861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-10a7b9b0-080a-46a4-9c44-8646468fd934 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:15.932247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-10a7b9b0-080a-46a4-9c44-8646468fd934 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:15.938795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10a7b9b0-080a-46a4-9c44-8646468fd934 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:15.939271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10a7b9b0-080a-46a4-9c44-8646468fd934 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:15.939727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10a7b9b0-080a-46a4-9c44-8646468fd934 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:15.940395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10a7b9b0-080a-46a4-9c44-8646468fd934 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:15.940871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10a7b9b0-080a-46a4-9c44-8646468fd934 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:15.941294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10a7b9b0-080a-46a4-9c44-8646468fd934 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:15.971261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-10a7b9b0-080a-46a4-9c44-8646468fd934 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045418 Aug 24 06:25:15.971826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 577/1148] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:15 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:16.940220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f83fb6ca-7b96-4aa3-a55e-c52cca2815d2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:16.942413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f83fb6ca-7b96-4aa3-a55e-c52cca2815d2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:16.949479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f83fb6ca-7b96-4aa3-a55e-c52cca2815d2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:16.949960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f83fb6ca-7b96-4aa3-a55e-c52cca2815d2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:16.950389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f83fb6ca-7b96-4aa3-a55e-c52cca2815d2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:16.951064 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f83fb6ca-7b96-4aa3-a55e-c52cca2815d2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:16.951509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f83fb6ca-7b96-4aa3-a55e-c52cca2815d2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:16.951922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f83fb6ca-7b96-4aa3-a55e-c52cca2815d2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:16.981216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f83fb6ca-7b96-4aa3-a55e-c52cca2815d2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044749 Aug 24 06:25:16.982497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 572/1149] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:16 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:16.983508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-596fec7e-fc4d-4df0-a4ff-c87764560d1f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:16.985657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-596fec7e-fc4d-4df0-a4ff-c87764560d1f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:16.991536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-596fec7e-fc4d-4df0-a4ff-c87764560d1f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:16.992018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-596fec7e-fc4d-4df0-a4ff-c87764560d1f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:16.992451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-596fec7e-fc4d-4df0-a4ff-c87764560d1f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:16.993165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-596fec7e-fc4d-4df0-a4ff-c87764560d1f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:16.993619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-596fec7e-fc4d-4df0-a4ff-c87764560d1f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:16.994509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-596fec7e-fc4d-4df0-a4ff-c87764560d1f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:17.023543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-596fec7e-fc4d-4df0-a4ff-c87764560d1f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Aug 24 06:25:17.024099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 578/1150] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:17.993960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a63aa17d-e7d6-45b8-992c-16d33f4c5f6a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:17.996009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a63aa17d-e7d6-45b8-992c-16d33f4c5f6a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:18.002369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63aa17d-e7d6-45b8-992c-16d33f4c5f6a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:18.002838 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63aa17d-e7d6-45b8-992c-16d33f4c5f6a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:18.003264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63aa17d-e7d6-45b8-992c-16d33f4c5f6a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:18.003940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63aa17d-e7d6-45b8-992c-16d33f4c5f6a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:18.004427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63aa17d-e7d6-45b8-992c-16d33f4c5f6a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:18.004879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63aa17d-e7d6-45b8-992c-16d33f4c5f6a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:18.034360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a63aa17d-e7d6-45b8-992c-16d33f4c5f6a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044358 Aug 24 06:25:18.034922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 573/1151] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:18.035338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-42927b26-61c9-4cab-89a9-bda7d7b0422c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:18.037545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-42927b26-61c9-4cab-89a9-bda7d7b0422c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:18.043928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42927b26-61c9-4cab-89a9-bda7d7b0422c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:18.044398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42927b26-61c9-4cab-89a9-bda7d7b0422c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:18.044896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42927b26-61c9-4cab-89a9-bda7d7b0422c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:18.045597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42927b26-61c9-4cab-89a9-bda7d7b0422c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:18.046018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42927b26-61c9-4cab-89a9-bda7d7b0422c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:18.046429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42927b26-61c9-4cab-89a9-bda7d7b0422c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:18.075138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-42927b26-61c9-4cab-89a9-bda7d7b0422c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Aug 24 06:25:18.075614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 579/1152] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:19.046735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c126130a-5e3a-4362-80c0-7b2cd9c0279c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:19.048810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c126130a-5e3a-4362-80c0-7b2cd9c0279c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:19.055144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c126130a-5e3a-4362-80c0-7b2cd9c0279c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:19.055613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c126130a-5e3a-4362-80c0-7b2cd9c0279c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:19.056291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c126130a-5e3a-4362-80c0-7b2cd9c0279c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:19.056986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c126130a-5e3a-4362-80c0-7b2cd9c0279c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:19.057428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c126130a-5e3a-4362-80c0-7b2cd9c0279c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:19.057836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c126130a-5e3a-4362-80c0-7b2cd9c0279c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:19.086496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c126130a-5e3a-4362-80c0-7b2cd9c0279c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043744 Aug 24 06:25:19.087058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 574/1153] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:19.087183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-80b5efa3-ee4f-4fdb-87dd-b85696a32ad7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:19.089883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-80b5efa3-ee4f-4fdb-87dd-b85696a32ad7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:19.096294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b5efa3-ee4f-4fdb-87dd-b85696a32ad7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:19.096799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b5efa3-ee4f-4fdb-87dd-b85696a32ad7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:19.097259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b5efa3-ee4f-4fdb-87dd-b85696a32ad7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:19.097974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b5efa3-ee4f-4fdb-87dd-b85696a32ad7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:19.098431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b5efa3-ee4f-4fdb-87dd-b85696a32ad7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:19.098854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80b5efa3-ee4f-4fdb-87dd-b85696a32ad7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:19.127777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-80b5efa3-ee4f-4fdb-87dd-b85696a32ad7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044585 Aug 24 06:25:19.128324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 580/1154] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:20.099475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d89f26df-36bd-4579-b469-d27f0deb010a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:20.101657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d89f26df-36bd-4579-b469-d27f0deb010a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:20.108732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d89f26df-36bd-4579-b469-d27f0deb010a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:20.109212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d89f26df-36bd-4579-b469-d27f0deb010a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:20.109641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d89f26df-36bd-4579-b469-d27f0deb010a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:20.110323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d89f26df-36bd-4579-b469-d27f0deb010a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:20.110772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d89f26df-36bd-4579-b469-d27f0deb010a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:20.111189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d89f26df-36bd-4579-b469-d27f0deb010a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:20.139684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-368dd8f6-01dd-46a7-8e78-421a1df6c2a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:20.140232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d89f26df-36bd-4579-b469-d27f0deb010a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044611 Aug 24 06:25:20.140521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 575/1155] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:20 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:20.141980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-368dd8f6-01dd-46a7-8e78-421a1df6c2a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:20.148283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-368dd8f6-01dd-46a7-8e78-421a1df6c2a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:20.148784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-368dd8f6-01dd-46a7-8e78-421a1df6c2a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:20.149212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-368dd8f6-01dd-46a7-8e78-421a1df6c2a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:20.149893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-368dd8f6-01dd-46a7-8e78-421a1df6c2a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:20.150336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-368dd8f6-01dd-46a7-8e78-421a1df6c2a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:20.150746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-368dd8f6-01dd-46a7-8e78-421a1df6c2a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:20.180485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-368dd8f6-01dd-46a7-8e78-421a1df6c2a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045056 Aug 24 06:25:20.181306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 581/1156] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:21.152261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-24b47b97-6c64-477b-9446-6b899cb9c542 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:21.154498 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-24b47b97-6c64-477b-9446-6b899cb9c542 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:21.160963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24b47b97-6c64-477b-9446-6b899cb9c542 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:21.161441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24b47b97-6c64-477b-9446-6b899cb9c542 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:21.161877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24b47b97-6c64-477b-9446-6b899cb9c542 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:21.162559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24b47b97-6c64-477b-9446-6b899cb9c542 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:21.163009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24b47b97-6c64-477b-9446-6b899cb9c542 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:21.163434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-24b47b97-6c64-477b-9446-6b899cb9c542 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:21.193643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-24b47b97-6c64-477b-9446-6b899cb9c542 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045443 Aug 24 06:25:21.193866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9f8f4588-ac72-48af-945b-3a8867f70955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:21.194429 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 576/1157] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:21.196017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9f8f4588-ac72-48af-945b-3a8867f70955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:21.202494 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f8f4588-ac72-48af-945b-3a8867f70955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:21.202971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f8f4588-ac72-48af-945b-3a8867f70955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:21.203429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f8f4588-ac72-48af-945b-3a8867f70955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:21.204193 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f8f4588-ac72-48af-945b-3a8867f70955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:21.204697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f8f4588-ac72-48af-945b-3a8867f70955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:21.205114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f8f4588-ac72-48af-945b-3a8867f70955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:21.234210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9f8f4588-ac72-48af-945b-3a8867f70955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045019 Aug 24 06:25:21.234686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 582/1158] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:21 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:22.206592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5ae6e95c-e647-478e-9889-e51145779902 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:22.208741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5ae6e95c-e647-478e-9889-e51145779902 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:22.211053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=60 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:25:22.215867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ae6e95c-e647-478e-9889-e51145779902 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:22.216340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ae6e95c-e647-478e-9889-e51145779902 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:22.216856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ae6e95c-e647-478e-9889-e51145779902 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:22.217562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ae6e95c-e647-478e-9889-e51145779902 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:22.217978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ae6e95c-e647-478e-9889-e51145779902 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:22.218482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ae6e95c-e647-478e-9889-e51145779902 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:22.247364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f0f9306e-5b3a-48f5-a159-7fb736c71d3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:22.248269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5ae6e95c-e647-478e-9889-e51145779902 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045654 Aug 24 06:25:22.248871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 577/1159] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:22 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:22.249521 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f0f9306e-5b3a-48f5-a159-7fb736c71d3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:22.255486 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0f9306e-5b3a-48f5-a159-7fb736c71d3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:22.255954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0f9306e-5b3a-48f5-a159-7fb736c71d3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:22.256379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0f9306e-5b3a-48f5-a159-7fb736c71d3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:22.257095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0f9306e-5b3a-48f5-a159-7fb736c71d3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:22.257537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0f9306e-5b3a-48f5-a159-7fb736c71d3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:22.257950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0f9306e-5b3a-48f5-a159-7fb736c71d3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:22.287708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f0f9306e-5b3a-48f5-a159-7fb736c71d3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Aug 24 06:25:22.288276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 583/1160] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:23.260219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-15b1aab4-1e7f-43c7-8e16-3679655f7288 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:23.262286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-15b1aab4-1e7f-43c7-8e16-3679655f7288 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:23.269240 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15b1aab4-1e7f-43c7-8e16-3679655f7288 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:23.269710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15b1aab4-1e7f-43c7-8e16-3679655f7288 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:23.270132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15b1aab4-1e7f-43c7-8e16-3679655f7288 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:23.270802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15b1aab4-1e7f-43c7-8e16-3679655f7288 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:23.271239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15b1aab4-1e7f-43c7-8e16-3679655f7288 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:23.271648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15b1aab4-1e7f-43c7-8e16-3679655f7288 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:23.300150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-817ce9f5-e8da-47a3-bcab-41fb0112026c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:23.302402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-817ce9f5-e8da-47a3-bcab-41fb0112026c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:23.310241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817ce9f5-e8da-47a3-bcab-41fb0112026c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:23.310728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817ce9f5-e8da-47a3-bcab-41fb0112026c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:23.311167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817ce9f5-e8da-47a3-bcab-41fb0112026c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:23.311875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817ce9f5-e8da-47a3-bcab-41fb0112026c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:23.312326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817ce9f5-e8da-47a3-bcab-41fb0112026c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:23.312776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817ce9f5-e8da-47a3-bcab-41fb0112026c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:23.346043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-817ce9f5-e8da-47a3-bcab-41fb0112026c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049922 Aug 24 06:25:23.346647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 584/1161] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:23 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:23.450844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-15b1aab4-1e7f-43c7-8e16-3679655f7288 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.194602 Aug 24 06:25:23.451389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 578/1162] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:25:24.358857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-033bc640-e5f4-45c7-b475-abfc95293a79 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:24.360948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-033bc640-e5f4-45c7-b475-abfc95293a79 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:24.367410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-033bc640-e5f4-45c7-b475-abfc95293a79 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:24.367881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-033bc640-e5f4-45c7-b475-abfc95293a79 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:24.368309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-033bc640-e5f4-45c7-b475-abfc95293a79 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:24.369042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-033bc640-e5f4-45c7-b475-abfc95293a79 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:24.369488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-033bc640-e5f4-45c7-b475-abfc95293a79 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:24.369897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-033bc640-e5f4-45c7-b475-abfc95293a79 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:24.399541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-033bc640-e5f4-45c7-b475-abfc95293a79 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044772 Aug 24 06:25:24.400085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 585/1163] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:24.463368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d5fa776c-a123-4e8e-9c9e-934b15288eee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:24.465497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d5fa776c-a123-4e8e-9c9e-934b15288eee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:24.471869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5fa776c-a123-4e8e-9c9e-934b15288eee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:24.472345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5fa776c-a123-4e8e-9c9e-934b15288eee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:24.472817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5fa776c-a123-4e8e-9c9e-934b15288eee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:24.473504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5fa776c-a123-4e8e-9c9e-934b15288eee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:24.473950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5fa776c-a123-4e8e-9c9e-934b15288eee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:24.474370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5fa776c-a123-4e8e-9c9e-934b15288eee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:24.504667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d5fa776c-a123-4e8e-9c9e-934b15288eee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045221 Aug 24 06:25:24.505222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 579/1164] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:25:25.411951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8c8c50a9-f3d5-42d7-a1c1-7b3ee43a5c7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:25.414077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8c8c50a9-f3d5-42d7-a1c1-7b3ee43a5c7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:25.421256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8c50a9-f3d5-42d7-a1c1-7b3ee43a5c7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:25.421739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8c50a9-f3d5-42d7-a1c1-7b3ee43a5c7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:25.422173 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8c50a9-f3d5-42d7-a1c1-7b3ee43a5c7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:25.422861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8c50a9-f3d5-42d7-a1c1-7b3ee43a5c7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:25.423337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8c50a9-f3d5-42d7-a1c1-7b3ee43a5c7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:25.423755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c8c50a9-f3d5-42d7-a1c1-7b3ee43a5c7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:25.453213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8c8c50a9-f3d5-42d7-a1c1-7b3ee43a5c7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Aug 24 06:25:25.453776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 586/1165] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:25 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:25.518983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-67519035-76c5-4a9c-b0a4-4070070d251b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:25.521096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-67519035-76c5-4a9c-b0a4-4070070d251b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:25.527527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67519035-76c5-4a9c-b0a4-4070070d251b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:25.528600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67519035-76c5-4a9c-b0a4-4070070d251b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:25.529027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67519035-76c5-4a9c-b0a4-4070070d251b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:25.529728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67519035-76c5-4a9c-b0a4-4070070d251b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:25.530171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67519035-76c5-4a9c-b0a4-4070070d251b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:25.530579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67519035-76c5-4a9c-b0a4-4070070d251b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:25.559605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-67519035-76c5-4a9c-b0a4-4070070d251b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044916 Aug 24 06:25:25.560164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 580/1166] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:26.465624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d2c5f34f-525e-43b9-83c6-f3dd6c967264 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:26.467820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d2c5f34f-525e-43b9-83c6-f3dd6c967264 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:26.474610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2c5f34f-525e-43b9-83c6-f3dd6c967264 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:26.480353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2c5f34f-525e-43b9-83c6-f3dd6c967264 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:26.480353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2c5f34f-525e-43b9-83c6-f3dd6c967264 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:26.480353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2c5f34f-525e-43b9-83c6-f3dd6c967264 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:26.480353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2c5f34f-525e-43b9-83c6-f3dd6c967264 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:26.481263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2c5f34f-525e-43b9-83c6-f3dd6c967264 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:26.507476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d2c5f34f-525e-43b9-83c6-f3dd6c967264 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045901 Aug 24 06:25:26.508032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 587/1167] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:26.572567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f9004268-cd6b-42e9-b8b4-b2d930b9b05e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:26.574616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f9004268-cd6b-42e9-b8b4-b2d930b9b05e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:26.581108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9004268-cd6b-42e9-b8b4-b2d930b9b05e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:26.581578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9004268-cd6b-42e9-b8b4-b2d930b9b05e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:26.582002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9004268-cd6b-42e9-b8b4-b2d930b9b05e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:26.582676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9004268-cd6b-42e9-b8b4-b2d930b9b05e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:26.583116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9004268-cd6b-42e9-b8b4-b2d930b9b05e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:26.583523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9004268-cd6b-42e9-b8b4-b2d930b9b05e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:26.613837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f9004268-cd6b-42e9-b8b4-b2d930b9b05e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045646 Aug 24 06:25:26.614375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 581/1168] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:25:27.525062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0c56e570-d81b-4e13-97a3-8dbcbbca55d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:27.527105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0c56e570-d81b-4e13-97a3-8dbcbbca55d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:27.533490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c56e570-d81b-4e13-97a3-8dbcbbca55d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:27.533969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c56e570-d81b-4e13-97a3-8dbcbbca55d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:27.534403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c56e570-d81b-4e13-97a3-8dbcbbca55d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:27.535088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c56e570-d81b-4e13-97a3-8dbcbbca55d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:27.535535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c56e570-d81b-4e13-97a3-8dbcbbca55d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:27.535952 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c56e570-d81b-4e13-97a3-8dbcbbca55d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:27.565284 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0c56e570-d81b-4e13-97a3-8dbcbbca55d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044282 Aug 24 06:25:27.565844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 588/1169] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:27.627200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-53120b8d-ba71-45db-94f1-bd40ab9b2165 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:27.629317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-53120b8d-ba71-45db-94f1-bd40ab9b2165 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:27.636046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-53120b8d-ba71-45db-94f1-bd40ab9b2165 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:27.636545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-53120b8d-ba71-45db-94f1-bd40ab9b2165 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:27.637605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-53120b8d-ba71-45db-94f1-bd40ab9b2165 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:27.638291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-53120b8d-ba71-45db-94f1-bd40ab9b2165 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:27.638733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-53120b8d-ba71-45db-94f1-bd40ab9b2165 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:27.639146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-53120b8d-ba71-45db-94f1-bd40ab9b2165 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:27.670858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-53120b8d-ba71-45db-94f1-bd40ab9b2165 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047827 Aug 24 06:25:27.671416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 582/1170] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:25:28.578117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9da6afac-462d-495e-8785-4de5192517d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:28.580150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9da6afac-462d-495e-8785-4de5192517d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:28.586598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9da6afac-462d-495e-8785-4de5192517d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:28.587064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9da6afac-462d-495e-8785-4de5192517d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:28.587535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9da6afac-462d-495e-8785-4de5192517d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:28.588210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9da6afac-462d-495e-8785-4de5192517d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:28.588689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9da6afac-462d-495e-8785-4de5192517d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:28.589119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9da6afac-462d-495e-8785-4de5192517d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:28.618676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9da6afac-462d-495e-8785-4de5192517d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 Aug 24 06:25:28.619230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 589/1171] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:28 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:28.682725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f1b74652-b3ed-4647-8160-35151d98b95e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:28.684930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f1b74652-b3ed-4647-8160-35151d98b95e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:28.692568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1b74652-b3ed-4647-8160-35151d98b95e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:28.693053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1b74652-b3ed-4647-8160-35151d98b95e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:28.693519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1b74652-b3ed-4647-8160-35151d98b95e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:28.694212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1b74652-b3ed-4647-8160-35151d98b95e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:28.694658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1b74652-b3ed-4647-8160-35151d98b95e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:28.695074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1b74652-b3ed-4647-8160-35151d98b95e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:28.698896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:25:28.725224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f1b74652-b3ed-4647-8160-35151d98b95e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046634 Aug 24 06:25:28.725964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 583/1172] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:28 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:29.631316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-00aa880c-bdda-4f8e-a812-141d39de2d3b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:29.633380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-00aa880c-bdda-4f8e-a812-141d39de2d3b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:29.639775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00aa880c-bdda-4f8e-a812-141d39de2d3b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:29.640243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00aa880c-bdda-4f8e-a812-141d39de2d3b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:29.640704 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00aa880c-bdda-4f8e-a812-141d39de2d3b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:29.641470 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00aa880c-bdda-4f8e-a812-141d39de2d3b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:29.641915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00aa880c-bdda-4f8e-a812-141d39de2d3b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:29.642331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-00aa880c-bdda-4f8e-a812-141d39de2d3b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:29.659756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:25:29.672812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-00aa880c-bdda-4f8e-a812-141d39de2d3b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045535 Aug 24 06:25:29.677076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 590/1173] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:29.738145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e8e147ea-16d6-4d45-9454-58f601a67869 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:29.740232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e8e147ea-16d6-4d45-9454-58f601a67869 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:29.746671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8e147ea-16d6-4d45-9454-58f601a67869 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:29.747151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8e147ea-16d6-4d45-9454-58f601a67869 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:29.747615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8e147ea-16d6-4d45-9454-58f601a67869 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:29.748304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8e147ea-16d6-4d45-9454-58f601a67869 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:29.748788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8e147ea-16d6-4d45-9454-58f601a67869 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:29.749215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8e147ea-16d6-4d45-9454-58f601a67869 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:29.780644 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e8e147ea-16d6-4d45-9454-58f601a67869 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046798 Aug 24 06:25:29.781201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 584/1174] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:29 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:30.688711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d6b13310-195c-4ab0-b5e2-e7b481dd03cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:30.690957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d6b13310-195c-4ab0-b5e2-e7b481dd03cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:30.697489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6b13310-195c-4ab0-b5e2-e7b481dd03cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:30.697965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6b13310-195c-4ab0-b5e2-e7b481dd03cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:30.698391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6b13310-195c-4ab0-b5e2-e7b481dd03cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:30.699075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6b13310-195c-4ab0-b5e2-e7b481dd03cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:30.700169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6b13310-195c-4ab0-b5e2-e7b481dd03cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:30.700619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6b13310-195c-4ab0-b5e2-e7b481dd03cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:30.729807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d6b13310-195c-4ab0-b5e2-e7b481dd03cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045893 Aug 24 06:25:30.730844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 591/1175] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:30.792335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a4c15454-729b-40b7-b5ad-c98c105c4e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:30.795072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a4c15454-729b-40b7-b5ad-c98c105c4e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:30.801540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4c15454-729b-40b7-b5ad-c98c105c4e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:30.802020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4c15454-729b-40b7-b5ad-c98c105c4e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:30.802448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4c15454-729b-40b7-b5ad-c98c105c4e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:30.803160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4c15454-729b-40b7-b5ad-c98c105c4e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:30.803608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4c15454-729b-40b7-b5ad-c98c105c4e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:30.804026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4c15454-729b-40b7-b5ad-c98c105c4e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:30.833423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a4c15454-729b-40b7-b5ad-c98c105c4e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045082 Aug 24 06:25:30.833974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 585/1176] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:31.741914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ad328189-4e80-40c3-8f64-c431002ce104 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:31.744063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ad328189-4e80-40c3-8f64-c431002ce104 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:31.750561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad328189-4e80-40c3-8f64-c431002ce104 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:31.751031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad328189-4e80-40c3-8f64-c431002ce104 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:31.751458 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad328189-4e80-40c3-8f64-c431002ce104 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:31.752133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad328189-4e80-40c3-8f64-c431002ce104 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:31.752613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad328189-4e80-40c3-8f64-c431002ce104 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:31.753037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad328189-4e80-40c3-8f64-c431002ce104 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:31.782353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ad328189-4e80-40c3-8f64-c431002ce104 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Aug 24 06:25:31.782899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 592/1177] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:31 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:31.845898 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ec3eb02e-8014-4840-8486-6b8b8d6f7818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:31.847991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ec3eb02e-8014-4840-8486-6b8b8d6f7818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:31.854464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec3eb02e-8014-4840-8486-6b8b8d6f7818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:31.854937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec3eb02e-8014-4840-8486-6b8b8d6f7818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:31.855392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec3eb02e-8014-4840-8486-6b8b8d6f7818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:31.856072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec3eb02e-8014-4840-8486-6b8b8d6f7818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:31.856536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec3eb02e-8014-4840-8486-6b8b8d6f7818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:31.856954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec3eb02e-8014-4840-8486-6b8b8d6f7818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:31.885960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ec3eb02e-8014-4840-8486-6b8b8d6f7818 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044000 Aug 24 06:25:31.886501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 586/1178] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:32.794907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-aa9e671f-a4d5-4e4a-8a47-ed70007bff26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:32.797087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-aa9e671f-a4d5-4e4a-8a47-ed70007bff26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:32.803424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa9e671f-a4d5-4e4a-8a47-ed70007bff26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:32.803904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa9e671f-a4d5-4e4a-8a47-ed70007bff26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:32.804350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa9e671f-a4d5-4e4a-8a47-ed70007bff26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:32.805066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa9e671f-a4d5-4e4a-8a47-ed70007bff26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:32.805516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa9e671f-a4d5-4e4a-8a47-ed70007bff26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:32.806196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa9e671f-a4d5-4e4a-8a47-ed70007bff26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:32.834721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-aa9e671f-a4d5-4e4a-8a47-ed70007bff26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044458 Aug 24 06:25:32.835274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 593/1179] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:32.899202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3c9bb8e3-e672-49ac-958d-e5b836d13188 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:32.901325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3c9bb8e3-e672-49ac-958d-e5b836d13188 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:32.908048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9bb8e3-e672-49ac-958d-e5b836d13188 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:32.908536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9bb8e3-e672-49ac-958d-e5b836d13188 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:32.908962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9bb8e3-e672-49ac-958d-e5b836d13188 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:32.909634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9bb8e3-e672-49ac-958d-e5b836d13188 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:32.910078 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9bb8e3-e672-49ac-958d-e5b836d13188 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:32.910492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3c9bb8e3-e672-49ac-958d-e5b836d13188 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:32.939662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3c9bb8e3-e672-49ac-958d-e5b836d13188 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044802 Aug 24 06:25:32.940210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 587/1180] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:33.847054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-caa86313-85fd-440b-a6d2-60f0b72550a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:33.849228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-caa86313-85fd-440b-a6d2-60f0b72550a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:33.855650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-caa86313-85fd-440b-a6d2-60f0b72550a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:33.856125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-caa86313-85fd-440b-a6d2-60f0b72550a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:33.859689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-caa86313-85fd-440b-a6d2-60f0b72550a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:33.860034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-caa86313-85fd-440b-a6d2-60f0b72550a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:33.860514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-caa86313-85fd-440b-a6d2-60f0b72550a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:33.860946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-caa86313-85fd-440b-a6d2-60f0b72550a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:33.889931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-caa86313-85fd-440b-a6d2-60f0b72550a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046869 Aug 24 06:25:33.890462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 594/1181] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:33.951461 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-48b427d0-c1f9-4d9a-8687-b327e714d2b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:33.953611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-48b427d0-c1f9-4d9a-8687-b327e714d2b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:33.960041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48b427d0-c1f9-4d9a-8687-b327e714d2b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:33.960538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48b427d0-c1f9-4d9a-8687-b327e714d2b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:33.960968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48b427d0-c1f9-4d9a-8687-b327e714d2b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:33.962494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48b427d0-c1f9-4d9a-8687-b327e714d2b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:33.963288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48b427d0-c1f9-4d9a-8687-b327e714d2b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:33.963713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48b427d0-c1f9-4d9a-8687-b327e714d2b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:33.993044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-48b427d0-c1f9-4d9a-8687-b327e714d2b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045561 Aug 24 06:25:33.993598 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 588/1182] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:34.901906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d5f5e029-86cd-437e-afa2-ec231511f197 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:34.904004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d5f5e029-86cd-437e-afa2-ec231511f197 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:34.910366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5f5e029-86cd-437e-afa2-ec231511f197 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:34.910838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5f5e029-86cd-437e-afa2-ec231511f197 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:34.911262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5f5e029-86cd-437e-afa2-ec231511f197 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:34.911938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5f5e029-86cd-437e-afa2-ec231511f197 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:34.912380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5f5e029-86cd-437e-afa2-ec231511f197 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:34.912819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5f5e029-86cd-437e-afa2-ec231511f197 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:34.941967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d5f5e029-86cd-437e-afa2-ec231511f197 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044037 Aug 24 06:25:34.942524 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 595/1183] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:34 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:35.005230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-74e3d1c3-ad84-49fe-8118-fc15a9024527 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:35.007319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-74e3d1c3-ad84-49fe-8118-fc15a9024527 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:35.014288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74e3d1c3-ad84-49fe-8118-fc15a9024527 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:35.014757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74e3d1c3-ad84-49fe-8118-fc15a9024527 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:35.015181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74e3d1c3-ad84-49fe-8118-fc15a9024527 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:35.015886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74e3d1c3-ad84-49fe-8118-fc15a9024527 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:35.016323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74e3d1c3-ad84-49fe-8118-fc15a9024527 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:35.016762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-74e3d1c3-ad84-49fe-8118-fc15a9024527 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:35.044807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-74e3d1c3-ad84-49fe-8118-fc15a9024527 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043549 Aug 24 06:25:35.045350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 589/1184] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:35.954562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-47cb69a2-2aaa-4a13-819d-61482931d4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:35.956601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-47cb69a2-2aaa-4a13-819d-61482931d4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:35.963018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47cb69a2-2aaa-4a13-819d-61482931d4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:35.963494 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47cb69a2-2aaa-4a13-819d-61482931d4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:35.963925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47cb69a2-2aaa-4a13-819d-61482931d4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:35.964648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47cb69a2-2aaa-4a13-819d-61482931d4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:35.965098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47cb69a2-2aaa-4a13-819d-61482931d4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:35.965518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47cb69a2-2aaa-4a13-819d-61482931d4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:35.995143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-47cb69a2-2aaa-4a13-819d-61482931d4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045127 Aug 24 06:25:35.995706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 596/1185] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:36.057518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-819d8183-7d0e-46d1-aa64-3ad6ab443d7d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:36.059744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-819d8183-7d0e-46d1-aa64-3ad6ab443d7d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:36.066158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819d8183-7d0e-46d1-aa64-3ad6ab443d7d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:36.066633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819d8183-7d0e-46d1-aa64-3ad6ab443d7d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:36.067062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819d8183-7d0e-46d1-aa64-3ad6ab443d7d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:36.067743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819d8183-7d0e-46d1-aa64-3ad6ab443d7d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:36.068190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819d8183-7d0e-46d1-aa64-3ad6ab443d7d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:36.068638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-819d8183-7d0e-46d1-aa64-3ad6ab443d7d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:36.098151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-819d8183-7d0e-46d1-aa64-3ad6ab443d7d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044889 Aug 24 06:25:36.098715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 590/1186] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:37.008025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2af1ca6b-e9d8-44fd-a575-4dd8e488f2ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:37.010222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2af1ca6b-e9d8-44fd-a575-4dd8e488f2ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:37.017335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2af1ca6b-e9d8-44fd-a575-4dd8e488f2ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:37.017854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2af1ca6b-e9d8-44fd-a575-4dd8e488f2ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:37.018340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2af1ca6b-e9d8-44fd-a575-4dd8e488f2ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:37.019251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2af1ca6b-e9d8-44fd-a575-4dd8e488f2ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:37.019834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2af1ca6b-e9d8-44fd-a575-4dd8e488f2ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:37.020404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2af1ca6b-e9d8-44fd-a575-4dd8e488f2ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:37.051107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2af1ca6b-e9d8-44fd-a575-4dd8e488f2ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047434 Aug 24 06:25:37.051694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 597/1187] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:37.110327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c06edd13-7122-4b96-9c5f-67caae17287f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:37.112446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c06edd13-7122-4b96-9c5f-67caae17287f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:37.119288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c06edd13-7122-4b96-9c5f-67caae17287f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:37.119767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c06edd13-7122-4b96-9c5f-67caae17287f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:37.120192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c06edd13-7122-4b96-9c5f-67caae17287f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:37.120938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c06edd13-7122-4b96-9c5f-67caae17287f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:37.121381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c06edd13-7122-4b96-9c5f-67caae17287f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:37.121797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c06edd13-7122-4b96-9c5f-67caae17287f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:37.150119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c06edd13-7122-4b96-9c5f-67caae17287f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044454 Aug 24 06:25:37.150666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 591/1188] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:38.064118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b518f245-9e54-4e6f-890d-1ac118085674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:38.066207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b518f245-9e54-4e6f-890d-1ac118085674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:38.072741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b518f245-9e54-4e6f-890d-1ac118085674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:38.073220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b518f245-9e54-4e6f-890d-1ac118085674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:38.073650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b518f245-9e54-4e6f-890d-1ac118085674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:38.074340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b518f245-9e54-4e6f-890d-1ac118085674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:38.074784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b518f245-9e54-4e6f-890d-1ac118085674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:38.075198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b518f245-9e54-4e6f-890d-1ac118085674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:38.105460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b518f245-9e54-4e6f-890d-1ac118085674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Aug 24 06:25:38.106013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 598/1189] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:38 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:38.162608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1dd087c5-1a57-4702-bb1c-45ebbd4d57e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:38.164732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1dd087c5-1a57-4702-bb1c-45ebbd4d57e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:38.171826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1dd087c5-1a57-4702-bb1c-45ebbd4d57e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:38.172299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1dd087c5-1a57-4702-bb1c-45ebbd4d57e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:38.172758 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1dd087c5-1a57-4702-bb1c-45ebbd4d57e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:38.173445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1dd087c5-1a57-4702-bb1c-45ebbd4d57e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:38.173889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1dd087c5-1a57-4702-bb1c-45ebbd4d57e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:38.174301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1dd087c5-1a57-4702-bb1c-45ebbd4d57e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:38.204117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1dd087c5-1a57-4702-bb1c-45ebbd4d57e8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045478 Aug 24 06:25:38.204708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 592/1190] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:39.118307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-197a6191-e7ca-4292-9d61-30549c345a7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:39.120587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-197a6191-e7ca-4292-9d61-30549c345a7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:39.127133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-197a6191-e7ca-4292-9d61-30549c345a7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:39.127602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-197a6191-e7ca-4292-9d61-30549c345a7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:39.128028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-197a6191-e7ca-4292-9d61-30549c345a7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:39.128749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-197a6191-e7ca-4292-9d61-30549c345a7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:39.129190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-197a6191-e7ca-4292-9d61-30549c345a7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:39.129609 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-197a6191-e7ca-4292-9d61-30549c345a7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:39.159818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-197a6191-e7ca-4292-9d61-30549c345a7f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045794 Aug 24 06:25:39.160379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 599/1191] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:39 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:39.217356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c3a42649-9258-4c4b-b6ab-4c83c75d1b34 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:39.219470 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c3a42649-9258-4c4b-b6ab-4c83c75d1b34 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:39.226116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3a42649-9258-4c4b-b6ab-4c83c75d1b34 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:39.226596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3a42649-9258-4c4b-b6ab-4c83c75d1b34 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:39.227023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3a42649-9258-4c4b-b6ab-4c83c75d1b34 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:39.227712 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3a42649-9258-4c4b-b6ab-4c83c75d1b34 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:39.228202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3a42649-9258-4c4b-b6ab-4c83c75d1b34 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:39.228662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3a42649-9258-4c4b-b6ab-4c83c75d1b34 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:39.258029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c3a42649-9258-4c4b-b6ab-4c83c75d1b34 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045392 Aug 24 06:25:39.258592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 593/1192] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:40.172471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a0553306-2a33-4d1b-a1c2-1061a775acbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:40.174955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a0553306-2a33-4d1b-a1c2-1061a775acbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:40.181667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0553306-2a33-4d1b-a1c2-1061a775acbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:40.182131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0553306-2a33-4d1b-a1c2-1061a775acbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:40.182553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0553306-2a33-4d1b-a1c2-1061a775acbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:40.183240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0553306-2a33-4d1b-a1c2-1061a775acbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:40.183681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0553306-2a33-4d1b-a1c2-1061a775acbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:40.184095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0553306-2a33-4d1b-a1c2-1061a775acbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:40.213435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a0553306-2a33-4d1b-a1c2-1061a775acbf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Aug 24 06:25:40.213995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 600/1193] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:40 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:40.269906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b26325f2-cb64-47af-afd4-29e0134adb11 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:40.271943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b26325f2-cb64-47af-afd4-29e0134adb11 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:40.278443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26325f2-cb64-47af-afd4-29e0134adb11 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:40.280385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26325f2-cb64-47af-afd4-29e0134adb11 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:40.280844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26325f2-cb64-47af-afd4-29e0134adb11 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:40.281548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26325f2-cb64-47af-afd4-29e0134adb11 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:40.281997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26325f2-cb64-47af-afd4-29e0134adb11 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:40.282413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26325f2-cb64-47af-afd4-29e0134adb11 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:40.313844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b26325f2-cb64-47af-afd4-29e0134adb11 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047995 Aug 24 06:25:40.314407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 594/1194] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:41.225939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1a6a9b76-7ff1-485b-a97f-61d8ea81a36f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:41.228031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1a6a9b76-7ff1-485b-a97f-61d8ea81a36f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:41.235400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a6a9b76-7ff1-485b-a97f-61d8ea81a36f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:41.235883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a6a9b76-7ff1-485b-a97f-61d8ea81a36f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:41.236316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a6a9b76-7ff1-485b-a97f-61d8ea81a36f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:41.237062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a6a9b76-7ff1-485b-a97f-61d8ea81a36f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:41.237516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a6a9b76-7ff1-485b-a97f-61d8ea81a36f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:41.237942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1a6a9b76-7ff1-485b-a97f-61d8ea81a36f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:41.268471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1a6a9b76-7ff1-485b-a97f-61d8ea81a36f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046546 Aug 24 06:25:41.269053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 601/1195] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:41 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:41.326446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-41ff06f7-cf69-47e2-b7f1-4898c981f81f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:41.328616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-41ff06f7-cf69-47e2-b7f1-4898c981f81f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:41.335051 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41ff06f7-cf69-47e2-b7f1-4898c981f81f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:41.335525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41ff06f7-cf69-47e2-b7f1-4898c981f81f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:41.335959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41ff06f7-cf69-47e2-b7f1-4898c981f81f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:41.336684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41ff06f7-cf69-47e2-b7f1-4898c981f81f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:41.337132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41ff06f7-cf69-47e2-b7f1-4898c981f81f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:41.337550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41ff06f7-cf69-47e2-b7f1-4898c981f81f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:41.367655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-41ff06f7-cf69-47e2-b7f1-4898c981f81f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045275 Aug 24 06:25:41.368211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 595/1196] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:41 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:42.281739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cd27b189-77c8-4851-a24c-1a97e5ad14fe tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:42.283812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cd27b189-77c8-4851-a24c-1a97e5ad14fe tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:42.286237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=60 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:25:42.290951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd27b189-77c8-4851-a24c-1a97e5ad14fe tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:42.291426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd27b189-77c8-4851-a24c-1a97e5ad14fe tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:42.291854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd27b189-77c8-4851-a24c-1a97e5ad14fe tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:42.292563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd27b189-77c8-4851-a24c-1a97e5ad14fe tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:42.293007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd27b189-77c8-4851-a24c-1a97e5ad14fe tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:42.293423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd27b189-77c8-4851-a24c-1a97e5ad14fe tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:42.324771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cd27b189-77c8-4851-a24c-1a97e5ad14fe tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047763 Aug 24 06:25:42.325326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 602/1197] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:42 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:42.379855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-58f90fdf-f7f6-40e5-aa76-d0e58e99dae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:42.382008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-58f90fdf-f7f6-40e5-aa76-d0e58e99dae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:42.389380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58f90fdf-f7f6-40e5-aa76-d0e58e99dae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:42.389869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58f90fdf-f7f6-40e5-aa76-d0e58e99dae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:42.390301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58f90fdf-f7f6-40e5-aa76-d0e58e99dae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:42.390996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58f90fdf-f7f6-40e5-aa76-d0e58e99dae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:42.391449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58f90fdf-f7f6-40e5-aa76-d0e58e99dae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:42.391870 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58f90fdf-f7f6-40e5-aa76-d0e58e99dae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:42.423575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-58f90fdf-f7f6-40e5-aa76-d0e58e99dae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047660 Aug 24 06:25:42.424158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 596/1198] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:43.338150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a2da9db3-ba1b-4fee-834b-9a65f5f75a86 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:43.342513 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a2da9db3-ba1b-4fee-834b-9a65f5f75a86 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:43.347530 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a2da9db3-ba1b-4fee-834b-9a65f5f75a86 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:43.348011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a2da9db3-ba1b-4fee-834b-9a65f5f75a86 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:43.348443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a2da9db3-ba1b-4fee-834b-9a65f5f75a86 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:43.349158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a2da9db3-ba1b-4fee-834b-9a65f5f75a86 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:43.349604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a2da9db3-ba1b-4fee-834b-9a65f5f75a86 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:43.350027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a2da9db3-ba1b-4fee-834b-9a65f5f75a86 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:43.380881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a2da9db3-ba1b-4fee-834b-9a65f5f75a86 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046695 Aug 24 06:25:43.381352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 603/1199] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:43 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:43.435787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dee7fddb-0ad9-48af-b660-41e315828e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:43.438002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dee7fddb-0ad9-48af-b660-41e315828e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:43.444375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dee7fddb-0ad9-48af-b660-41e315828e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:43.444882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dee7fddb-0ad9-48af-b660-41e315828e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:43.445318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dee7fddb-0ad9-48af-b660-41e315828e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:43.446000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dee7fddb-0ad9-48af-b660-41e315828e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:43.446443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dee7fddb-0ad9-48af-b660-41e315828e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:43.446857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dee7fddb-0ad9-48af-b660-41e315828e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:43.477197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dee7fddb-0ad9-48af-b660-41e315828e5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045456 Aug 24 06:25:43.478517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 597/1200] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:44.393280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-020d03ce-e97c-434c-8dc3-7ababb3fa6c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:44.395385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-020d03ce-e97c-434c-8dc3-7ababb3fa6c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:44.401854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-020d03ce-e97c-434c-8dc3-7ababb3fa6c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:44.402328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-020d03ce-e97c-434c-8dc3-7ababb3fa6c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:44.402766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-020d03ce-e97c-434c-8dc3-7ababb3fa6c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:44.403459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-020d03ce-e97c-434c-8dc3-7ababb3fa6c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:44.403907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-020d03ce-e97c-434c-8dc3-7ababb3fa6c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:44.404375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-020d03ce-e97c-434c-8dc3-7ababb3fa6c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:44.434504 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-020d03ce-e97c-434c-8dc3-7ababb3fa6c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045220 Aug 24 06:25:44.435821 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 604/1201] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:44 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:44.489593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9a1a4c49-6bed-44b7-b1f3-30ed49557dea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:44.491821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9a1a4c49-6bed-44b7-b1f3-30ed49557dea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:44.498961 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a1a4c49-6bed-44b7-b1f3-30ed49557dea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:44.499432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a1a4c49-6bed-44b7-b1f3-30ed49557dea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:44.499857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a1a4c49-6bed-44b7-b1f3-30ed49557dea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:44.500590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a1a4c49-6bed-44b7-b1f3-30ed49557dea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:44.501045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a1a4c49-6bed-44b7-b1f3-30ed49557dea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:44.501456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a1a4c49-6bed-44b7-b1f3-30ed49557dea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:44.533023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9a1a4c49-6bed-44b7-b1f3-30ed49557dea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047261 Aug 24 06:25:44.533590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 598/1202] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:45.450413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-40355c11-6dc9-4d9f-ae42-27dab9f8431d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:45.452451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-40355c11-6dc9-4d9f-ae42-27dab9f8431d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:45.459084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40355c11-6dc9-4d9f-ae42-27dab9f8431d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:45.459555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40355c11-6dc9-4d9f-ae42-27dab9f8431d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:45.459983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40355c11-6dc9-4d9f-ae42-27dab9f8431d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:45.460708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40355c11-6dc9-4d9f-ae42-27dab9f8431d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:45.461180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40355c11-6dc9-4d9f-ae42-27dab9f8431d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:45.461602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40355c11-6dc9-4d9f-ae42-27dab9f8431d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:45.492568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-40355c11-6dc9-4d9f-ae42-27dab9f8431d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046121 Aug 24 06:25:45.493134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 605/1203] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:45 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:45.545955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-83041c5b-1141-48f1-b3d8-a9942182cfe9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:45.548048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-83041c5b-1141-48f1-b3d8-a9942182cfe9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:45.554563 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83041c5b-1141-48f1-b3d8-a9942182cfe9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:45.555034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83041c5b-1141-48f1-b3d8-a9942182cfe9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:45.555454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83041c5b-1141-48f1-b3d8-a9942182cfe9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:45.556389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83041c5b-1141-48f1-b3d8-a9942182cfe9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:45.556854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83041c5b-1141-48f1-b3d8-a9942182cfe9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:45.557265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83041c5b-1141-48f1-b3d8-a9942182cfe9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:45.581018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:25:45.585675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-83041c5b-1141-48f1-b3d8-a9942182cfe9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044209 Aug 24 06:25:45.586452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 599/1204] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:46.506435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ee066353-b070-4e84-ac31-8f6f88050fe5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:46.508596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ee066353-b070-4e84-ac31-8f6f88050fe5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:46.514956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee066353-b070-4e84-ac31-8f6f88050fe5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:46.515427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee066353-b070-4e84-ac31-8f6f88050fe5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:46.515871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee066353-b070-4e84-ac31-8f6f88050fe5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:46.516572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee066353-b070-4e84-ac31-8f6f88050fe5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:46.516999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee066353-b070-4e84-ac31-8f6f88050fe5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:46.517414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee066353-b070-4e84-ac31-8f6f88050fe5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:46.547832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ee066353-b070-4e84-ac31-8f6f88050fe5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045409 Aug 24 06:25:46.548386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 606/1205] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:46.600781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-48c35f25-9b76-4c82-8950-be5d13bb91a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:46.602889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-48c35f25-9b76-4c82-8950-be5d13bb91a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:46.610596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48c35f25-9b76-4c82-8950-be5d13bb91a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:46.611069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48c35f25-9b76-4c82-8950-be5d13bb91a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:46.611503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48c35f25-9b76-4c82-8950-be5d13bb91a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:46.612188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48c35f25-9b76-4c82-8950-be5d13bb91a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:46.612670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48c35f25-9b76-4c82-8950-be5d13bb91a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:46.613090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-48c35f25-9b76-4c82-8950-be5d13bb91a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:46.642552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-48c35f25-9b76-4c82-8950-be5d13bb91a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046063 Aug 24 06:25:46.643106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 600/1206] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:47.560990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-604ea956-3b52-4dc2-b3a8-f2e2152b0461 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:47.563062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-604ea956-3b52-4dc2-b3a8-f2e2152b0461 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:47.568970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-604ea956-3b52-4dc2-b3a8-f2e2152b0461 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:47.569436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-604ea956-3b52-4dc2-b3a8-f2e2152b0461 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:47.569868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-604ea956-3b52-4dc2-b3a8-f2e2152b0461 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:47.570549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-604ea956-3b52-4dc2-b3a8-f2e2152b0461 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:47.570996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-604ea956-3b52-4dc2-b3a8-f2e2152b0461 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:47.571416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-604ea956-3b52-4dc2-b3a8-f2e2152b0461 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:47.574964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:25:47.600775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-604ea956-3b52-4dc2-b3a8-f2e2152b0461 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044710 Aug 24 06:25:47.601335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 607/1207] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:47.655182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-755d42f2-02fa-4fd3-bca8-de944b6297be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:47.657372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-755d42f2-02fa-4fd3-bca8-de944b6297be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:47.663725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-755d42f2-02fa-4fd3-bca8-de944b6297be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:47.664201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-755d42f2-02fa-4fd3-bca8-de944b6297be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:47.664682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-755d42f2-02fa-4fd3-bca8-de944b6297be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:47.665365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-755d42f2-02fa-4fd3-bca8-de944b6297be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:47.665821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-755d42f2-02fa-4fd3-bca8-de944b6297be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:47.666240 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-755d42f2-02fa-4fd3-bca8-de944b6297be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:47.695861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-755d42f2-02fa-4fd3-bca8-de944b6297be tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044577 Aug 24 06:25:47.696400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 601/1208] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:48.614687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4b92e8e0-3bd4-40c1-910f-250c45ef65fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:48.616799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4b92e8e0-3bd4-40c1-910f-250c45ef65fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:48.623423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b92e8e0-3bd4-40c1-910f-250c45ef65fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:48.623902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b92e8e0-3bd4-40c1-910f-250c45ef65fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:48.624337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b92e8e0-3bd4-40c1-910f-250c45ef65fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:48.625067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b92e8e0-3bd4-40c1-910f-250c45ef65fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:48.625531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b92e8e0-3bd4-40c1-910f-250c45ef65fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:48.625958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b92e8e0-3bd4-40c1-910f-250c45ef65fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:48.657288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4b92e8e0-3bd4-40c1-910f-250c45ef65fc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047068 Aug 24 06:25:48.657859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 608/1209] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:48.711099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-41444e4e-4359-477d-bdc7-0b4c743da633 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:48.713316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-41444e4e-4359-477d-bdc7-0b4c743da633 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:48.720443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41444e4e-4359-477d-bdc7-0b4c743da633 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:48.720945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41444e4e-4359-477d-bdc7-0b4c743da633 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:48.721428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41444e4e-4359-477d-bdc7-0b4c743da633 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:48.722118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41444e4e-4359-477d-bdc7-0b4c743da633 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:48.722559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41444e4e-4359-477d-bdc7-0b4c743da633 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:48.722982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41444e4e-4359-477d-bdc7-0b4c743da633 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:48.752402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-41444e4e-4359-477d-bdc7-0b4c743da633 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046599 Aug 24 06:25:48.752992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 602/1210] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:49.671207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4812e3be-cf12-471a-b75a-a55b507b8cdc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:49.673374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4812e3be-cf12-471a-b75a-a55b507b8cdc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:49.679926 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4812e3be-cf12-471a-b75a-a55b507b8cdc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:49.680339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4812e3be-cf12-471a-b75a-a55b507b8cdc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:49.680813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4812e3be-cf12-471a-b75a-a55b507b8cdc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:49.681758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4812e3be-cf12-471a-b75a-a55b507b8cdc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:49.682235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4812e3be-cf12-471a-b75a-a55b507b8cdc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:49.682667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4812e3be-cf12-471a-b75a-a55b507b8cdc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:49.713504 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4812e3be-cf12-471a-b75a-a55b507b8cdc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046765 Aug 24 06:25:49.714076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 609/1211] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:49 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:49.765444 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0e660c96-2479-4ba3-a1e5-2dcbd7a1f95b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:49.767525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0e660c96-2479-4ba3-a1e5-2dcbd7a1f95b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:49.774700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e660c96-2479-4ba3-a1e5-2dcbd7a1f95b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:49.774700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e660c96-2479-4ba3-a1e5-2dcbd7a1f95b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:49.775278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e660c96-2479-4ba3-a1e5-2dcbd7a1f95b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:49.775811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e660c96-2479-4ba3-a1e5-2dcbd7a1f95b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:49.776255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e660c96-2479-4ba3-a1e5-2dcbd7a1f95b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:49.776699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e660c96-2479-4ba3-a1e5-2dcbd7a1f95b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:49.808022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0e660c96-2479-4ba3-a1e5-2dcbd7a1f95b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046621 Aug 24 06:25:49.808602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 603/1212] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:50.727375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-745c624f-5a45-4b52-ba20-376bd7478a6d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:50.729888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-745c624f-5a45-4b52-ba20-376bd7478a6d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:50.736793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-745c624f-5a45-4b52-ba20-376bd7478a6d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:50.737220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-745c624f-5a45-4b52-ba20-376bd7478a6d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:50.737651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-745c624f-5a45-4b52-ba20-376bd7478a6d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:50.738338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-745c624f-5a45-4b52-ba20-376bd7478a6d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:50.738778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-745c624f-5a45-4b52-ba20-376bd7478a6d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:50.739199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-745c624f-5a45-4b52-ba20-376bd7478a6d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:50.769625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-745c624f-5a45-4b52-ba20-376bd7478a6d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047274 Aug 24 06:25:50.770188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 610/1213] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:50.820712 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7dbcd1f2-0242-459f-b662-38d17ca36181 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:50.822841 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7dbcd1f2-0242-459f-b662-38d17ca36181 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:50.829887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7dbcd1f2-0242-459f-b662-38d17ca36181 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:50.830355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7dbcd1f2-0242-459f-b662-38d17ca36181 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:50.830779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7dbcd1f2-0242-459f-b662-38d17ca36181 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:50.831462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7dbcd1f2-0242-459f-b662-38d17ca36181 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:50.831903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7dbcd1f2-0242-459f-b662-38d17ca36181 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:50.832316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7dbcd1f2-0242-459f-b662-38d17ca36181 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:50.861640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7dbcd1f2-0242-459f-b662-38d17ca36181 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044900 Aug 24 06:25:50.862298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 604/1214] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:51.783483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5cbe042d-be69-4b78-93ca-e8b47c0cc545 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:51.785943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5cbe042d-be69-4b78-93ca-e8b47c0cc545 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:51.793002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbe042d-be69-4b78-93ca-e8b47c0cc545 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:51.794331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbe042d-be69-4b78-93ca-e8b47c0cc545 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:51.794331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbe042d-be69-4b78-93ca-e8b47c0cc545 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:51.794901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbe042d-be69-4b78-93ca-e8b47c0cc545 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:51.795411 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbe042d-be69-4b78-93ca-e8b47c0cc545 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:51.796004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbe042d-be69-4b78-93ca-e8b47c0cc545 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:51.834330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5cbe042d-be69-4b78-93ca-e8b47c0cc545 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056247 Aug 24 06:25:51.835325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 611/1215] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:51.874585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-22492a39-8665-45cf-9847-cad5c0eb97f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:51.876925 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-22492a39-8665-45cf-9847-cad5c0eb97f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:51.883545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22492a39-8665-45cf-9847-cad5c0eb97f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:51.884026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22492a39-8665-45cf-9847-cad5c0eb97f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:51.884465 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22492a39-8665-45cf-9847-cad5c0eb97f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:51.885196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22492a39-8665-45cf-9847-cad5c0eb97f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:51.885676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22492a39-8665-45cf-9847-cad5c0eb97f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:51.886092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22492a39-8665-45cf-9847-cad5c0eb97f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:51.920037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-22492a39-8665-45cf-9847-cad5c0eb97f7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049466 Aug 24 06:25:51.921699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 605/1216] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:51 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:52.848084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f78fe515-b2b1-40b7-b78e-57669543c1fa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:52.850281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f78fe515-b2b1-40b7-b78e-57669543c1fa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:52.857498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f78fe515-b2b1-40b7-b78e-57669543c1fa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:52.857910 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f78fe515-b2b1-40b7-b78e-57669543c1fa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:52.858338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f78fe515-b2b1-40b7-b78e-57669543c1fa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:52.859031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f78fe515-b2b1-40b7-b78e-57669543c1fa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:52.859476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f78fe515-b2b1-40b7-b78e-57669543c1fa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:52.859893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f78fe515-b2b1-40b7-b78e-57669543c1fa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:52.890939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f78fe515-b2b1-40b7-b78e-57669543c1fa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046845 Aug 24 06:25:52.891523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 612/1217] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:52 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:52.934435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-326f3727-52db-42cb-89d9-4bc4c884465a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:52.936606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-326f3727-52db-42cb-89d9-4bc4c884465a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:52.942604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-326f3727-52db-42cb-89d9-4bc4c884465a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:52.943083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-326f3727-52db-42cb-89d9-4bc4c884465a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:52.943513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-326f3727-52db-42cb-89d9-4bc4c884465a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:52.944205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-326f3727-52db-42cb-89d9-4bc4c884465a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:52.944697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-326f3727-52db-42cb-89d9-4bc4c884465a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:52.945114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-326f3727-52db-42cb-89d9-4bc4c884465a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:52.974933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-326f3727-52db-42cb-89d9-4bc4c884465a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045232 Aug 24 06:25:52.975497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 606/1218] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:53.903542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bdba995e-fa3f-4e88-a03d-a19b8cd3264d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:53.905651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bdba995e-fa3f-4e88-a03d-a19b8cd3264d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:53.912048 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdba995e-fa3f-4e88-a03d-a19b8cd3264d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:53.912559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdba995e-fa3f-4e88-a03d-a19b8cd3264d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:53.912995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdba995e-fa3f-4e88-a03d-a19b8cd3264d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:53.913683 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdba995e-fa3f-4e88-a03d-a19b8cd3264d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:53.914129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdba995e-fa3f-4e88-a03d-a19b8cd3264d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:53.914547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bdba995e-fa3f-4e88-a03d-a19b8cd3264d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:53.944242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bdba995e-fa3f-4e88-a03d-a19b8cd3264d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Aug 24 06:25:53.944825 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 613/1219] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:53.988210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-badc6a65-ce5f-475a-b560-2172eda2753d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:53.990368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-badc6a65-ce5f-475a-b560-2172eda2753d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:53.992648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=60 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:25:53.997895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-badc6a65-ce5f-475a-b560-2172eda2753d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:54.008082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-badc6a65-ce5f-475a-b560-2172eda2753d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:54.008082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-badc6a65-ce5f-475a-b560-2172eda2753d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:54.008082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-badc6a65-ce5f-475a-b560-2172eda2753d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:54.008082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-badc6a65-ce5f-475a-b560-2172eda2753d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:54.008459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-badc6a65-ce5f-475a-b560-2172eda2753d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:54.029788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-badc6a65-ce5f-475a-b560-2172eda2753d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045606 Aug 24 06:25:54.030351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 607/1220] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:54.957332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-05c59f28-9edc-46eb-a42a-1d8cd78507c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:54.959505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-05c59f28-9edc-46eb-a42a-1d8cd78507c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:54.966500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05c59f28-9edc-46eb-a42a-1d8cd78507c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:54.966973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05c59f28-9edc-46eb-a42a-1d8cd78507c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:54.967403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05c59f28-9edc-46eb-a42a-1d8cd78507c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:54.968086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05c59f28-9edc-46eb-a42a-1d8cd78507c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:54.968556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05c59f28-9edc-46eb-a42a-1d8cd78507c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:54.968982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05c59f28-9edc-46eb-a42a-1d8cd78507c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:54.997728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-05c59f28-9edc-46eb-a42a-1d8cd78507c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044141 Aug 24 06:25:54.998451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 614/1221] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:55.042100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0f67fd07-0b6e-47c7-8554-3f04dc05afcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:55.044263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0f67fd07-0b6e-47c7-8554-3f04dc05afcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:55.050890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f67fd07-0b6e-47c7-8554-3f04dc05afcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:55.051364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f67fd07-0b6e-47c7-8554-3f04dc05afcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:55.051796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f67fd07-0b6e-47c7-8554-3f04dc05afcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:55.052477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f67fd07-0b6e-47c7-8554-3f04dc05afcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:55.052946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f67fd07-0b6e-47c7-8554-3f04dc05afcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:55.053361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f67fd07-0b6e-47c7-8554-3f04dc05afcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:55.083735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0f67fd07-0b6e-47c7-8554-3f04dc05afcc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045616 Aug 24 06:25:55.084283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 608/1222] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:56.010322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-289f3654-bac6-4606-b3ce-683c6b88aba5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:56.013092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-289f3654-bac6-4606-b3ce-683c6b88aba5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:56.019524 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-289f3654-bac6-4606-b3ce-683c6b88aba5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:56.019997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-289f3654-bac6-4606-b3ce-683c6b88aba5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:56.020426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-289f3654-bac6-4606-b3ce-683c6b88aba5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:56.021143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-289f3654-bac6-4606-b3ce-683c6b88aba5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:56.021601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-289f3654-bac6-4606-b3ce-683c6b88aba5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:56.022018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-289f3654-bac6-4606-b3ce-683c6b88aba5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:56.052923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-289f3654-bac6-4606-b3ce-683c6b88aba5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046621 Aug 24 06:25:56.053969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 615/1223] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:56.095702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-854cace4-8810-4a4b-9e33-4792d00f0685 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:56.097955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-854cace4-8810-4a4b-9e33-4792d00f0685 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:56.106949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-854cace4-8810-4a4b-9e33-4792d00f0685 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:56.107710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-854cace4-8810-4a4b-9e33-4792d00f0685 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:56.108460 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-854cace4-8810-4a4b-9e33-4792d00f0685 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:56.109648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-854cace4-8810-4a4b-9e33-4792d00f0685 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:56.110413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-854cace4-8810-4a4b-9e33-4792d00f0685 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:56.111179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-854cace4-8810-4a4b-9e33-4792d00f0685 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:56.146825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-854cace4-8810-4a4b-9e33-4792d00f0685 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055007 Aug 24 06:25:56.147381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 609/1224] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:25:57.066304 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-46a8725c-cf31-4bbb-8797-ed23fb6a4a59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:57.068559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-46a8725c-cf31-4bbb-8797-ed23fb6a4a59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:57.075080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46a8725c-cf31-4bbb-8797-ed23fb6a4a59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:57.075556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46a8725c-cf31-4bbb-8797-ed23fb6a4a59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:57.076521 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46a8725c-cf31-4bbb-8797-ed23fb6a4a59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:57.077211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46a8725c-cf31-4bbb-8797-ed23fb6a4a59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:57.077662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46a8725c-cf31-4bbb-8797-ed23fb6a4a59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:57.078169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-46a8725c-cf31-4bbb-8797-ed23fb6a4a59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:57.108231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-46a8725c-cf31-4bbb-8797-ed23fb6a4a59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045860 Aug 24 06:25:57.108826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 616/1225] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:57 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:25:57.159993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3f30088a-b241-4db3-9b49-1709420924a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:57.162746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3f30088a-b241-4db3-9b49-1709420924a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:57.169202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f30088a-b241-4db3-9b49-1709420924a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:57.169768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f30088a-b241-4db3-9b49-1709420924a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:57.170133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f30088a-b241-4db3-9b49-1709420924a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:57.170820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f30088a-b241-4db3-9b49-1709420924a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:57.171265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f30088a-b241-4db3-9b49-1709420924a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:57.171679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f30088a-b241-4db3-9b49-1709420924a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:57.201482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3f30088a-b241-4db3-9b49-1709420924a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044998 Aug 24 06:25:57.202042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 610/1226] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:57 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:58.120435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1f9a82ac-a160-43e9-8351-3eb61b72fe83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:58.122607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1f9a82ac-a160-43e9-8351-3eb61b72fe83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:58.129308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f9a82ac-a160-43e9-8351-3eb61b72fe83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:58.129799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f9a82ac-a160-43e9-8351-3eb61b72fe83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:58.130231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f9a82ac-a160-43e9-8351-3eb61b72fe83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:58.130918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f9a82ac-a160-43e9-8351-3eb61b72fe83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:58.131363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f9a82ac-a160-43e9-8351-3eb61b72fe83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:58.131796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1f9a82ac-a160-43e9-8351-3eb61b72fe83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:58.160938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1f9a82ac-a160-43e9-8351-3eb61b72fe83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044490 Aug 24 06:25:58.161507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 617/1227] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:58.213831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-37294aaf-eb3d-487f-952d-5ccbe5741d54 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:58.215915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-37294aaf-eb3d-487f-952d-5ccbe5741d54 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:58.222800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37294aaf-eb3d-487f-952d-5ccbe5741d54 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:58.223271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37294aaf-eb3d-487f-952d-5ccbe5741d54 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:58.223698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37294aaf-eb3d-487f-952d-5ccbe5741d54 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:58.224373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37294aaf-eb3d-487f-952d-5ccbe5741d54 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:58.224842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37294aaf-eb3d-487f-952d-5ccbe5741d54 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:58.225254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37294aaf-eb3d-487f-952d-5ccbe5741d54 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:58.253807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-37294aaf-eb3d-487f-952d-5ccbe5741d54 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044051 Aug 24 06:25:58.254349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 611/1228] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:58 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:25:59.173688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-12788da1-2500-4eef-b213-765dd0deb876 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:59.175823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-12788da1-2500-4eef-b213-765dd0deb876 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:59.182556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12788da1-2500-4eef-b213-765dd0deb876 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:59.183036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12788da1-2500-4eef-b213-765dd0deb876 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:59.183471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12788da1-2500-4eef-b213-765dd0deb876 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:59.184161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12788da1-2500-4eef-b213-765dd0deb876 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:59.184651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12788da1-2500-4eef-b213-765dd0deb876 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:59.185667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12788da1-2500-4eef-b213-765dd0deb876 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:59.213983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-12788da1-2500-4eef-b213-765dd0deb876 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Aug 24 06:25:59.214533 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 618/1229] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:25:59 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:25:59.265259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8f8dcac3-34c9-414d-bf78-d3b2e4c39ae1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:25:59.267395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8f8dcac3-34c9-414d-bf78-d3b2e4c39ae1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:25:59.273790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f8dcac3-34c9-414d-bf78-d3b2e4c39ae1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:59.274253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f8dcac3-34c9-414d-bf78-d3b2e4c39ae1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:59.274683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f8dcac3-34c9-414d-bf78-d3b2e4c39ae1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:59.275352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f8dcac3-34c9-414d-bf78-d3b2e4c39ae1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:25:59.275819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f8dcac3-34c9-414d-bf78-d3b2e4c39ae1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:25:59.276227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f8dcac3-34c9-414d-bf78-d3b2e4c39ae1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:25:59.304643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8f8dcac3-34c9-414d-bf78-d3b2e4c39ae1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043338 Aug 24 06:25:59.305181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 612/1230] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:25:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:00.227042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-189d48ed-2519-4407-b9cb-c530542b7bec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:00.229184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-189d48ed-2519-4407-b9cb-c530542b7bec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:00.235634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-189d48ed-2519-4407-b9cb-c530542b7bec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:00.236117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-189d48ed-2519-4407-b9cb-c530542b7bec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:00.236592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-189d48ed-2519-4407-b9cb-c530542b7bec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:00.237289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-189d48ed-2519-4407-b9cb-c530542b7bec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:00.237734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-189d48ed-2519-4407-b9cb-c530542b7bec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:00.238153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-189d48ed-2519-4407-b9cb-c530542b7bec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:00.267841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-189d48ed-2519-4407-b9cb-c530542b7bec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Aug 24 06:26:00.268320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 619/1231] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:00.317358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-812a59ef-a3ad-49e1-a02e-da21a5836c7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:00.319511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-812a59ef-a3ad-49e1-a02e-da21a5836c7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:00.326570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-812a59ef-a3ad-49e1-a02e-da21a5836c7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:00.327045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-812a59ef-a3ad-49e1-a02e-da21a5836c7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:00.327500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-812a59ef-a3ad-49e1-a02e-da21a5836c7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:00.328228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-812a59ef-a3ad-49e1-a02e-da21a5836c7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:00.328716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-812a59ef-a3ad-49e1-a02e-da21a5836c7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:00.330111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-812a59ef-a3ad-49e1-a02e-da21a5836c7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:00.358770 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-812a59ef-a3ad-49e1-a02e-da21a5836c7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045434 Aug 24 06:26:00.359328 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 613/1232] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:00 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:01.280429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-355f81d3-cb12-49d5-891b-ec736641d708 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:01.282629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-355f81d3-cb12-49d5-891b-ec736641d708 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:01.289140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-355f81d3-cb12-49d5-891b-ec736641d708 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:01.289612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-355f81d3-cb12-49d5-891b-ec736641d708 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:01.290032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-355f81d3-cb12-49d5-891b-ec736641d708 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:01.290716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-355f81d3-cb12-49d5-891b-ec736641d708 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:01.291153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-355f81d3-cb12-49d5-891b-ec736641d708 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:01.291565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-355f81d3-cb12-49d5-891b-ec736641d708 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:01.322292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-355f81d3-cb12-49d5-891b-ec736641d708 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046229 Aug 24 06:26:01.322782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 620/1233] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:01.371696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c2162322-53b8-46ca-9c9a-fc1e1781b9f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:01.373902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c2162322-53b8-46ca-9c9a-fc1e1781b9f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:01.380300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2162322-53b8-46ca-9c9a-fc1e1781b9f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:01.380804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2162322-53b8-46ca-9c9a-fc1e1781b9f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:01.381232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2162322-53b8-46ca-9c9a-fc1e1781b9f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:01.381911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2162322-53b8-46ca-9c9a-fc1e1781b9f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:01.382353 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2162322-53b8-46ca-9c9a-fc1e1781b9f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:01.382766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2162322-53b8-46ca-9c9a-fc1e1781b9f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:01.413378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c2162322-53b8-46ca-9c9a-fc1e1781b9f8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045774 Aug 24 06:26:01.413930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 614/1234] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:02.334890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8b3c14d5-88f3-487c-a19c-e1019b6b01f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:02.337021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8b3c14d5-88f3-487c-a19c-e1019b6b01f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:02.343450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b3c14d5-88f3-487c-a19c-e1019b6b01f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:02.343921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b3c14d5-88f3-487c-a19c-e1019b6b01f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:02.344346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b3c14d5-88f3-487c-a19c-e1019b6b01f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:02.345079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b3c14d5-88f3-487c-a19c-e1019b6b01f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:02.345523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b3c14d5-88f3-487c-a19c-e1019b6b01f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:02.345937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b3c14d5-88f3-487c-a19c-e1019b6b01f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:02.376090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8b3c14d5-88f3-487c-a19c-e1019b6b01f4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045023 Aug 24 06:26:02.376572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 621/1235] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:02 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:26:02.426449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d12e623f-2766-4fdf-85e3-fcc7bbe7673b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:02.428572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d12e623f-2766-4fdf-85e3-fcc7bbe7673b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:02.435561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d12e623f-2766-4fdf-85e3-fcc7bbe7673b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:02.436039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d12e623f-2766-4fdf-85e3-fcc7bbe7673b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:02.436463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d12e623f-2766-4fdf-85e3-fcc7bbe7673b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:02.437164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d12e623f-2766-4fdf-85e3-fcc7bbe7673b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:02.437604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d12e623f-2766-4fdf-85e3-fcc7bbe7673b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:02.438013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d12e623f-2766-4fdf-85e3-fcc7bbe7673b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:02.466994 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d12e623f-2766-4fdf-85e3-fcc7bbe7673b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044550 Aug 24 06:26:02.467548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 615/1236] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:03.388445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-50d06823-dcb1-4622-89be-cc9a6dcfe42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:03.390601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-50d06823-dcb1-4622-89be-cc9a6dcfe42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:03.397109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50d06823-dcb1-4622-89be-cc9a6dcfe42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:03.397584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50d06823-dcb1-4622-89be-cc9a6dcfe42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:03.398012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50d06823-dcb1-4622-89be-cc9a6dcfe42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:03.398696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50d06823-dcb1-4622-89be-cc9a6dcfe42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:03.399138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50d06823-dcb1-4622-89be-cc9a6dcfe42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:03.399554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50d06823-dcb1-4622-89be-cc9a6dcfe42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:03.429667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-50d06823-dcb1-4622-89be-cc9a6dcfe42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045103 Aug 24 06:26:03.430214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 622/1237] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:03 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:03.478546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-be9edc98-2020-4927-8c32-2b4ffd287762 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:03.480738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-be9edc98-2020-4927-8c32-2b4ffd287762 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:03.487770 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be9edc98-2020-4927-8c32-2b4ffd287762 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:03.488243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be9edc98-2020-4927-8c32-2b4ffd287762 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:03.488723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be9edc98-2020-4927-8c32-2b4ffd287762 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:03.489404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be9edc98-2020-4927-8c32-2b4ffd287762 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:03.489845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be9edc98-2020-4927-8c32-2b4ffd287762 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:03.490256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be9edc98-2020-4927-8c32-2b4ffd287762 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:03.506741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:26:03.519567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-be9edc98-2020-4927-8c32-2b4ffd287762 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044965 Aug 24 06:26:03.520122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 616/1238] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:04.442961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-116cf898-c37a-415a-af8e-66215aa5303a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:04.445123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-116cf898-c37a-415a-af8e-66215aa5303a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:04.451754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-116cf898-c37a-415a-af8e-66215aa5303a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:04.452232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-116cf898-c37a-415a-af8e-66215aa5303a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:04.452697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-116cf898-c37a-415a-af8e-66215aa5303a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:04.453392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-116cf898-c37a-415a-af8e-66215aa5303a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:04.453844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-116cf898-c37a-415a-af8e-66215aa5303a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:04.454263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-116cf898-c37a-415a-af8e-66215aa5303a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:04.479047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:26:04.484248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-116cf898-c37a-415a-af8e-66215aa5303a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045405 Aug 24 06:26:04.484850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 623/1239] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:04.531716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5cf1978f-7fdf-4939-a6f3-b703ef7d663b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:04.533973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5cf1978f-7fdf-4939-a6f3-b703ef7d663b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:04.540804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cf1978f-7fdf-4939-a6f3-b703ef7d663b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:04.541276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cf1978f-7fdf-4939-a6f3-b703ef7d663b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:04.541718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cf1978f-7fdf-4939-a6f3-b703ef7d663b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:04.542381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cf1978f-7fdf-4939-a6f3-b703ef7d663b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:04.542822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cf1978f-7fdf-4939-a6f3-b703ef7d663b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:04.543233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cf1978f-7fdf-4939-a6f3-b703ef7d663b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:04.573330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5cf1978f-7fdf-4939-a6f3-b703ef7d663b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045923 Aug 24 06:26:04.573892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 617/1240] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:04 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:05.496853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cdff9d35-8e8d-4997-b87d-9cb4c7dba3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:05.499501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cdff9d35-8e8d-4997-b87d-9cb4c7dba3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:05.506293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdff9d35-8e8d-4997-b87d-9cb4c7dba3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:05.506773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdff9d35-8e8d-4997-b87d-9cb4c7dba3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:05.507205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdff9d35-8e8d-4997-b87d-9cb4c7dba3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:05.507895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdff9d35-8e8d-4997-b87d-9cb4c7dba3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:05.508342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdff9d35-8e8d-4997-b87d-9cb4c7dba3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:05.508786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdff9d35-8e8d-4997-b87d-9cb4c7dba3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:05.542381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cdff9d35-8e8d-4997-b87d-9cb4c7dba3db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049410 Aug 24 06:26:05.542864 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 624/1241] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:26:05.585793 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-799a5632-ffc3-4790-8f3e-9d6c8b18588c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:05.587940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-799a5632-ffc3-4790-8f3e-9d6c8b18588c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:05.595008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-799a5632-ffc3-4790-8f3e-9d6c8b18588c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:05.595481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-799a5632-ffc3-4790-8f3e-9d6c8b18588c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:05.595908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-799a5632-ffc3-4790-8f3e-9d6c8b18588c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:05.596624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-799a5632-ffc3-4790-8f3e-9d6c8b18588c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:05.597072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-799a5632-ffc3-4790-8f3e-9d6c8b18588c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:05.597486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-799a5632-ffc3-4790-8f3e-9d6c8b18588c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:05.627007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-799a5632-ffc3-4790-8f3e-9d6c8b18588c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045231 Aug 24 06:26:05.627578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 618/1242] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:26:06.554600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-591da86e-0e8e-49e1-82e6-5f31d9088407 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:06.557279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-591da86e-0e8e-49e1-82e6-5f31d9088407 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:06.564095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-591da86e-0e8e-49e1-82e6-5f31d9088407 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:06.564596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-591da86e-0e8e-49e1-82e6-5f31d9088407 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:06.565022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-591da86e-0e8e-49e1-82e6-5f31d9088407 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:06.565700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-591da86e-0e8e-49e1-82e6-5f31d9088407 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:06.566143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-591da86e-0e8e-49e1-82e6-5f31d9088407 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:06.566556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-591da86e-0e8e-49e1-82e6-5f31d9088407 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:06.596202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-591da86e-0e8e-49e1-82e6-5f31d9088407 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Aug 24 06:26:06.596715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 625/1243] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:06.639407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-566016f7-78bd-4fad-9cf0-73f8952b66ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:06.642162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-566016f7-78bd-4fad-9cf0-73f8952b66ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:06.648801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-566016f7-78bd-4fad-9cf0-73f8952b66ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:06.649313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-566016f7-78bd-4fad-9cf0-73f8952b66ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:06.649747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-566016f7-78bd-4fad-9cf0-73f8952b66ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:06.650449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-566016f7-78bd-4fad-9cf0-73f8952b66ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:06.650924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-566016f7-78bd-4fad-9cf0-73f8952b66ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:06.651348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-566016f7-78bd-4fad-9cf0-73f8952b66ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:06.682323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-566016f7-78bd-4fad-9cf0-73f8952b66ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046686 Aug 24 06:26:06.682894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 619/1244] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:07.608329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5bb78461-4696-472b-9578-58eb9e607598 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:07.611023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5bb78461-4696-472b-9578-58eb9e607598 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:07.617358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5bb78461-4696-472b-9578-58eb9e607598 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:07.617833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5bb78461-4696-472b-9578-58eb9e607598 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:07.618265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5bb78461-4696-472b-9578-58eb9e607598 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:07.618944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5bb78461-4696-472b-9578-58eb9e607598 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:07.619390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5bb78461-4696-472b-9578-58eb9e607598 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:07.619807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5bb78461-4696-472b-9578-58eb9e607598 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:07.649192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5bb78461-4696-472b-9578-58eb9e607598 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Aug 24 06:26:07.649664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 626/1245] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:07.695107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-91780dd2-f3b1-4ad1-a83b-397a8327f289 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:07.697286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-91780dd2-f3b1-4ad1-a83b-397a8327f289 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:07.703569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91780dd2-f3b1-4ad1-a83b-397a8327f289 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:07.704045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91780dd2-f3b1-4ad1-a83b-397a8327f289 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:07.704477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91780dd2-f3b1-4ad1-a83b-397a8327f289 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:07.705189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91780dd2-f3b1-4ad1-a83b-397a8327f289 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:07.705636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91780dd2-f3b1-4ad1-a83b-397a8327f289 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:07.706081 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91780dd2-f3b1-4ad1-a83b-397a8327f289 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:07.735731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-91780dd2-f3b1-4ad1-a83b-397a8327f289 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044584 Aug 24 06:26:07.736401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 620/1246] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:07 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:08.660302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-561cbbd5-ad57-4bc1-98ad-04fbd6c0fe51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:08.662484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-561cbbd5-ad57-4bc1-98ad-04fbd6c0fe51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:08.668950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-561cbbd5-ad57-4bc1-98ad-04fbd6c0fe51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:08.669424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-561cbbd5-ad57-4bc1-98ad-04fbd6c0fe51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:08.669854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-561cbbd5-ad57-4bc1-98ad-04fbd6c0fe51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:08.670540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-561cbbd5-ad57-4bc1-98ad-04fbd6c0fe51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:08.670987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-561cbbd5-ad57-4bc1-98ad-04fbd6c0fe51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:08.671404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-561cbbd5-ad57-4bc1-98ad-04fbd6c0fe51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:08.701095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-561cbbd5-ad57-4bc1-98ad-04fbd6c0fe51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Aug 24 06:26:08.701650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 627/1247] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:08.748184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fe64836f-f242-4c07-9efa-4d81de8aaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:08.750837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fe64836f-f242-4c07-9efa-4d81de8aaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:08.757246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe64836f-f242-4c07-9efa-4d81de8aaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:08.757716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe64836f-f242-4c07-9efa-4d81de8aaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:08.758141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe64836f-f242-4c07-9efa-4d81de8aaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:08.758811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe64836f-f242-4c07-9efa-4d81de8aaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:08.759254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe64836f-f242-4c07-9efa-4d81de8aaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:08.759666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe64836f-f242-4c07-9efa-4d81de8aaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:08.788520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fe64836f-f242-4c07-9efa-4d81de8aaa0a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044251 Aug 24 06:26:08.789073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 621/1248] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:09.713851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4b426e24-4636-4a0a-944b-fe692e8276f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:09.716100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4b426e24-4636-4a0a-944b-fe692e8276f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:09.723129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b426e24-4636-4a0a-944b-fe692e8276f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:09.723608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b426e24-4636-4a0a-944b-fe692e8276f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:09.724028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b426e24-4636-4a0a-944b-fe692e8276f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:09.724733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b426e24-4636-4a0a-944b-fe692e8276f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:09.725177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b426e24-4636-4a0a-944b-fe692e8276f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:09.725592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b426e24-4636-4a0a-944b-fe692e8276f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:09.753886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4b426e24-4636-4a0a-944b-fe692e8276f0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Aug 24 06:26:09.754428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 628/1249] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:09 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:09.801469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ad38ddf9-5c76-42d2-b750-572e34bdb14e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:09.803538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ad38ddf9-5c76-42d2-b750-572e34bdb14e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:09.810375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad38ddf9-5c76-42d2-b750-572e34bdb14e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:09.810843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad38ddf9-5c76-42d2-b750-572e34bdb14e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:09.811272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad38ddf9-5c76-42d2-b750-572e34bdb14e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:09.811965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad38ddf9-5c76-42d2-b750-572e34bdb14e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:09.812395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad38ddf9-5c76-42d2-b750-572e34bdb14e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:09.812831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad38ddf9-5c76-42d2-b750-572e34bdb14e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:09.843012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ad38ddf9-5c76-42d2-b750-572e34bdb14e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045621 Aug 24 06:26:09.843635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 622/1250] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:10.766088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-927597ed-00a2-4a03-8513-f614d1d912cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:10.768250 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-927597ed-00a2-4a03-8513-f614d1d912cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:10.774718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-927597ed-00a2-4a03-8513-f614d1d912cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:10.775195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-927597ed-00a2-4a03-8513-f614d1d912cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:10.775629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-927597ed-00a2-4a03-8513-f614d1d912cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:10.776312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-927597ed-00a2-4a03-8513-f614d1d912cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:10.776791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-927597ed-00a2-4a03-8513-f614d1d912cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:10.777225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-927597ed-00a2-4a03-8513-f614d1d912cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:10.806855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-927597ed-00a2-4a03-8513-f614d1d912cd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 Aug 24 06:26:10.807403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 629/1251] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:10 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:10.855271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0a6754f2-e107-44c2-9dfe-090817fb0448 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:10.857345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0a6754f2-e107-44c2-9dfe-090817fb0448 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:10.865863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a6754f2-e107-44c2-9dfe-090817fb0448 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:10.866335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a6754f2-e107-44c2-9dfe-090817fb0448 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:10.866875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a6754f2-e107-44c2-9dfe-090817fb0448 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:10.867600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a6754f2-e107-44c2-9dfe-090817fb0448 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:10.868079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a6754f2-e107-44c2-9dfe-090817fb0448 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:10.868524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a6754f2-e107-44c2-9dfe-090817fb0448 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:10.897134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0a6754f2-e107-44c2-9dfe-090817fb0448 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045824 Aug 24 06:26:10.897686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 623/1252] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:10 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:11.819394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e556ca0e-5332-484a-ad4f-0fdff72211d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:11.821611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e556ca0e-5332-484a-ad4f-0fdff72211d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:11.828684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e556ca0e-5332-484a-ad4f-0fdff72211d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:11.829158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e556ca0e-5332-484a-ad4f-0fdff72211d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:11.829587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e556ca0e-5332-484a-ad4f-0fdff72211d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:11.830267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e556ca0e-5332-484a-ad4f-0fdff72211d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:11.830717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e556ca0e-5332-484a-ad4f-0fdff72211d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:11.831134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e556ca0e-5332-484a-ad4f-0fdff72211d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:11.859769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e556ca0e-5332-484a-ad4f-0fdff72211d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043917 Aug 24 06:26:11.860323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 630/1253] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:11.908776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a34d19bc-719d-462e-8649-86b80ac50e4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:11.910833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a34d19bc-719d-462e-8649-86b80ac50e4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:11.917265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a34d19bc-719d-462e-8649-86b80ac50e4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:11.917744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a34d19bc-719d-462e-8649-86b80ac50e4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:11.918176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a34d19bc-719d-462e-8649-86b80ac50e4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:11.918864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a34d19bc-719d-462e-8649-86b80ac50e4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:11.919312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a34d19bc-719d-462e-8649-86b80ac50e4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:11.919734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a34d19bc-719d-462e-8649-86b80ac50e4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:11.949789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a34d19bc-719d-462e-8649-86b80ac50e4f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045134 Aug 24 06:26:11.950346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 624/1254] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:12.871938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6cc14276-3a2f-4ebe-8fc5-d3d871d49941 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:12.874775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6cc14276-3a2f-4ebe-8fc5-d3d871d49941 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:12.877118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=58 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:26:12.882171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6cc14276-3a2f-4ebe-8fc5-d3d871d49941 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:12.882652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6cc14276-3a2f-4ebe-8fc5-d3d871d49941 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:12.883114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6cc14276-3a2f-4ebe-8fc5-d3d871d49941 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:12.883833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6cc14276-3a2f-4ebe-8fc5-d3d871d49941 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:12.884285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6cc14276-3a2f-4ebe-8fc5-d3d871d49941 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:12.884741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6cc14276-3a2f-4ebe-8fc5-d3d871d49941 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:12.916888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6cc14276-3a2f-4ebe-8fc5-d3d871d49941 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049097 Aug 24 06:26:12.917460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 631/1255] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:12.962487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7793212d-6e21-4674-8f60-2ceeb6b6e3dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:12.964672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7793212d-6e21-4674-8f60-2ceeb6b6e3dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:12.971046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7793212d-6e21-4674-8f60-2ceeb6b6e3dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:12.971518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7793212d-6e21-4674-8f60-2ceeb6b6e3dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:12.971948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7793212d-6e21-4674-8f60-2ceeb6b6e3dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:12.972665 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7793212d-6e21-4674-8f60-2ceeb6b6e3dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:12.973114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7793212d-6e21-4674-8f60-2ceeb6b6e3dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:12.973535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7793212d-6e21-4674-8f60-2ceeb6b6e3dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:13.002551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7793212d-6e21-4674-8f60-2ceeb6b6e3dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044199 Aug 24 06:26:13.003104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 625/1256] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:13.929817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1be68978-81ec-4fc7-9875-bd5193d6ec65 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:13.932189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1be68978-81ec-4fc7-9875-bd5193d6ec65 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:13.939008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1be68978-81ec-4fc7-9875-bd5193d6ec65 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:13.939423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1be68978-81ec-4fc7-9875-bd5193d6ec65 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:13.939856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1be68978-81ec-4fc7-9875-bd5193d6ec65 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:13.940569 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1be68978-81ec-4fc7-9875-bd5193d6ec65 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:13.941020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1be68978-81ec-4fc7-9875-bd5193d6ec65 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:13.941443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1be68978-81ec-4fc7-9875-bd5193d6ec65 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:13.972176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1be68978-81ec-4fc7-9875-bd5193d6ec65 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046649 Aug 24 06:26:13.972768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 632/1257] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:14.014974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b3865ab5-a52b-4060-83e7-92322bd57c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:14.018805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b3865ab5-a52b-4060-83e7-92322bd57c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:14.023451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3865ab5-a52b-4060-83e7-92322bd57c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:14.023922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3865ab5-a52b-4060-83e7-92322bd57c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:14.024352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3865ab5-a52b-4060-83e7-92322bd57c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:14.025140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3865ab5-a52b-4060-83e7-92322bd57c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:14.025591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3865ab5-a52b-4060-83e7-92322bd57c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:14.026008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3865ab5-a52b-4060-83e7-92322bd57c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:14.055516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b3865ab5-a52b-4060-83e7-92322bd57c22 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044600 Aug 24 06:26:14.056074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 626/1258] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:14.985403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cffff2dc-b521-4230-995d-666cff3cd3d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:14.987457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cffff2dc-b521-4230-995d-666cff3cd3d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:14.993924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffff2dc-b521-4230-995d-666cff3cd3d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:14.994416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffff2dc-b521-4230-995d-666cff3cd3d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:14.994830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffff2dc-b521-4230-995d-666cff3cd3d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:14.995521 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffff2dc-b521-4230-995d-666cff3cd3d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:14.995968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffff2dc-b521-4230-995d-666cff3cd3d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:14.996385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffff2dc-b521-4230-995d-666cff3cd3d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:15.026698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cffff2dc-b521-4230-995d-666cff3cd3d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Aug 24 06:26:15.027275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 633/1259] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:15.068714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-14e46eca-72e2-4b4f-8f47-50ea0fe0fa35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:15.070914 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-14e46eca-72e2-4b4f-8f47-50ea0fe0fa35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:15.077378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14e46eca-72e2-4b4f-8f47-50ea0fe0fa35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:15.077851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14e46eca-72e2-4b4f-8f47-50ea0fe0fa35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:15.078282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14e46eca-72e2-4b4f-8f47-50ea0fe0fa35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:15.078972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14e46eca-72e2-4b4f-8f47-50ea0fe0fa35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:15.079414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14e46eca-72e2-4b4f-8f47-50ea0fe0fa35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:15.079827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-14e46eca-72e2-4b4f-8f47-50ea0fe0fa35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:15.110403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-14e46eca-72e2-4b4f-8f47-50ea0fe0fa35 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045640 Aug 24 06:26:15.110967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 627/1260] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:16.039185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b3d818ab-c940-4f8f-9d55-f676b9fc5614 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:16.041405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b3d818ab-c940-4f8f-9d55-f676b9fc5614 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:16.048139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3d818ab-c940-4f8f-9d55-f676b9fc5614 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:16.048668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3d818ab-c940-4f8f-9d55-f676b9fc5614 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:16.049103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3d818ab-c940-4f8f-9d55-f676b9fc5614 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:16.049841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3d818ab-c940-4f8f-9d55-f676b9fc5614 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:16.050308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3d818ab-c940-4f8f-9d55-f676b9fc5614 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:16.050734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3d818ab-c940-4f8f-9d55-f676b9fc5614 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:16.082323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b3d818ab-c940-4f8f-9d55-f676b9fc5614 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047135 Aug 24 06:26:16.082904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 634/1261] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:16.123497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bf43dfec-2e7c-4eb7-9a4b-795e90645328 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:16.126189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bf43dfec-2e7c-4eb7-9a4b-795e90645328 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:16.132341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf43dfec-2e7c-4eb7-9a4b-795e90645328 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:16.132844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf43dfec-2e7c-4eb7-9a4b-795e90645328 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:16.133271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf43dfec-2e7c-4eb7-9a4b-795e90645328 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:16.133957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf43dfec-2e7c-4eb7-9a4b-795e90645328 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:16.134400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf43dfec-2e7c-4eb7-9a4b-795e90645328 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:16.134811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf43dfec-2e7c-4eb7-9a4b-795e90645328 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:16.165018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bf43dfec-2e7c-4eb7-9a4b-795e90645328 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046054 Aug 24 06:26:16.165583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 628/1262] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:16 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:17.095882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0f915b22-767c-4562-a548-b85af32a787c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:17.098125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0f915b22-767c-4562-a548-b85af32a787c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:17.104406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f915b22-767c-4562-a548-b85af32a787c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:17.104922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f915b22-767c-4562-a548-b85af32a787c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:17.105371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f915b22-767c-4562-a548-b85af32a787c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:17.106132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f915b22-767c-4562-a548-b85af32a787c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:17.106587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f915b22-767c-4562-a548-b85af32a787c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:17.107006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f915b22-767c-4562-a548-b85af32a787c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:17.139147 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0f915b22-767c-4562-a548-b85af32a787c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048136 Aug 24 06:26:17.139742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 635/1263] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:17 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:17.177564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d31f30f4-f618-4c9d-b981-9845330ab50f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:17.179737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d31f30f4-f618-4c9d-b981-9845330ab50f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:17.186666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d31f30f4-f618-4c9d-b981-9845330ab50f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:17.187176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d31f30f4-f618-4c9d-b981-9845330ab50f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:17.187609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d31f30f4-f618-4c9d-b981-9845330ab50f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:17.188309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d31f30f4-f618-4c9d-b981-9845330ab50f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:17.188796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d31f30f4-f618-4c9d-b981-9845330ab50f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:17.189214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d31f30f4-f618-4c9d-b981-9845330ab50f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:17.220703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d31f30f4-f618-4c9d-b981-9845330ab50f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047081 Aug 24 06:26:17.221427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 629/1264] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:18.154744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0334b98d-9439-437f-b027-5c2c5985f95a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:18.156905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0334b98d-9439-437f-b027-5c2c5985f95a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:18.163373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0334b98d-9439-437f-b027-5c2c5985f95a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:18.163841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0334b98d-9439-437f-b027-5c2c5985f95a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:18.164265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0334b98d-9439-437f-b027-5c2c5985f95a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:18.164988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0334b98d-9439-437f-b027-5c2c5985f95a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:18.165430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0334b98d-9439-437f-b027-5c2c5985f95a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:18.165845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0334b98d-9439-437f-b027-5c2c5985f95a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:18.196592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0334b98d-9439-437f-b027-5c2c5985f95a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045729 Aug 24 06:26:18.197154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 636/1265] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:18.233522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dc480bf3-0484-48c2-bae7-a00c2360751a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:18.236088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dc480bf3-0484-48c2-bae7-a00c2360751a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:18.242619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc480bf3-0484-48c2-bae7-a00c2360751a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:18.243084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc480bf3-0484-48c2-bae7-a00c2360751a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:18.243508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc480bf3-0484-48c2-bae7-a00c2360751a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:18.244253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc480bf3-0484-48c2-bae7-a00c2360751a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:18.244729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc480bf3-0484-48c2-bae7-a00c2360751a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:18.245149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc480bf3-0484-48c2-bae7-a00c2360751a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:18.278809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dc480bf3-0484-48c2-bae7-a00c2360751a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049292 Aug 24 06:26:18.279371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 630/1266] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:19.209449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f826901d-95ce-41d3-9979-ab3b2e8e6a50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:19.211603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f826901d-95ce-41d3-9979-ab3b2e8e6a50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:19.218290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f826901d-95ce-41d3-9979-ab3b2e8e6a50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:19.218773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f826901d-95ce-41d3-9979-ab3b2e8e6a50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:19.219230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f826901d-95ce-41d3-9979-ab3b2e8e6a50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:19.219918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f826901d-95ce-41d3-9979-ab3b2e8e6a50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:19.220359 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f826901d-95ce-41d3-9979-ab3b2e8e6a50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:19.220805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f826901d-95ce-41d3-9979-ab3b2e8e6a50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:19.249786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f826901d-95ce-41d3-9979-ab3b2e8e6a50 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Aug 24 06:26:19.250351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 637/1267] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:19.291975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7932534f-5ef1-4327-8300-19513a852402 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:19.294243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7932534f-5ef1-4327-8300-19513a852402 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:19.301293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7932534f-5ef1-4327-8300-19513a852402 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:19.301768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7932534f-5ef1-4327-8300-19513a852402 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:19.302192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7932534f-5ef1-4327-8300-19513a852402 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:19.302872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7932534f-5ef1-4327-8300-19513a852402 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:19.303319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7932534f-5ef1-4327-8300-19513a852402 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:19.303757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7932534f-5ef1-4327-8300-19513a852402 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:19.335074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7932534f-5ef1-4327-8300-19513a852402 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047125 Aug 24 06:26:19.335643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 631/1268] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:20.263155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3fc770be-4b20-4690-880e-972379d8e9c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:20.265236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3fc770be-4b20-4690-880e-972379d8e9c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:20.274244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc770be-4b20-4690-880e-972379d8e9c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:20.274728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc770be-4b20-4690-880e-972379d8e9c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:20.275164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc770be-4b20-4690-880e-972379d8e9c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:20.276022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc770be-4b20-4690-880e-972379d8e9c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:20.276562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc770be-4b20-4690-880e-972379d8e9c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:20.276992 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc770be-4b20-4690-880e-972379d8e9c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:20.309284 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3fc770be-4b20-4690-880e-972379d8e9c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050164 Aug 24 06:26:20.309865 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 638/1269] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:20.347438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-22795045-8909-4882-9c58-a5e41a598877 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:20.349603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-22795045-8909-4882-9c58-a5e41a598877 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:20.356450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22795045-8909-4882-9c58-a5e41a598877 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:20.356962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22795045-8909-4882-9c58-a5e41a598877 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:20.357392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22795045-8909-4882-9c58-a5e41a598877 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:20.358082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22795045-8909-4882-9c58-a5e41a598877 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:20.358527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22795045-8909-4882-9c58-a5e41a598877 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:20.358940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22795045-8909-4882-9c58-a5e41a598877 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:20.388291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-22795045-8909-4882-9c58-a5e41a598877 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045763 Aug 24 06:26:20.388888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 632/1270] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:20 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:21.321790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d32bb112-8d49-428a-bbf5-cd7b789911d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:21.323970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d32bb112-8d49-428a-bbf5-cd7b789911d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:21.330372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d32bb112-8d49-428a-bbf5-cd7b789911d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:21.330856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d32bb112-8d49-428a-bbf5-cd7b789911d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:21.331301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d32bb112-8d49-428a-bbf5-cd7b789911d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:21.332004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d32bb112-8d49-428a-bbf5-cd7b789911d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:21.332451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d32bb112-8d49-428a-bbf5-cd7b789911d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:21.332904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d32bb112-8d49-428a-bbf5-cd7b789911d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:21.365185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d32bb112-8d49-428a-bbf5-cd7b789911d9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047328 Aug 24 06:26:21.365764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 639/1271] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:21 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:21.401384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-83d1cf67-8718-4b9a-8aa8-83f665e006dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:21.403486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-83d1cf67-8718-4b9a-8aa8-83f665e006dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:21.410572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83d1cf67-8718-4b9a-8aa8-83f665e006dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:21.411049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83d1cf67-8718-4b9a-8aa8-83f665e006dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:21.411473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83d1cf67-8718-4b9a-8aa8-83f665e006dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:21.412160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83d1cf67-8718-4b9a-8aa8-83f665e006dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:21.412625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83d1cf67-8718-4b9a-8aa8-83f665e006dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:21.413043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-83d1cf67-8718-4b9a-8aa8-83f665e006dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:21.416877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:26:21.443583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-83d1cf67-8718-4b9a-8aa8-83f665e006dd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046161 Aug 24 06:26:21.444183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 633/1272] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:22.378081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6141ae53-e429-4af9-bd8c-1db44ad1d12b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:22.380229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6141ae53-e429-4af9-bd8c-1db44ad1d12b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:22.386752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6141ae53-e429-4af9-bd8c-1db44ad1d12b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:22.387238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6141ae53-e429-4af9-bd8c-1db44ad1d12b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:22.387699 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6141ae53-e429-4af9-bd8c-1db44ad1d12b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:22.388398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6141ae53-e429-4af9-bd8c-1db44ad1d12b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:22.388869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6141ae53-e429-4af9-bd8c-1db44ad1d12b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:22.389289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6141ae53-e429-4af9-bd8c-1db44ad1d12b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:22.406836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:26:22.420575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6141ae53-e429-4af9-bd8c-1db44ad1d12b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046458 Aug 24 06:26:22.421145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 640/1273] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:22.455840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4a16ee56-a4de-4f53-b2d0-6604ce1a0ed6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:22.457961 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4a16ee56-a4de-4f53-b2d0-6604ce1a0ed6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:22.464844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a16ee56-a4de-4f53-b2d0-6604ce1a0ed6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:22.465373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a16ee56-a4de-4f53-b2d0-6604ce1a0ed6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:22.465802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a16ee56-a4de-4f53-b2d0-6604ce1a0ed6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:22.466502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a16ee56-a4de-4f53-b2d0-6604ce1a0ed6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:22.466950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a16ee56-a4de-4f53-b2d0-6604ce1a0ed6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:22.467369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a16ee56-a4de-4f53-b2d0-6604ce1a0ed6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:22.497484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4a16ee56-a4de-4f53-b2d0-6604ce1a0ed6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046188 Aug 24 06:26:22.498054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 634/1274] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:22 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:23.433278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1aaf46b0-c5fe-4010-9b04-499f7bbeeb68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:23.436988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1aaf46b0-c5fe-4010-9b04-499f7bbeeb68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:23.443999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1aaf46b0-c5fe-4010-9b04-499f7bbeeb68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:23.444478 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1aaf46b0-c5fe-4010-9b04-499f7bbeeb68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:23.444935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1aaf46b0-c5fe-4010-9b04-499f7bbeeb68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:23.445631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1aaf46b0-c5fe-4010-9b04-499f7bbeeb68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:23.446081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1aaf46b0-c5fe-4010-9b04-499f7bbeeb68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:23.446502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1aaf46b0-c5fe-4010-9b04-499f7bbeeb68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:23.476624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1aaf46b0-c5fe-4010-9b04-499f7bbeeb68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047581 Aug 24 06:26:23.477193 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 641/1275] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:23 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:23.510009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c339a4f6-cf64-494e-b279-c8d5ccb591df tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:23.512044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c339a4f6-cf64-494e-b279-c8d5ccb591df tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:23.518552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c339a4f6-cf64-494e-b279-c8d5ccb591df tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:23.519028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c339a4f6-cf64-494e-b279-c8d5ccb591df tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:23.519456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c339a4f6-cf64-494e-b279-c8d5ccb591df tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:23.520150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c339a4f6-cf64-494e-b279-c8d5ccb591df tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:23.520617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c339a4f6-cf64-494e-b279-c8d5ccb591df tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:23.521031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c339a4f6-cf64-494e-b279-c8d5ccb591df tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:23.551591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c339a4f6-cf64-494e-b279-c8d5ccb591df tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045585 Aug 24 06:26:23.552163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 635/1276] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:26:24.492701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0f785864-372d-43e8-a65e-8b07ceab27ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:24.494849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0f785864-372d-43e8-a65e-8b07ceab27ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:24.501503 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f785864-372d-43e8-a65e-8b07ceab27ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:24.501977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f785864-372d-43e8-a65e-8b07ceab27ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:24.502404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f785864-372d-43e8-a65e-8b07ceab27ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:24.503707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f785864-372d-43e8-a65e-8b07ceab27ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:24.504155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f785864-372d-43e8-a65e-8b07ceab27ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:24.504610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0f785864-372d-43e8-a65e-8b07ceab27ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:24.533976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0f785864-372d-43e8-a65e-8b07ceab27ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048398 Aug 24 06:26:24.534545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 642/1277] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:24.563399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-806d8629-19a9-4252-a6e3-090176cefe2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:24.566222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-806d8629-19a9-4252-a6e3-090176cefe2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:24.572644 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-806d8629-19a9-4252-a6e3-090176cefe2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:24.573121 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-806d8629-19a9-4252-a6e3-090176cefe2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:24.573550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-806d8629-19a9-4252-a6e3-090176cefe2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:24.574243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-806d8629-19a9-4252-a6e3-090176cefe2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:24.574692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-806d8629-19a9-4252-a6e3-090176cefe2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:24.575112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-806d8629-19a9-4252-a6e3-090176cefe2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:24.604793 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-806d8629-19a9-4252-a6e3-090176cefe2a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045264 Aug 24 06:26:24.605356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 636/1278] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:25.546482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fa0df1fd-352e-4537-b36a-897b97d3157d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:25.548660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fa0df1fd-352e-4537-b36a-897b97d3157d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:25.555334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa0df1fd-352e-4537-b36a-897b97d3157d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:25.555812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa0df1fd-352e-4537-b36a-897b97d3157d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:25.556510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa0df1fd-352e-4537-b36a-897b97d3157d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:25.557214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa0df1fd-352e-4537-b36a-897b97d3157d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:25.557663 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa0df1fd-352e-4537-b36a-897b97d3157d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:25.558084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa0df1fd-352e-4537-b36a-897b97d3157d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:25.589588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fa0df1fd-352e-4537-b36a-897b97d3157d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047063 Aug 24 06:26:25.590165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 643/1279] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:25 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:25.620639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b578d9ac-9778-496f-933f-fae54c58b29d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:25.620639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b578d9ac-9778-496f-933f-fae54c58b29d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:25.621588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=60 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:26:25.626500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b578d9ac-9778-496f-933f-fae54c58b29d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:25.626912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b578d9ac-9778-496f-933f-fae54c58b29d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:25.627336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b578d9ac-9778-496f-933f-fae54c58b29d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:25.628545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b578d9ac-9778-496f-933f-fae54c58b29d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:25.628996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b578d9ac-9778-496f-933f-fae54c58b29d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:25.629411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b578d9ac-9778-496f-933f-fae54c58b29d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:25.660380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b578d9ac-9778-496f-933f-fae54c58b29d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047249 Aug 24 06:26:25.660979 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 637/1280] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:26.602102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e408be3a-23d4-4d54-8cab-f69512d40b2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:26.604330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e408be3a-23d4-4d54-8cab-f69512d40b2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:26.611108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e408be3a-23d4-4d54-8cab-f69512d40b2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:26.611672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e408be3a-23d4-4d54-8cab-f69512d40b2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:26.612100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e408be3a-23d4-4d54-8cab-f69512d40b2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:26.612856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e408be3a-23d4-4d54-8cab-f69512d40b2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:26.613289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e408be3a-23d4-4d54-8cab-f69512d40b2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:26.613736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e408be3a-23d4-4d54-8cab-f69512d40b2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:26.645079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e408be3a-23d4-4d54-8cab-f69512d40b2f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047017 Aug 24 06:26:26.645655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 644/1281] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:26.673537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-872f0878-1ab4-4056-b7af-1f3cf595142e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:26.680559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-872f0878-1ab4-4056-b7af-1f3cf595142e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:26.682791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-872f0878-1ab4-4056-b7af-1f3cf595142e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:26.683307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-872f0878-1ab4-4056-b7af-1f3cf595142e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:26.683739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-872f0878-1ab4-4056-b7af-1f3cf595142e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:26.684447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-872f0878-1ab4-4056-b7af-1f3cf595142e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:26.684935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-872f0878-1ab4-4056-b7af-1f3cf595142e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:26.685359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-872f0878-1ab4-4056-b7af-1f3cf595142e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:26.718676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-872f0878-1ab4-4056-b7af-1f3cf595142e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049510 Aug 24 06:26:26.719251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 638/1282] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:27.657562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-67a3ac8a-4fa5-4551-86ca-3c02c7163b63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:27.659722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-67a3ac8a-4fa5-4551-86ca-3c02c7163b63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:27.666360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3ac8a-4fa5-4551-86ca-3c02c7163b63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:27.666841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3ac8a-4fa5-4551-86ca-3c02c7163b63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:27.667269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3ac8a-4fa5-4551-86ca-3c02c7163b63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:27.667958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3ac8a-4fa5-4551-86ca-3c02c7163b63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:27.668402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3ac8a-4fa5-4551-86ca-3c02c7163b63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:27.668852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3ac8a-4fa5-4551-86ca-3c02c7163b63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:27.702955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-67a3ac8a-4fa5-4551-86ca-3c02c7163b63 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049370 Aug 24 06:26:27.703532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 645/1283] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:27.731991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b91f4ceb-49d4-45b5-bf8b-261e7b1864b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:27.734195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b91f4ceb-49d4-45b5-bf8b-261e7b1864b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:27.741469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b91f4ceb-49d4-45b5-bf8b-261e7b1864b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:27.741880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b91f4ceb-49d4-45b5-bf8b-261e7b1864b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:27.742319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b91f4ceb-49d4-45b5-bf8b-261e7b1864b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:27.743046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b91f4ceb-49d4-45b5-bf8b-261e7b1864b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:27.743494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b91f4ceb-49d4-45b5-bf8b-261e7b1864b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:27.743912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b91f4ceb-49d4-45b5-bf8b-261e7b1864b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:27.774574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b91f4ceb-49d4-45b5-bf8b-261e7b1864b7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047067 Aug 24 06:26:27.775139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 639/1284] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:28.715390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f899a556-e997-4186-8479-a7ad5e215c57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:28.717606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f899a556-e997-4186-8479-a7ad5e215c57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:28.724097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f899a556-e997-4186-8479-a7ad5e215c57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:28.724615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f899a556-e997-4186-8479-a7ad5e215c57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:28.725045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f899a556-e997-4186-8479-a7ad5e215c57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:28.725739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f899a556-e997-4186-8479-a7ad5e215c57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:28.726189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f899a556-e997-4186-8479-a7ad5e215c57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:28.726607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f899a556-e997-4186-8479-a7ad5e215c57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:28.761720 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f899a556-e997-4186-8479-a7ad5e215c57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050223 Aug 24 06:26:28.762188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 646/1285] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:28 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:28.787296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ee8bdfbb-155f-4658-a91d-50bdaddfa406 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:28.789548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ee8bdfbb-155f-4658-a91d-50bdaddfa406 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:28.796572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8bdfbb-155f-4658-a91d-50bdaddfa406 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:28.797061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8bdfbb-155f-4658-a91d-50bdaddfa406 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:28.797496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8bdfbb-155f-4658-a91d-50bdaddfa406 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:28.798303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8bdfbb-155f-4658-a91d-50bdaddfa406 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:28.798896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8bdfbb-155f-4658-a91d-50bdaddfa406 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:28.799365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8bdfbb-155f-4658-a91d-50bdaddfa406 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:28.831453 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ee8bdfbb-155f-4658-a91d-50bdaddfa406 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047716 Aug 24 06:26:28.832028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 640/1286] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:28 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:26:29.774374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6fd2d3bc-23b2-47af-8520-0c76882065c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:29.776565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6fd2d3bc-23b2-47af-8520-0c76882065c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:29.783054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6fd2d3bc-23b2-47af-8520-0c76882065c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:29.783532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6fd2d3bc-23b2-47af-8520-0c76882065c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:29.784538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6fd2d3bc-23b2-47af-8520-0c76882065c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:29.785235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6fd2d3bc-23b2-47af-8520-0c76882065c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:29.785686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6fd2d3bc-23b2-47af-8520-0c76882065c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:29.786104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6fd2d3bc-23b2-47af-8520-0c76882065c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:29.816643 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6fd2d3bc-23b2-47af-8520-0c76882065c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046264 Aug 24 06:26:29.817211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 647/1287] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:29.843373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-69d93d2e-7a4b-4735-a3a2-6233c30b3292 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:29.845621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-69d93d2e-7a4b-4735-a3a2-6233c30b3292 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:29.853084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d93d2e-7a4b-4735-a3a2-6233c30b3292 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:29.853560 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d93d2e-7a4b-4735-a3a2-6233c30b3292 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:29.853990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d93d2e-7a4b-4735-a3a2-6233c30b3292 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:29.854681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d93d2e-7a4b-4735-a3a2-6233c30b3292 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:29.855147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d93d2e-7a4b-4735-a3a2-6233c30b3292 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:29.855544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d93d2e-7a4b-4735-a3a2-6233c30b3292 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:29.885805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-69d93d2e-7a4b-4735-a3a2-6233c30b3292 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046270 Aug 24 06:26:29.886286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 641/1288] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:29 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:30.830173 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-27bc6d1f-602f-4bfb-a048-4feb80db2a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:30.832322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-27bc6d1f-602f-4bfb-a048-4feb80db2a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:30.839227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27bc6d1f-602f-4bfb-a048-4feb80db2a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:30.839715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27bc6d1f-602f-4bfb-a048-4feb80db2a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:30.840154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27bc6d1f-602f-4bfb-a048-4feb80db2a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:30.840900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27bc6d1f-602f-4bfb-a048-4feb80db2a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:30.841352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27bc6d1f-602f-4bfb-a048-4feb80db2a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:30.841770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-27bc6d1f-602f-4bfb-a048-4feb80db2a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:30.873790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-27bc6d1f-602f-4bfb-a048-4feb80db2a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047621 Aug 24 06:26:30.874365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 648/1289] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:30.898428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-61fff099-94b0-4f49-aefb-23cf0fc08593 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:30.900579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-61fff099-94b0-4f49-aefb-23cf0fc08593 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:30.907220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61fff099-94b0-4f49-aefb-23cf0fc08593 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:30.907693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61fff099-94b0-4f49-aefb-23cf0fc08593 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:30.908115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61fff099-94b0-4f49-aefb-23cf0fc08593 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:30.909344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61fff099-94b0-4f49-aefb-23cf0fc08593 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:30.913181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61fff099-94b0-4f49-aefb-23cf0fc08593 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:30.913181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61fff099-94b0-4f49-aefb-23cf0fc08593 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:30.944278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-61fff099-94b0-4f49-aefb-23cf0fc08593 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049844 Aug 24 06:26:30.944790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 642/1290] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:31.885818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2553b65a-32da-4739-be08-e4b1054e6df6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:31.887965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2553b65a-32da-4739-be08-e4b1054e6df6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:31.895208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2553b65a-32da-4739-be08-e4b1054e6df6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:31.895690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2553b65a-32da-4739-be08-e4b1054e6df6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:31.896120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2553b65a-32da-4739-be08-e4b1054e6df6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:31.896848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2553b65a-32da-4739-be08-e4b1054e6df6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:31.897293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2553b65a-32da-4739-be08-e4b1054e6df6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:31.897714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2553b65a-32da-4739-be08-e4b1054e6df6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:31.928447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2553b65a-32da-4739-be08-e4b1054e6df6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046479 Aug 24 06:26:31.929054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 649/1291] 10.222.0.62 () {58 vars in 1302 bytes} [Wed Aug 24 06:26:31 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:31.957282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c7924c68-5d28-4969-8d4c-397152d90fe1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:31.959481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c7924c68-5d28-4969-8d4c-397152d90fe1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:31.965994 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7924c68-5d28-4969-8d4c-397152d90fe1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:31.966462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7924c68-5d28-4969-8d4c-397152d90fe1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:31.966937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7924c68-5d28-4969-8d4c-397152d90fe1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:31.967633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7924c68-5d28-4969-8d4c-397152d90fe1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:31.968075 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7924c68-5d28-4969-8d4c-397152d90fe1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:31.968488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c7924c68-5d28-4969-8d4c-397152d90fe1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:31.998931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c7924c68-5d28-4969-8d4c-397152d90fe1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046191 Aug 24 06:26:31.999502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 643/1292] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:32.220839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:26:32.221061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:26:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:26:32.941428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-73ea578c-1996-4697-90da-53d70c6d1713 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:26:32.943714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-73ea578c-1996-4697-90da-53d70c6d1713 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:32.952330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73ea578c-1996-4697-90da-53d70c6d1713 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:32.952903 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73ea578c-1996-4697-90da-53d70c6d1713 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:32.953287 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73ea578c-1996-4697-90da-53d70c6d1713 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:32.953990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73ea578c-1996-4697-90da-53d70c6d1713 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:32.954445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73ea578c-1996-4697-90da-53d70c6d1713 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:32.954868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73ea578c-1996-4697-90da-53d70c6d1713 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:32.983271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR oslo.messaging._drivers.impl_rabbit [None req-73ea578c-1996-4697-90da-53d70c6d1713 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [6a6fc95c-c399-42da-94e1-2f53132ea67c] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:26:33.011334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f2c0ab70-a799-447c-9503-8cf3c38cb6bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:33.013496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f2c0ab70-a799-447c-9503-8cf3c38cb6bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:33.020185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2c0ab70-a799-447c-9503-8cf3c38cb6bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:33.020700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2c0ab70-a799-447c-9503-8cf3c38cb6bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:33.021129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2c0ab70-a799-447c-9503-8cf3c38cb6bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:33.021818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2c0ab70-a799-447c-9503-8cf3c38cb6bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:33.022263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2c0ab70-a799-447c-9503-8cf3c38cb6bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:33.022680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f2c0ab70-a799-447c-9503-8cf3c38cb6bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:33.053408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f2c0ab70-a799-447c-9503-8cf3c38cb6bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045956 Aug 24 06:26:33.053981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 644/1293] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:26:33.998430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [None req-73ea578c-1996-4697-90da-53d70c6d1713 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [6a6fc95c-c399-42da-94e1-2f53132ea67c] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 58944. Aug 24 06:26:34.061559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-73ea578c-1996-4697-90da-53d70c6d1713 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "POST /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/action" status: 200 len: 41403 microversion: 2.1 time: 1.124263 Aug 24 06:26:34.062447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 650/1294] 10.222.0.62 () {60 vars in 1278 bytes} [Wed Aug 24 06:26:32 2022] POST /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb/action => generated 41403 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:34.066481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9937c0fe-9b58-43ae-89b3-35a1f7c89caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:34.068747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9937c0fe-9b58-43ae-89b3-35a1f7c89caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:34.075754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9937c0fe-9b58-43ae-89b3-35a1f7c89caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:34.076242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9937c0fe-9b58-43ae-89b3-35a1f7c89caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:34.076707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9937c0fe-9b58-43ae-89b3-35a1f7c89caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:34.077417 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9937c0fe-9b58-43ae-89b3-35a1f7c89caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:34.077866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9937c0fe-9b58-43ae-89b3-35a1f7c89caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:34.078467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9937c0fe-9b58-43ae-89b3-35a1f7c89caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:34.116438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9937c0fe-9b58-43ae-89b3-35a1f7c89caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054771 Aug 24 06:26:34.117062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 645/1295] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:34 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 06:26:35.129613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2185985e-6743-47d0-9350-59e55e3e971b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:35.131908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2185985e-6743-47d0-9350-59e55e3e971b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:35.139634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2185985e-6743-47d0-9350-59e55e3e971b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:35.140110 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2185985e-6743-47d0-9350-59e55e3e971b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:35.140582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2185985e-6743-47d0-9350-59e55e3e971b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:35.141279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2185985e-6743-47d0-9350-59e55e3e971b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:35.141725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2185985e-6743-47d0-9350-59e55e3e971b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:35.142144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2185985e-6743-47d0-9350-59e55e3e971b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:35.186550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2185985e-6743-47d0-9350-59e55e3e971b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061332 Aug 24 06:26:35.187492 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 651/1296] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:35.203492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c9eb7a2d-76bb-48f6-8e0a-a71e1461725c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:35.204723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c9eb7a2d-76bb-48f6-8e0a-a71e1461725c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:35.211728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eb7a2d-76bb-48f6-8e0a-a71e1461725c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:35.212208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eb7a2d-76bb-48f6-8e0a-a71e1461725c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:35.212667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eb7a2d-76bb-48f6-8e0a-a71e1461725c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:35.213358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eb7a2d-76bb-48f6-8e0a-a71e1461725c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:35.213805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eb7a2d-76bb-48f6-8e0a-a71e1461725c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:35.214217 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eb7a2d-76bb-48f6-8e0a-a71e1461725c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:35.392111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-c9eb7a2d-76bb-48f6-8e0a-a71e1461725c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lazy-loading 'services' on Instance uuid 6f57e168-0ea9-4010-ac53-24c1da2474d7 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:26:35.703500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c9eb7a2d-76bb-48f6-8e0a-a71e1461725c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7/os-volume_attachments/6b28f644-bc25-456f-8bf3-d6690ff62f1c" status: 202 len: 0 microversion: 2.1 time: 0.503685 Aug 24 06:26:35.704157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 646/1297] 10.222.0.62 () {58 vars in 1416 bytes} [Wed Aug 24 06:26:35 2022] DELETE /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7/os-volume_attachments/6b28f644-bc25-456f-8bf3-d6690ff62f1c => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:26:36.201430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ee93e802-9aa8-49ea-b2f0-10b4f1fd217d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:36.203586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ee93e802-9aa8-49ea-b2f0-10b4f1fd217d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:36.210371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee93e802-9aa8-49ea-b2f0-10b4f1fd217d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:36.210852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee93e802-9aa8-49ea-b2f0-10b4f1fd217d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:36.211285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee93e802-9aa8-49ea-b2f0-10b4f1fd217d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:36.212107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee93e802-9aa8-49ea-b2f0-10b4f1fd217d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:36.212429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee93e802-9aa8-49ea-b2f0-10b4f1fd217d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:36.212889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee93e802-9aa8-49ea-b2f0-10b4f1fd217d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:36.248348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ee93e802-9aa8-49ea-b2f0-10b4f1fd217d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050919 Aug 24 06:26:36.248959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 652/1298] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:37.262187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9f5a8fa0-d278-469c-841f-59998f76df39 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:37.264547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9f5a8fa0-d278-469c-841f-59998f76df39 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:37.277140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fa0-d278-469c-841f-59998f76df39 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:37.277140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fa0-d278-469c-841f-59998f76df39 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:37.277140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fa0-d278-469c-841f-59998f76df39 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:37.277140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fa0-d278-469c-841f-59998f76df39 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:37.277667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fa0-d278-469c-841f-59998f76df39 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:37.277667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5a8fa0-d278-469c-841f-59998f76df39 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:37.314844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9f5a8fa0-d278-469c-841f-59998f76df39 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057451 Aug 24 06:26:37.315443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 647/1299] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:37.367151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-73736a94-1a09-4190-95ad-7ccc1cb19ecf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:37.367810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-73736a94-1a09-4190-95ad-7ccc1cb19ecf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:37.374095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73736a94-1a09-4190-95ad-7ccc1cb19ecf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:37.374573 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73736a94-1a09-4190-95ad-7ccc1cb19ecf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:37.375006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73736a94-1a09-4190-95ad-7ccc1cb19ecf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:37.375703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73736a94-1a09-4190-95ad-7ccc1cb19ecf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:37.376154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73736a94-1a09-4190-95ad-7ccc1cb19ecf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:37.376607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73736a94-1a09-4190-95ad-7ccc1cb19ecf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:37.404969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-73736a94-1a09-4190-95ad-7ccc1cb19ecf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:26:37.714950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-73736a94-1a09-4190-95ad-7ccc1cb19ecf tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "DELETE /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 204 len: 0 microversion: 2.1 time: 0.351372 Aug 24 06:26:37.715535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 653/1300] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:26:37 2022] DELETE /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:26:37.729327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6b138626-0b69-4883-a277-9cc2b66d81aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:37.730084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6b138626-0b69-4883-a277-9cc2b66d81aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:37.736179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b138626-0b69-4883-a277-9cc2b66d81aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:37.736700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b138626-0b69-4883-a277-9cc2b66d81aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:37.737130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b138626-0b69-4883-a277-9cc2b66d81aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:37.737874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b138626-0b69-4883-a277-9cc2b66d81aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:37.738317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b138626-0b69-4883-a277-9cc2b66d81aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:37.738730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6b138626-0b69-4883-a277-9cc2b66d81aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:37.874645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6b138626-0b69-4883-a277-9cc2b66d81aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:26:37.883627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6b138626-0b69-4883-a277-9cc2b66d81aa tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1554 microversion: 2.1 time: 0.163702 Aug 24 06:26:37.884187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 648/1301] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:26:37 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:26:38.328303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3f96723d-ecbb-40e8-a24e-f9ead7206a9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:38.332253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3f96723d-ecbb-40e8-a24e-f9ead7206a9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:38.342036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f96723d-ecbb-40e8-a24e-f9ead7206a9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:38.342639 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f96723d-ecbb-40e8-a24e-f9ead7206a9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:38.343299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f96723d-ecbb-40e8-a24e-f9ead7206a9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:38.344098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f96723d-ecbb-40e8-a24e-f9ead7206a9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:38.344611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f96723d-ecbb-40e8-a24e-f9ead7206a9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:38.345225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f96723d-ecbb-40e8-a24e-f9ead7206a9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:38.376656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3f96723d-ecbb-40e8-a24e-f9ead7206a9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052824 Aug 24 06:26:38.377312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 654/1302] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:38.847843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-9e8b1a06-3f56-468a-81e1-6eef3c9df927 req-02b4198a-e548-4d20-9595-85dcdc3016a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967afe19-8139-4888-ae38-b682c1188c8f", "name": "network-vif-deleted", "tag": "284c413d-f37f-41e3-a049-9aeaaa40a0c8"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:26:38.857768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-9e8b1a06-3f56-468a-81e1-6eef3c9df927 req-02b4198a-e548-4d20-9595-85dcdc3016a7 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:38.858241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-9e8b1a06-3f56-468a-81e1-6eef3c9df927 req-02b4198a-e548-4d20-9595-85dcdc3016a7 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:38.858665 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-9e8b1a06-3f56-468a-81e1-6eef3c9df927 req-02b4198a-e548-4d20-9595-85dcdc3016a7 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:38.862599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:26:38.869885 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-9e8b1a06-3f56-468a-81e1-6eef3c9df927 req-02b4198a-e548-4d20-9595-85dcdc3016a7 service nova] Creating event network-vif-deleted:284c413d-f37f-41e3-a049-9aeaaa40a0c8 for instance 967afe19-8139-4888-ae38-b682c1188c8f on hv-cinder-85426 Aug 24 06:26:38.875094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-9e8b1a06-3f56-468a-81e1-6eef3c9df927 req-02b4198a-e548-4d20-9595-85dcdc3016a7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107148 Aug 24 06:26:38.875691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 649/1303] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:26:38.905458 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-59529dfd-489b-4347-be0c-46ff68a017b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:38.906249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-59529dfd-489b-4347-be0c-46ff68a017b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:38.916043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59529dfd-489b-4347-be0c-46ff68a017b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:38.916763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59529dfd-489b-4347-be0c-46ff68a017b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:38.917505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59529dfd-489b-4347-be0c-46ff68a017b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:38.918240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59529dfd-489b-4347-be0c-46ff68a017b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:38.918689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59529dfd-489b-4347-be0c-46ff68a017b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:38.919134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59529dfd-489b-4347-be0c-46ff68a017b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:39.045117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-59529dfd-489b-4347-be0c-46ff68a017b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3a03b5f82724f37a2134554d42b2925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2adcef70b1f41d19ddee6811b47be41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:26:39.048889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:26:39.053651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-59529dfd-489b-4347-be0c-46ff68a017b8 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 200 len: 1512 microversion: 2.1 time: 0.152144 Aug 24 06:26:39.054308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 655/1304] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:26:38 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:26:39.459418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1851f18e-526b-49c9-b630-c165c0793b7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:39.461919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1851f18e-526b-49c9-b630-c165c0793b7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:39.469000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1851f18e-526b-49c9-b630-c165c0793b7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:39.469703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1851f18e-526b-49c9-b630-c165c0793b7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:39.470151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1851f18e-526b-49c9-b630-c165c0793b7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:39.470901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1851f18e-526b-49c9-b630-c165c0793b7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:39.471344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1851f18e-526b-49c9-b630-c165c0793b7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:39.471805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1851f18e-526b-49c9-b630-c165c0793b7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:39.507612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1851f18e-526b-49c9-b630-c165c0793b7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122498 Aug 24 06:26:39.512243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 650/1305] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:39.890056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:26:39.890684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:26:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:26:40.075186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:40.075789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] [instance: 967afe19-8139-4888-ae38-b682c1188c8f] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:40.083128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:40.083606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:40.084034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:40.084750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:40.085191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:40.085606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:40.099636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] HTTP exception thrown: Instance 967afe19-8139-4888-ae38-b682c1188c8f could not be found. Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Request method failure captured: Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f HTTP/1.1 Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcJuAYQ-1FOq5bxlBZ-B8fw4zdntumALmpmWAfW6Mh16IT9C-wOzUUAx-vEe1v5AqeSluLJPAEfhjqhdQZlI0oGIcqrS4EFbZ43a9AvEg22yulmVDHrGlfqg8VueTi5bCJAfKpVXl5RN8EqkS_kXmvzpT_foMj-6_6DwKkq6WlYyrfw Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: e2adcef70b1f41d19ddee6811b47be41 Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-TestMinimumBasicScenario-171285182 Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:26:40.101337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e2adcef70b1f41d19ddee6811b47be41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/e2adcef70b1f41d19ddee6811b47be41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/e2adcef70b1f41d19ddee6811b47be41"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_e2adcef70b1f41d19ddee6811b47be41", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-TestMinimumBasicScenario-171285182 Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: e2adcef70b1f41d19ddee6811b47be41 Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-TestMinimumBasicScenario-171285182 Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-TestMinimumBasicScenario-171285182-project Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: d3a03b5f82724f37a2134554d42b2925 Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-TestMinimumBasicScenario-171285182-project Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 967afe19-8139-4888-ae38-b682c1188c8f could not be found. Aug 24 06:26:40.102960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '967afe19-8139-4888-ae38-b682c1188c8f'} Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967afe19-8139-4888-ae38-b682c1188c8f could not be found. Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:26:40.103807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967afe19-8139-4888-ae38-b682c1188c8f could not be found. Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967afe19-8139-4888-ae38-b682c1188c8f could not be found. Aug 24 06:26:40.105447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:26:40.106750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Returning 404 to user: Instance 967afe19-8139-4888-ae38-b682c1188c8f could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:26:40.106750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8d0b0d76-ab27-4ca3-9eaa-56119cd51c83 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f" status: 404 len: 111 microversion: 2.1 time: 0.031492 Aug 24 06:26:40.106750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 656/1306] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:26:40 2022] GET /compute/v2.1/servers/967afe19-8139-4888-ae38-b682c1188c8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:26:40.111918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-944f9132-57f1-4e17-a7b3-716d03028fb4 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] Calling method '.version_select at 0x7fcddc1738b0>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:40.200626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-944f9132-57f1-4e17-a7b3-716d03028fb4 tempest-TestMinimumBasicScenario-171285182 tempest-TestMinimumBasicScenario-171285182-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1126420631" status: 202 len: 0 microversion: 2.1 time: 0.092737 Aug 24 06:26:40.201201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 651/1307] 10.222.0.62 () {58 vars in 1272 bytes} [Wed Aug 24 06:26:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1126420631 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:26:40.519826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e1204d1c-4b12-4092-8f67-9d97b9ad3255 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:40.522057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e1204d1c-4b12-4092-8f67-9d97b9ad3255 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:40.531712 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1204d1c-4b12-4092-8f67-9d97b9ad3255 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:40.532203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1204d1c-4b12-4092-8f67-9d97b9ad3255 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:40.532677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1204d1c-4b12-4092-8f67-9d97b9ad3255 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:40.533386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1204d1c-4b12-4092-8f67-9d97b9ad3255 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:40.533833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1204d1c-4b12-4092-8f67-9d97b9ad3255 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:40.534252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1204d1c-4b12-4092-8f67-9d97b9ad3255 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:40.570584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e1204d1c-4b12-4092-8f67-9d97b9ad3255 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054690 Aug 24 06:26:40.571161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 657/1308] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:41.604777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4112afff-1c88-4408-9913-7b6e0ee43417 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:26:41.604777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4112afff-1c88-4408-9913-7b6e0ee43417 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:41.604777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4112afff-1c88-4408-9913-7b6e0ee43417 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:41.604777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4112afff-1c88-4408-9913-7b6e0ee43417 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:41.605730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4112afff-1c88-4408-9913-7b6e0ee43417 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:41.605730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4112afff-1c88-4408-9913-7b6e0ee43417 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:41.605730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4112afff-1c88-4408-9913-7b6e0ee43417 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:41.605730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4112afff-1c88-4408-9913-7b6e0ee43417 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:41.626524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4112afff-1c88-4408-9913-7b6e0ee43417 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046987 Aug 24 06:26:41.627100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 652/1309] 10.222.0.62 () {60 vars in 1343 bytes} [Wed Aug 24 06:26:41 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:26:42.639173 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-db19f6d0-228d-41db-baab-0c9c864656dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:26:42.641385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-db19f6d0-228d-41db-baab-0c9c864656dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:26:42.648405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db19f6d0-228d-41db-baab-0c9c864656dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:42.648926 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db19f6d0-228d-41db-baab-0c9c864656dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:42.649381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db19f6d0-228d-41db-baab-0c9c864656dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:42.650086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db19f6d0-228d-41db-baab-0c9c864656dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:26:42.650535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db19f6d0-228d-41db-baab-0c9c864656dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:26:42.650961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db19f6d0-228d-41db-baab-0c9c864656dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:26:42.725251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-db19f6d0-228d-41db-baab-0c9c864656dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "POST /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/action" status: 200 len: 37960 microversion: 2.20 time: 0.089884 Aug 24 06:26:42.726822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 658/1310] 10.222.0.62 () {62 vars in 1319 bytes} [Wed Aug 24 06:26:42 2022] POST /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9/action => generated 37960 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:26:45.186708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:26:45.187404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:26:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:26:45.808334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:26:45.808988 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:26:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:27:04.902196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:27:04.902918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=12 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:27:05.104141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-607b0d82-a4df-4fb5-b05b-a4c37d22e15d tempest-TestShelveInstance-1117133601 tempest-TestShelveInstance-1117133601-project] Action: 'create', calling method: .version_select at 0x7fcddc3030d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1073337624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKcBf3xB87P5+y+jzgdKaTysxZslvM8JSCsB6QQLLw+kVjnmIskZ5pj0sIW0VPZCgSWy5bPhWomB1P1CW4Ru8hZauAEiHbrjI7Xv/lBLo7haI0/aj/ww7tYOo+DNhIvfzw=="}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:27:05.123799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-607b0d82-a4df-4fb5-b05b-a4c37d22e15d tempest-TestShelveInstance-1117133601 tempest-TestShelveInstance-1117133601-project] Getting quotas for project df659b3447644e7dbe0f124b881e4344. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:27:05.127985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-607b0d82-a4df-4fb5-b05b-a4c37d22e15d tempest-TestShelveInstance-1117133601 tempest-TestShelveInstance-1117133601-project] Getting quotas for user 27d9cb186f8f40498141aa20db23e9d0 and project df659b3447644e7dbe0f124b881e4344. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:27:05.229971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-607b0d82-a4df-4fb5-b05b-a4c37d22e15d tempest-TestShelveInstance-1117133601 tempest-TestShelveInstance-1117133601-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.332429 Aug 24 06:27:05.230586 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 653/1311] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 24 06:27:04 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:27:11.240616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9bdbabb5-a04c-43de-a112-75cff717e1a0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:11.241797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9bdbabb5-a04c-43de-a112-75cff717e1a0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:11.244597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:27:11.247471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=12 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:27:11.254229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bdbabb5-a04c-43de-a112-75cff717e1a0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:11.254777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bdbabb5-a04c-43de-a112-75cff717e1a0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:11.255428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bdbabb5-a04c-43de-a112-75cff717e1a0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:11.256394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bdbabb5-a04c-43de-a112-75cff717e1a0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:11.257132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bdbabb5-a04c-43de-a112-75cff717e1a0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:11.257617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bdbabb5-a04c-43de-a112-75cff717e1a0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:11.295341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9bdbabb5-a04c-43de-a112-75cff717e1a0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:27:11.776892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9bdbabb5-a04c-43de-a112-75cff717e1a0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "DELETE /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 204 len: 0 microversion: 2.1 time: 0.540916 Aug 24 06:27:11.777491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 659/1312] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:27:11 2022] DELETE /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:27:11.786001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f5e30773-f303-44a6-a10d-fa605e9d0f8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:11.786615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f5e30773-f303-44a6-a10d-fa605e9d0f8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:11.792670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5e30773-f303-44a6-a10d-fa605e9d0f8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:11.793156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5e30773-f303-44a6-a10d-fa605e9d0f8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:11.793587 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5e30773-f303-44a6-a10d-fa605e9d0f8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:11.794280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5e30773-f303-44a6-a10d-fa605e9d0f8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:11.794728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5e30773-f303-44a6-a10d-fa605e9d0f8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:11.795161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5e30773-f303-44a6-a10d-fa605e9d0f8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:11.933564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f5e30773-f303-44a6-a10d-fa605e9d0f8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:11.942959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f5e30773-f303-44a6-a10d-fa605e9d0f8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.161359 Aug 24 06:27:11.943525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 654/1313] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:11 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:12.963889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b2c5cc88-71ac-49b1-9b91-ce3b1e274966 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:12.964617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b2c5cc88-71ac-49b1-9b91-ce3b1e274966 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:12.972250 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2c5cc88-71ac-49b1-9b91-ce3b1e274966 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:12.972764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2c5cc88-71ac-49b1-9b91-ce3b1e274966 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:12.973198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2c5cc88-71ac-49b1-9b91-ce3b1e274966 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:12.973903 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2c5cc88-71ac-49b1-9b91-ce3b1e274966 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:12.974354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2c5cc88-71ac-49b1-9b91-ce3b1e274966 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:12.974776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2c5cc88-71ac-49b1-9b91-ce3b1e274966 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:13.115514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b2c5cc88-71ac-49b1-9b91-ce3b1e274966 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:13.124449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b2c5cc88-71ac-49b1-9b91-ce3b1e274966 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.164749 Aug 24 06:27:13.125069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 660/1314] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:12 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:14.145787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8767d04e-6a3a-4f33-9c86-0f90ea24d59e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:14.146339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8767d04e-6a3a-4f33-9c86-0f90ea24d59e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:14.152797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8767d04e-6a3a-4f33-9c86-0f90ea24d59e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:14.153277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8767d04e-6a3a-4f33-9c86-0f90ea24d59e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:14.153707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8767d04e-6a3a-4f33-9c86-0f90ea24d59e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:14.154393 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8767d04e-6a3a-4f33-9c86-0f90ea24d59e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:14.155170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8767d04e-6a3a-4f33-9c86-0f90ea24d59e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:14.155273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8767d04e-6a3a-4f33-9c86-0f90ea24d59e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:14.289549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8767d04e-6a3a-4f33-9c86-0f90ea24d59e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:14.298296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8767d04e-6a3a-4f33-9c86-0f90ea24d59e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155877 Aug 24 06:27:14.299302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 655/1315] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:14 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:15.319845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-675210a0-29cf-4206-b55f-9d2a338baecb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:15.320461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-675210a0-29cf-4206-b55f-9d2a338baecb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:15.327211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675210a0-29cf-4206-b55f-9d2a338baecb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:15.327724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675210a0-29cf-4206-b55f-9d2a338baecb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:15.328163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675210a0-29cf-4206-b55f-9d2a338baecb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:15.329028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675210a0-29cf-4206-b55f-9d2a338baecb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:15.329929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675210a0-29cf-4206-b55f-9d2a338baecb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:15.330358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675210a0-29cf-4206-b55f-9d2a338baecb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:15.465293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-675210a0-29cf-4206-b55f-9d2a338baecb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:15.474556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-675210a0-29cf-4206-b55f-9d2a338baecb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158652 Aug 24 06:27:15.475463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 661/1316] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:15 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:16.496398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3b5d38d9-1004-4c30-b193-42553d7be30b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:16.497783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3b5d38d9-1004-4c30-b193-42553d7be30b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:16.500181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=4 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:27:16.505632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b5d38d9-1004-4c30-b193-42553d7be30b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:16.506157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b5d38d9-1004-4c30-b193-42553d7be30b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:16.506597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b5d38d9-1004-4c30-b193-42553d7be30b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:16.507369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b5d38d9-1004-4c30-b193-42553d7be30b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:16.507770 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b5d38d9-1004-4c30-b193-42553d7be30b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:16.508191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b5d38d9-1004-4c30-b193-42553d7be30b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:16.871373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3b5d38d9-1004-4c30-b193-42553d7be30b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:16.879605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3b5d38d9-1004-4c30-b193-42553d7be30b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.387092 Aug 24 06:27:16.880171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 656/1317] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:16 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:17.900864 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0904d91c-5246-427e-a9a8-909e2de0c8d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:17.901416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0904d91c-5246-427e-a9a8-909e2de0c8d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:17.908044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0904d91c-5246-427e-a9a8-909e2de0c8d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:17.908560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0904d91c-5246-427e-a9a8-909e2de0c8d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:17.909003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0904d91c-5246-427e-a9a8-909e2de0c8d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:17.909710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0904d91c-5246-427e-a9a8-909e2de0c8d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:17.910192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0904d91c-5246-427e-a9a8-909e2de0c8d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:17.910612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0904d91c-5246-427e-a9a8-909e2de0c8d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:18.043405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0904d91c-5246-427e-a9a8-909e2de0c8d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:18.052102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0904d91c-5246-427e-a9a8-909e2de0c8d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155319 Aug 24 06:27:18.052687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 662/1318] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:17 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:19.074054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ec0021ba-0682-4016-8a6f-bafb2d08fa27 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:19.074670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ec0021ba-0682-4016-8a6f-bafb2d08fa27 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:19.081392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec0021ba-0682-4016-8a6f-bafb2d08fa27 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:19.081875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec0021ba-0682-4016-8a6f-bafb2d08fa27 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:19.082335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec0021ba-0682-4016-8a6f-bafb2d08fa27 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:19.083029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec0021ba-0682-4016-8a6f-bafb2d08fa27 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:19.083483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec0021ba-0682-4016-8a6f-bafb2d08fa27 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:19.083906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec0021ba-0682-4016-8a6f-bafb2d08fa27 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:19.212462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ec0021ba-0682-4016-8a6f-bafb2d08fa27 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:19.221523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ec0021ba-0682-4016-8a6f-bafb2d08fa27 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151326 Aug 24 06:27:19.222087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 657/1319] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:19 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:20.242646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-36e4119d-550b-42a8-92e7-c09645aeaf56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:20.243254 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-36e4119d-550b-42a8-92e7-c09645aeaf56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:20.249675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36e4119d-550b-42a8-92e7-c09645aeaf56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:20.250178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36e4119d-550b-42a8-92e7-c09645aeaf56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:20.251264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36e4119d-550b-42a8-92e7-c09645aeaf56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:20.251986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36e4119d-550b-42a8-92e7-c09645aeaf56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:20.252438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36e4119d-550b-42a8-92e7-c09645aeaf56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:20.257846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-36e4119d-550b-42a8-92e7-c09645aeaf56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:20.392251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-36e4119d-550b-42a8-92e7-c09645aeaf56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:20.400399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-36e4119d-550b-42a8-92e7-c09645aeaf56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.161743 Aug 24 06:27:20.400994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 663/1320] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:20 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:21.421524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ff28c642-3c7a-40a7-85a8-eb43e38eb290 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:21.422131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ff28c642-3c7a-40a7-85a8-eb43e38eb290 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:21.428816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff28c642-3c7a-40a7-85a8-eb43e38eb290 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:21.429299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff28c642-3c7a-40a7-85a8-eb43e38eb290 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:21.429731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff28c642-3c7a-40a7-85a8-eb43e38eb290 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:21.430425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff28c642-3c7a-40a7-85a8-eb43e38eb290 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:21.430878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff28c642-3c7a-40a7-85a8-eb43e38eb290 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:21.431298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff28c642-3c7a-40a7-85a8-eb43e38eb290 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:21.563993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ff28c642-3c7a-40a7-85a8-eb43e38eb290 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:21.572300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ff28c642-3c7a-40a7-85a8-eb43e38eb290 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154691 Aug 24 06:27:21.572899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 658/1321] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:21 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:22.593684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-eab192eb-52c7-4b48-8615-55d30a3d2508 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:22.594330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-eab192eb-52c7-4b48-8615-55d30a3d2508 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:22.601318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab192eb-52c7-4b48-8615-55d30a3d2508 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:22.601812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab192eb-52c7-4b48-8615-55d30a3d2508 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:22.602252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab192eb-52c7-4b48-8615-55d30a3d2508 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:22.602963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab192eb-52c7-4b48-8615-55d30a3d2508 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:22.603418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab192eb-52c7-4b48-8615-55d30a3d2508 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:22.603842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab192eb-52c7-4b48-8615-55d30a3d2508 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:22.745309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-eab192eb-52c7-4b48-8615-55d30a3d2508 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:22.753488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-eab192eb-52c7-4b48-8615-55d30a3d2508 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.163666 Aug 24 06:27:22.754049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 664/1322] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:22 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:23.775292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ae4fd255-9bf4-4cff-b676-0476d015a5fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:23.775964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ae4fd255-9bf4-4cff-b676-0476d015a5fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:23.783307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4fd255-9bf4-4cff-b676-0476d015a5fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:23.783886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4fd255-9bf4-4cff-b676-0476d015a5fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:23.784415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4fd255-9bf4-4cff-b676-0476d015a5fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:23.785226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4fd255-9bf4-4cff-b676-0476d015a5fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:23.785703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4fd255-9bf4-4cff-b676-0476d015a5fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:23.786131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae4fd255-9bf4-4cff-b676-0476d015a5fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:23.918009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ae4fd255-9bf4-4cff-b676-0476d015a5fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:23.926291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ae4fd255-9bf4-4cff-b676-0476d015a5fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155007 Aug 24 06:27:23.926861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 659/1323] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:23 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:24.949322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7592debe-b8ae-4502-908d-1508d391caa3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:24.949944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7592debe-b8ae-4502-908d-1508d391caa3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:24.956767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7592debe-b8ae-4502-908d-1508d391caa3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:24.957252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7592debe-b8ae-4502-908d-1508d391caa3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:24.957709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7592debe-b8ae-4502-908d-1508d391caa3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:24.958428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7592debe-b8ae-4502-908d-1508d391caa3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:24.958886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7592debe-b8ae-4502-908d-1508d391caa3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:24.959368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7592debe-b8ae-4502-908d-1508d391caa3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:25.089153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7592debe-b8ae-4502-908d-1508d391caa3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:25.097886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7592debe-b8ae-4502-908d-1508d391caa3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153175 Aug 24 06:27:25.098471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 665/1324] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:24 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:26.118922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-149eb4f9-4e97-4465-b530-a263066cfabd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:26.119645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-149eb4f9-4e97-4465-b530-a263066cfabd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:26.126812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-149eb4f9-4e97-4465-b530-a263066cfabd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:26.127293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-149eb4f9-4e97-4465-b530-a263066cfabd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:26.127724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-149eb4f9-4e97-4465-b530-a263066cfabd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:26.128410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-149eb4f9-4e97-4465-b530-a263066cfabd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:26.128894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-149eb4f9-4e97-4465-b530-a263066cfabd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:26.129314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-149eb4f9-4e97-4465-b530-a263066cfabd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:26.259455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-149eb4f9-4e97-4465-b530-a263066cfabd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:26.267578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-149eb4f9-4e97-4465-b530-a263066cfabd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152490 Aug 24 06:27:26.268137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 660/1325] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:26 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:27.289331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d6f94746-c2b6-46c0-b346-9fab92092ab2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:27.289907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d6f94746-c2b6-46c0-b346-9fab92092ab2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:27.295826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6f94746-c2b6-46c0-b346-9fab92092ab2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:27.296309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6f94746-c2b6-46c0-b346-9fab92092ab2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:27.296773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6f94746-c2b6-46c0-b346-9fab92092ab2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:27.297493 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6f94746-c2b6-46c0-b346-9fab92092ab2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:27.297967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6f94746-c2b6-46c0-b346-9fab92092ab2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:27.298390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6f94746-c2b6-46c0-b346-9fab92092ab2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:27.430194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d6f94746-c2b6-46c0-b346-9fab92092ab2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:27.439095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d6f94746-c2b6-46c0-b346-9fab92092ab2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154368 Aug 24 06:27:27.439651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 666/1326] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:27 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:28.460482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9a344492-e125-4f5a-bd1f-4ee403fcc70c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:28.461118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9a344492-e125-4f5a-bd1f-4ee403fcc70c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:28.467691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a344492-e125-4f5a-bd1f-4ee403fcc70c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:28.468171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a344492-e125-4f5a-bd1f-4ee403fcc70c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:28.468631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a344492-e125-4f5a-bd1f-4ee403fcc70c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:28.469958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a344492-e125-4f5a-bd1f-4ee403fcc70c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:28.470408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a344492-e125-4f5a-bd1f-4ee403fcc70c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:28.470829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a344492-e125-4f5a-bd1f-4ee403fcc70c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:28.599356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a344492-e125-4f5a-bd1f-4ee403fcc70c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:28.607648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9a344492-e125-4f5a-bd1f-4ee403fcc70c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151008 Aug 24 06:27:28.608264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 661/1327] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:28 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:29.628961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0898bdc0-16a9-4b53-92b6-fe17d5ba4314 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:29.629600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0898bdc0-16a9-4b53-92b6-fe17d5ba4314 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:29.636083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0898bdc0-16a9-4b53-92b6-fe17d5ba4314 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:29.636586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0898bdc0-16a9-4b53-92b6-fe17d5ba4314 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:29.637018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0898bdc0-16a9-4b53-92b6-fe17d5ba4314 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:29.637706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0898bdc0-16a9-4b53-92b6-fe17d5ba4314 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:29.638154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0898bdc0-16a9-4b53-92b6-fe17d5ba4314 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:29.638600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0898bdc0-16a9-4b53-92b6-fe17d5ba4314 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:29.768919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0898bdc0-16a9-4b53-92b6-fe17d5ba4314 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:29.777260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0898bdc0-16a9-4b53-92b6-fe17d5ba4314 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152117 Aug 24 06:27:29.777831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 667/1328] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:29 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:30.804165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2fec6614-5892-482d-b313-8b4a577a90ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:30.804795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2fec6614-5892-482d-b313-8b4a577a90ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:30.811455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fec6614-5892-482d-b313-8b4a577a90ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:30.811927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fec6614-5892-482d-b313-8b4a577a90ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:30.812355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fec6614-5892-482d-b313-8b4a577a90ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:30.813088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fec6614-5892-482d-b313-8b4a577a90ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:30.813529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fec6614-5892-482d-b313-8b4a577a90ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:30.813943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fec6614-5892-482d-b313-8b4a577a90ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:30.943060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2fec6614-5892-482d-b313-8b4a577a90ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:30.951491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2fec6614-5892-482d-b313-8b4a577a90ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151115 Aug 24 06:27:30.952060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 662/1329] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:30 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:31.973816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6987020f-71e2-47b6-b1b5-0706c624e7e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:31.974402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6987020f-71e2-47b6-b1b5-0706c624e7e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:31.980829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6987020f-71e2-47b6-b1b5-0706c624e7e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:31.981309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6987020f-71e2-47b6-b1b5-0706c624e7e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:31.981750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6987020f-71e2-47b6-b1b5-0706c624e7e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:31.982427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6987020f-71e2-47b6-b1b5-0706c624e7e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:31.982899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6987020f-71e2-47b6-b1b5-0706c624e7e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:31.983319 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6987020f-71e2-47b6-b1b5-0706c624e7e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:32.115824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6987020f-71e2-47b6-b1b5-0706c624e7e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:32.124069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6987020f-71e2-47b6-b1b5-0706c624e7e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154221 Aug 24 06:27:32.124660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 668/1330] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:31 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:33.145927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b5f07a75-dfe2-46d2-9f13-8c3de99623d8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:33.146529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b5f07a75-dfe2-46d2-9f13-8c3de99623d8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:33.152588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5f07a75-dfe2-46d2-9f13-8c3de99623d8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:33.153066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5f07a75-dfe2-46d2-9f13-8c3de99623d8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:33.153496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5f07a75-dfe2-46d2-9f13-8c3de99623d8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:33.154179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5f07a75-dfe2-46d2-9f13-8c3de99623d8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:33.154766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5f07a75-dfe2-46d2-9f13-8c3de99623d8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:33.155191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5f07a75-dfe2-46d2-9f13-8c3de99623d8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:33.291348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b5f07a75-dfe2-46d2-9f13-8c3de99623d8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:33.300028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b5f07a75-dfe2-46d2-9f13-8c3de99623d8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158298 Aug 24 06:27:33.300632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 663/1331] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:33 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:34.322152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-06167b76-f937-4e92-a809-c1a0b5ddd268 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:34.322766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-06167b76-f937-4e92-a809-c1a0b5ddd268 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:34.330355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06167b76-f937-4e92-a809-c1a0b5ddd268 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:34.331054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06167b76-f937-4e92-a809-c1a0b5ddd268 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:34.331703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06167b76-f937-4e92-a809-c1a0b5ddd268 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:34.332713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06167b76-f937-4e92-a809-c1a0b5ddd268 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:34.333407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06167b76-f937-4e92-a809-c1a0b5ddd268 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:34.334037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-06167b76-f937-4e92-a809-c1a0b5ddd268 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:34.487702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-06167b76-f937-4e92-a809-c1a0b5ddd268 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:34.491123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-06167b76-f937-4e92-a809-c1a0b5ddd268 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.172776 Aug 24 06:27:34.491679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 669/1332] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:34 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:35.511388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0f24c647-e682-4367-8eaa-5353f66e3e6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:35.512097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0f24c647-e682-4367-8eaa-5353f66e3e6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:35.514899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:27:35.519674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f24c647-e682-4367-8eaa-5353f66e3e6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:35.520201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f24c647-e682-4367-8eaa-5353f66e3e6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:35.520727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f24c647-e682-4367-8eaa-5353f66e3e6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:35.521430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f24c647-e682-4367-8eaa-5353f66e3e6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:35.521924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f24c647-e682-4367-8eaa-5353f66e3e6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:35.522364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f24c647-e682-4367-8eaa-5353f66e3e6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:35.526715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=61 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:27:35.652036 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0f24c647-e682-4367-8eaa-5353f66e3e6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:35.664590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0f24c647-e682-4367-8eaa-5353f66e3e6b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156993 Aug 24 06:27:35.665160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 664/1333] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:35 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:27:36.690018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-67d09e0b-34d5-4ef7-b13d-3c2aa5fef9e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:36.690768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-67d09e0b-34d5-4ef7-b13d-3c2aa5fef9e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:36.697715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67d09e0b-34d5-4ef7-b13d-3c2aa5fef9e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:36.698187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67d09e0b-34d5-4ef7-b13d-3c2aa5fef9e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:36.698642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67d09e0b-34d5-4ef7-b13d-3c2aa5fef9e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:36.699320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67d09e0b-34d5-4ef7-b13d-3c2aa5fef9e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:36.699760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67d09e0b-34d5-4ef7-b13d-3c2aa5fef9e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:36.700172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67d09e0b-34d5-4ef7-b13d-3c2aa5fef9e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:36.826494 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-67d09e0b-34d5-4ef7-b13d-3c2aa5fef9e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:36.835117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-67d09e0b-34d5-4ef7-b13d-3c2aa5fef9e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149733 Aug 24 06:27:36.835679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 670/1334] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:36 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:37.857305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6995c358-0260-4ceb-9c9d-bb94585ac37b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:37.857923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6995c358-0260-4ceb-9c9d-bb94585ac37b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:37.864996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6995c358-0260-4ceb-9c9d-bb94585ac37b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:37.865540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6995c358-0260-4ceb-9c9d-bb94585ac37b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:37.865924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6995c358-0260-4ceb-9c9d-bb94585ac37b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:37.866624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6995c358-0260-4ceb-9c9d-bb94585ac37b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:37.867076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6995c358-0260-4ceb-9c9d-bb94585ac37b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:37.867499 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6995c358-0260-4ceb-9c9d-bb94585ac37b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:38.000595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6995c358-0260-4ceb-9c9d-bb94585ac37b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:38.008787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6995c358-0260-4ceb-9c9d-bb94585ac37b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155435 Aug 24 06:27:38.009367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 665/1335] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:37 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:39.029295 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3cb87bfa-641c-4b11-8234-368512a5a299 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:39.029906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3cb87bfa-641c-4b11-8234-368512a5a299 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:39.036360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cb87bfa-641c-4b11-8234-368512a5a299 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:39.036869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cb87bfa-641c-4b11-8234-368512a5a299 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:39.037321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cb87bfa-641c-4b11-8234-368512a5a299 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:39.037993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cb87bfa-641c-4b11-8234-368512a5a299 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:39.038446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cb87bfa-641c-4b11-8234-368512a5a299 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:39.038863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3cb87bfa-641c-4b11-8234-368512a5a299 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:39.167343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3cb87bfa-641c-4b11-8234-368512a5a299 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:39.176272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3cb87bfa-641c-4b11-8234-368512a5a299 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150874 Aug 24 06:27:39.176939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 671/1336] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:39 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:40.197521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e8445d3c-9783-45f9-9ab8-a8de984f562c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:40.198135 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e8445d3c-9783-45f9-9ab8-a8de984f562c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:40.205351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8445d3c-9783-45f9-9ab8-a8de984f562c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:40.205835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8445d3c-9783-45f9-9ab8-a8de984f562c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:40.206266 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8445d3c-9783-45f9-9ab8-a8de984f562c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:40.206985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8445d3c-9783-45f9-9ab8-a8de984f562c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:40.207444 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8445d3c-9783-45f9-9ab8-a8de984f562c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:40.207867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8445d3c-9783-45f9-9ab8-a8de984f562c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:40.339048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e8445d3c-9783-45f9-9ab8-a8de984f562c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:40.347115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e8445d3c-9783-45f9-9ab8-a8de984f562c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153522 Aug 24 06:27:40.347677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 666/1337] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:40 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:41.367956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9b25b552-a22b-4d6d-9a10-416aba72c7b6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:41.368523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9b25b552-a22b-4d6d-9a10-416aba72c7b6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:41.374957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b25b552-a22b-4d6d-9a10-416aba72c7b6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:41.375432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b25b552-a22b-4d6d-9a10-416aba72c7b6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:41.375863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b25b552-a22b-4d6d-9a10-416aba72c7b6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:41.376575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b25b552-a22b-4d6d-9a10-416aba72c7b6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:41.377024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b25b552-a22b-4d6d-9a10-416aba72c7b6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:41.377444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b25b552-a22b-4d6d-9a10-416aba72c7b6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:41.503035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9b25b552-a22b-4d6d-9a10-416aba72c7b6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:41.511372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9b25b552-a22b-4d6d-9a10-416aba72c7b6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.147336 Aug 24 06:27:41.511931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 672/1338] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:41 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:42.533945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-030b6275-ab60-4b95-8ac0-5d342ae8f225 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:42.534540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-030b6275-ab60-4b95-8ac0-5d342ae8f225 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:42.540940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-030b6275-ab60-4b95-8ac0-5d342ae8f225 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:42.541419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-030b6275-ab60-4b95-8ac0-5d342ae8f225 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:42.541847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-030b6275-ab60-4b95-8ac0-5d342ae8f225 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:42.542531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-030b6275-ab60-4b95-8ac0-5d342ae8f225 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:42.542979 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-030b6275-ab60-4b95-8ac0-5d342ae8f225 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:42.543401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-030b6275-ab60-4b95-8ac0-5d342ae8f225 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:42.675143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-030b6275-ab60-4b95-8ac0-5d342ae8f225 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:42.683731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-030b6275-ab60-4b95-8ac0-5d342ae8f225 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154223 Aug 24 06:27:42.684301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 667/1339] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:42 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:43.706728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5abb5c9b-b0f5-472a-95e7-bd4c5771aae3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:43.707590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5abb5c9b-b0f5-472a-95e7-bd4c5771aae3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:43.710812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:27:43.715497 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abb5c9b-b0f5-472a-95e7-bd4c5771aae3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:43.715964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abb5c9b-b0f5-472a-95e7-bd4c5771aae3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:43.716395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abb5c9b-b0f5-472a-95e7-bd4c5771aae3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:43.717108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abb5c9b-b0f5-472a-95e7-bd4c5771aae3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:43.717553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abb5c9b-b0f5-472a-95e7-bd4c5771aae3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:43.717969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abb5c9b-b0f5-472a-95e7-bd4c5771aae3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:43.721122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:27:43.862748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5abb5c9b-b0f5-472a-95e7-bd4c5771aae3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:43.878037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5abb5c9b-b0f5-472a-95e7-bd4c5771aae3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.169702 Aug 24 06:27:43.878037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 673/1340] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:43 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:44.891414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6584f5dc-63da-45ba-8787-d2b970b73164 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:44.892094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6584f5dc-63da-45ba-8787-d2b970b73164 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:44.898508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6584f5dc-63da-45ba-8787-d2b970b73164 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:44.898990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6584f5dc-63da-45ba-8787-d2b970b73164 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:44.899421 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6584f5dc-63da-45ba-8787-d2b970b73164 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:44.900117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6584f5dc-63da-45ba-8787-d2b970b73164 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:44.900593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6584f5dc-63da-45ba-8787-d2b970b73164 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:44.901040 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6584f5dc-63da-45ba-8787-d2b970b73164 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:45.040157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6584f5dc-63da-45ba-8787-d2b970b73164 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:45.048776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6584f5dc-63da-45ba-8787-d2b970b73164 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.161186 Aug 24 06:27:45.049369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 668/1341] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:44 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:46.070668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-79992a4d-a93b-454e-9b94-500ebeb69562 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:46.071279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-79992a4d-a93b-454e-9b94-500ebeb69562 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:46.080487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79992a4d-a93b-454e-9b94-500ebeb69562 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:46.080996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79992a4d-a93b-454e-9b94-500ebeb69562 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:46.081435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79992a4d-a93b-454e-9b94-500ebeb69562 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:46.082138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79992a4d-a93b-454e-9b94-500ebeb69562 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:46.082617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79992a4d-a93b-454e-9b94-500ebeb69562 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:46.083070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79992a4d-a93b-454e-9b94-500ebeb69562 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:46.211154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-79992a4d-a93b-454e-9b94-500ebeb69562 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:46.219426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-79992a4d-a93b-454e-9b94-500ebeb69562 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153017 Aug 24 06:27:46.219910 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 674/1342] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:46 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:47.241780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8af808a6-925a-468f-9605-b89bda7ff2cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:47.242338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8af808a6-925a-468f-9605-b89bda7ff2cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:47.248823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8af808a6-925a-468f-9605-b89bda7ff2cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:47.249327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8af808a6-925a-468f-9605-b89bda7ff2cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:47.249763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8af808a6-925a-468f-9605-b89bda7ff2cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:47.250454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8af808a6-925a-468f-9605-b89bda7ff2cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:47.251531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8af808a6-925a-468f-9605-b89bda7ff2cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:47.251959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8af808a6-925a-468f-9605-b89bda7ff2cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:47.377757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8af808a6-925a-468f-9605-b89bda7ff2cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:47.386050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8af808a6-925a-468f-9605-b89bda7ff2cf tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.148260 Aug 24 06:27:47.386632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 669/1343] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:47 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:48.407249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fbe95cac-f6c1-4651-9943-d59d0371289b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:48.407855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fbe95cac-f6c1-4651-9943-d59d0371289b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:48.413836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbe95cac-f6c1-4651-9943-d59d0371289b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:48.414310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbe95cac-f6c1-4651-9943-d59d0371289b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:48.414741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbe95cac-f6c1-4651-9943-d59d0371289b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:48.415422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbe95cac-f6c1-4651-9943-d59d0371289b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:48.415869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbe95cac-f6c1-4651-9943-d59d0371289b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:48.416287 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbe95cac-f6c1-4651-9943-d59d0371289b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:48.547084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fbe95cac-f6c1-4651-9943-d59d0371289b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:48.555790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fbe95cac-f6c1-4651-9943-d59d0371289b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152592 Aug 24 06:27:48.556362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 675/1344] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:48 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:49.578002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ae997e01-c3d1-4f0e-9546-7dad5852df35 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:49.578613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ae997e01-c3d1-4f0e-9546-7dad5852df35 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:49.585105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae997e01-c3d1-4f0e-9546-7dad5852df35 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:49.585579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae997e01-c3d1-4f0e-9546-7dad5852df35 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:49.586017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae997e01-c3d1-4f0e-9546-7dad5852df35 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:49.586695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae997e01-c3d1-4f0e-9546-7dad5852df35 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:49.587143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae997e01-c3d1-4f0e-9546-7dad5852df35 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:49.587562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae997e01-c3d1-4f0e-9546-7dad5852df35 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:49.719355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ae997e01-c3d1-4f0e-9546-7dad5852df35 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:49.727944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ae997e01-c3d1-4f0e-9546-7dad5852df35 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153829 Aug 24 06:27:49.728508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 670/1345] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:49 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:50.749012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6812cecd-76c0-43a7-8fe7-c8e13983dbde tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:50.749668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6812cecd-76c0-43a7-8fe7-c8e13983dbde tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:50.756741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6812cecd-76c0-43a7-8fe7-c8e13983dbde tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:50.757212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6812cecd-76c0-43a7-8fe7-c8e13983dbde tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:50.757637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6812cecd-76c0-43a7-8fe7-c8e13983dbde tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:50.758321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6812cecd-76c0-43a7-8fe7-c8e13983dbde tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:50.758766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6812cecd-76c0-43a7-8fe7-c8e13983dbde tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:50.759175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6812cecd-76c0-43a7-8fe7-c8e13983dbde tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:50.886555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6812cecd-76c0-43a7-8fe7-c8e13983dbde tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:50.894655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6812cecd-76c0-43a7-8fe7-c8e13983dbde tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149529 Aug 24 06:27:50.895226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 676/1346] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:50 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:51.915204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-eff953d1-398d-4204-b372-74d3502ffbaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:51.915785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-eff953d1-398d-4204-b372-74d3502ffbaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:51.922311 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eff953d1-398d-4204-b372-74d3502ffbaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:51.926739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eff953d1-398d-4204-b372-74d3502ffbaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:51.926739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eff953d1-398d-4204-b372-74d3502ffbaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:51.926739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eff953d1-398d-4204-b372-74d3502ffbaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:51.926739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eff953d1-398d-4204-b372-74d3502ffbaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:51.927177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eff953d1-398d-4204-b372-74d3502ffbaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:52.051987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-eff953d1-398d-4204-b372-74d3502ffbaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:52.060296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-eff953d1-398d-4204-b372-74d3502ffbaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.148987 Aug 24 06:27:52.060888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 671/1347] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:51 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:53.082917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0567dbf3-7952-49f1-9770-25bddd45af86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:53.083518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0567dbf3-7952-49f1-9770-25bddd45af86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:53.090041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0567dbf3-7952-49f1-9770-25bddd45af86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:53.090515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0567dbf3-7952-49f1-9770-25bddd45af86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:53.090944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0567dbf3-7952-49f1-9770-25bddd45af86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:53.091628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0567dbf3-7952-49f1-9770-25bddd45af86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:53.092072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0567dbf3-7952-49f1-9770-25bddd45af86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:53.092518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0567dbf3-7952-49f1-9770-25bddd45af86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:53.224608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0567dbf3-7952-49f1-9770-25bddd45af86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:53.234621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0567dbf3-7952-49f1-9770-25bddd45af86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156426 Aug 24 06:27:53.235178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 677/1348] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:53 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:54.256028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f89c89ac-ba46-4df3-a977-cbf34a1886f3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:54.256721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f89c89ac-ba46-4df3-a977-cbf34a1886f3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:54.263310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89c89ac-ba46-4df3-a977-cbf34a1886f3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:54.263816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89c89ac-ba46-4df3-a977-cbf34a1886f3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:54.264225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89c89ac-ba46-4df3-a977-cbf34a1886f3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:54.264976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89c89ac-ba46-4df3-a977-cbf34a1886f3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:54.265423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89c89ac-ba46-4df3-a977-cbf34a1886f3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:54.265842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f89c89ac-ba46-4df3-a977-cbf34a1886f3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:54.405650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f89c89ac-ba46-4df3-a977-cbf34a1886f3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:54.413996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f89c89ac-ba46-4df3-a977-cbf34a1886f3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.162298 Aug 24 06:27:54.414578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 672/1349] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:54 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:55.443565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fd72dc84-b674-4cdb-a972-b7002117549d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:55.444190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fd72dc84-b674-4cdb-a972-b7002117549d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:55.451233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd72dc84-b674-4cdb-a972-b7002117549d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:55.451718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd72dc84-b674-4cdb-a972-b7002117549d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:55.452159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd72dc84-b674-4cdb-a972-b7002117549d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:55.452920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd72dc84-b674-4cdb-a972-b7002117549d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:55.453477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd72dc84-b674-4cdb-a972-b7002117549d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:55.454053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd72dc84-b674-4cdb-a972-b7002117549d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:55.595774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fd72dc84-b674-4cdb-a972-b7002117549d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:55.604578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fd72dc84-b674-4cdb-a972-b7002117549d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.165832 Aug 24 06:27:55.605421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 678/1350] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:55 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:56.628046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-511baede-d0a3-487b-8db5-ddeae29e2ee0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:56.634219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-511baede-d0a3-487b-8db5-ddeae29e2ee0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:56.635149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-511baede-d0a3-487b-8db5-ddeae29e2ee0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:56.635640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-511baede-d0a3-487b-8db5-ddeae29e2ee0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:56.636077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-511baede-d0a3-487b-8db5-ddeae29e2ee0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:56.636805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-511baede-d0a3-487b-8db5-ddeae29e2ee0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:56.637309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-511baede-d0a3-487b-8db5-ddeae29e2ee0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:56.637677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-511baede-d0a3-487b-8db5-ddeae29e2ee0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:56.775490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-511baede-d0a3-487b-8db5-ddeae29e2ee0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:56.783648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-511baede-d0a3-487b-8db5-ddeae29e2ee0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.159990 Aug 24 06:27:56.784214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 673/1351] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:56 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:57.804553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a0985e9b-661d-4cdc-a141-26048616c17f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:57.805247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a0985e9b-661d-4cdc-a141-26048616c17f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:57.812015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0985e9b-661d-4cdc-a141-26048616c17f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:57.812516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0985e9b-661d-4cdc-a141-26048616c17f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:57.812958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0985e9b-661d-4cdc-a141-26048616c17f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:57.813645 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0985e9b-661d-4cdc-a141-26048616c17f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:57.814094 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0985e9b-661d-4cdc-a141-26048616c17f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:57.814512 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0985e9b-661d-4cdc-a141-26048616c17f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:57.942483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a0985e9b-661d-4cdc-a141-26048616c17f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:57.950656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a0985e9b-661d-4cdc-a141-26048616c17f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150104 Aug 24 06:27:57.951219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 679/1352] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:57 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:27:58.972062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-30b87850-5176-4b55-bc5d-802d3d2624ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:27:58.972748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-30b87850-5176-4b55-bc5d-802d3d2624ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:27:58.979458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30b87850-5176-4b55-bc5d-802d3d2624ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:58.979967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30b87850-5176-4b55-bc5d-802d3d2624ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:58.980443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30b87850-5176-4b55-bc5d-802d3d2624ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:58.981183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30b87850-5176-4b55-bc5d-802d3d2624ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:27:58.981654 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30b87850-5176-4b55-bc5d-802d3d2624ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:27:58.982094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30b87850-5176-4b55-bc5d-802d3d2624ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:27:59.117797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-30b87850-5176-4b55-bc5d-802d3d2624ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:27:59.126077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-30b87850-5176-4b55-bc5d-802d3d2624ed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158726 Aug 24 06:27:59.126637 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 674/1353] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:27:58 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:00.147237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a662f688-bf4e-4d1f-9337-8d6e76d3358a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:00.147848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a662f688-bf4e-4d1f-9337-8d6e76d3358a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:00.154700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a662f688-bf4e-4d1f-9337-8d6e76d3358a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:00.155184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a662f688-bf4e-4d1f-9337-8d6e76d3358a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:00.155615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a662f688-bf4e-4d1f-9337-8d6e76d3358a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:00.156310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a662f688-bf4e-4d1f-9337-8d6e76d3358a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:00.156798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a662f688-bf4e-4d1f-9337-8d6e76d3358a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:00.157268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a662f688-bf4e-4d1f-9337-8d6e76d3358a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:00.291175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a662f688-bf4e-4d1f-9337-8d6e76d3358a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:00.299955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a662f688-bf4e-4d1f-9337-8d6e76d3358a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156605 Aug 24 06:28:00.300536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 680/1354] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:00 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:01.326945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-44e17107-625f-4f0f-9239-1e8374113a0f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:01.327503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-44e17107-625f-4f0f-9239-1e8374113a0f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:01.333931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44e17107-625f-4f0f-9239-1e8374113a0f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:01.334408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44e17107-625f-4f0f-9239-1e8374113a0f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:01.334835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44e17107-625f-4f0f-9239-1e8374113a0f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:01.335515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44e17107-625f-4f0f-9239-1e8374113a0f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:01.335958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44e17107-625f-4f0f-9239-1e8374113a0f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:01.336370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44e17107-625f-4f0f-9239-1e8374113a0f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:01.466292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-44e17107-625f-4f0f-9239-1e8374113a0f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:01.474330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-44e17107-625f-4f0f-9239-1e8374113a0f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151419 Aug 24 06:28:01.474909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 675/1355] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:01 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:02.495160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-293d3f5d-8ba0-4518-91d3-535d54a4301e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:02.495767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-293d3f5d-8ba0-4518-91d3-535d54a4301e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:02.502707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-293d3f5d-8ba0-4518-91d3-535d54a4301e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:02.503185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-293d3f5d-8ba0-4518-91d3-535d54a4301e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:02.503618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-293d3f5d-8ba0-4518-91d3-535d54a4301e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:02.504304 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-293d3f5d-8ba0-4518-91d3-535d54a4301e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:02.504844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-293d3f5d-8ba0-4518-91d3-535d54a4301e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:02.505272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-293d3f5d-8ba0-4518-91d3-535d54a4301e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:02.630810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-293d3f5d-8ba0-4518-91d3-535d54a4301e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:02.639138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-293d3f5d-8ba0-4518-91d3-535d54a4301e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.147831 Aug 24 06:28:02.639701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 681/1356] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:02 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:03.661025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-79c44ed1-b15b-4386-bc1b-3d41cca58132 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:03.661670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-79c44ed1-b15b-4386-bc1b-3d41cca58132 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:03.667742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c44ed1-b15b-4386-bc1b-3d41cca58132 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:03.668214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c44ed1-b15b-4386-bc1b-3d41cca58132 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:03.668687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c44ed1-b15b-4386-bc1b-3d41cca58132 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:03.669358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c44ed1-b15b-4386-bc1b-3d41cca58132 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:03.669806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c44ed1-b15b-4386-bc1b-3d41cca58132 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:03.670228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c44ed1-b15b-4386-bc1b-3d41cca58132 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:03.798324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-79c44ed1-b15b-4386-bc1b-3d41cca58132 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:03.806929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-79c44ed1-b15b-4386-bc1b-3d41cca58132 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149847 Aug 24 06:28:03.807743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 676/1357] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:03 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:04.829077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7dbc94ad-c714-463f-8a28-f5e70b595c19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:04.829715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7dbc94ad-c714-463f-8a28-f5e70b595c19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:04.836266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dbc94ad-c714-463f-8a28-f5e70b595c19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:04.836789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dbc94ad-c714-463f-8a28-f5e70b595c19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:04.837226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dbc94ad-c714-463f-8a28-f5e70b595c19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:04.837935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dbc94ad-c714-463f-8a28-f5e70b595c19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:04.838387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dbc94ad-c714-463f-8a28-f5e70b595c19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:04.838816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7dbc94ad-c714-463f-8a28-f5e70b595c19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:04.974811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7dbc94ad-c714-463f-8a28-f5e70b595c19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:04.983635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7dbc94ad-c714-463f-8a28-f5e70b595c19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158365 Aug 24 06:28:04.984217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 682/1358] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:04 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:06.005890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-544aa087-399d-43bc-b9ad-4a9de6e401bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:06.006495 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-544aa087-399d-43bc-b9ad-4a9de6e401bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:06.008873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=26 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:28:06.013654 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-544aa087-399d-43bc-b9ad-4a9de6e401bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:06.014140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-544aa087-399d-43bc-b9ad-4a9de6e401bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:06.014571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-544aa087-399d-43bc-b9ad-4a9de6e401bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:06.015266 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-544aa087-399d-43bc-b9ad-4a9de6e401bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:06.015718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-544aa087-399d-43bc-b9ad-4a9de6e401bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:06.016137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-544aa087-399d-43bc-b9ad-4a9de6e401bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:06.020084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=78 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:28:06.161623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-544aa087-399d-43bc-b9ad-4a9de6e401bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:06.179872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-544aa087-399d-43bc-b9ad-4a9de6e401bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.168427 Aug 24 06:28:06.179872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 677/1359] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:06 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:07.192864 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-dcde281a-f8df-487d-a3d7-cb9cba2d8fe5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:07.193600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-dcde281a-f8df-487d-a3d7-cb9cba2d8fe5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:07.199879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcde281a-f8df-487d-a3d7-cb9cba2d8fe5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:07.200358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcde281a-f8df-487d-a3d7-cb9cba2d8fe5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:07.200822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcde281a-f8df-487d-a3d7-cb9cba2d8fe5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:07.201511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcde281a-f8df-487d-a3d7-cb9cba2d8fe5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:07.201963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcde281a-f8df-487d-a3d7-cb9cba2d8fe5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:07.202531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcde281a-f8df-487d-a3d7-cb9cba2d8fe5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:07.330624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-dcde281a-f8df-487d-a3d7-cb9cba2d8fe5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:07.339082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-dcde281a-f8df-487d-a3d7-cb9cba2d8fe5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151018 Aug 24 06:28:07.339653 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 683/1360] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:07 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:08.360203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a60c8789-592f-4968-8409-61aab36f421d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:08.360820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a60c8789-592f-4968-8409-61aab36f421d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:08.367231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a60c8789-592f-4968-8409-61aab36f421d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:08.367701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a60c8789-592f-4968-8409-61aab36f421d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:08.368122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a60c8789-592f-4968-8409-61aab36f421d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:08.368833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a60c8789-592f-4968-8409-61aab36f421d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:08.369278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a60c8789-592f-4968-8409-61aab36f421d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:08.369691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a60c8789-592f-4968-8409-61aab36f421d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:08.495209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a60c8789-592f-4968-8409-61aab36f421d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:08.504049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a60c8789-592f-4968-8409-61aab36f421d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.147727 Aug 24 06:28:08.504845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 678/1361] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:08 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:09.525430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a3915496-66f4-49b6-97bc-234a127a1d8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:09.525990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a3915496-66f4-49b6-97bc-234a127a1d8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:09.532416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3915496-66f4-49b6-97bc-234a127a1d8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:09.532921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3915496-66f4-49b6-97bc-234a127a1d8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:09.533348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3915496-66f4-49b6-97bc-234a127a1d8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:09.534616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3915496-66f4-49b6-97bc-234a127a1d8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:09.535103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3915496-66f4-49b6-97bc-234a127a1d8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:09.535522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3915496-66f4-49b6-97bc-234a127a1d8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:09.670291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a3915496-66f4-49b6-97bc-234a127a1d8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:09.678485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a3915496-66f4-49b6-97bc-234a127a1d8c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157072 Aug 24 06:28:09.679044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 684/1362] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:09 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:10.699615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d20a4644-92fe-4271-8b75-cce36943cb19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:10.700195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d20a4644-92fe-4271-8b75-cce36943cb19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:10.706838 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d20a4644-92fe-4271-8b75-cce36943cb19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:10.707320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d20a4644-92fe-4271-8b75-cce36943cb19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:10.707748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d20a4644-92fe-4271-8b75-cce36943cb19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:10.708438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d20a4644-92fe-4271-8b75-cce36943cb19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:10.709121 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d20a4644-92fe-4271-8b75-cce36943cb19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:10.709312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d20a4644-92fe-4271-8b75-cce36943cb19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:10.838057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d20a4644-92fe-4271-8b75-cce36943cb19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:10.847291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d20a4644-92fe-4271-8b75-cce36943cb19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151689 Aug 24 06:28:10.847852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 679/1363] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:10 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:11.868937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-59912107-ad96-45e3-a123-3d62b0e10c94 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:11.869549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-59912107-ad96-45e3-a123-3d62b0e10c94 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:11.876019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59912107-ad96-45e3-a123-3d62b0e10c94 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:11.876506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59912107-ad96-45e3-a123-3d62b0e10c94 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:11.876959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59912107-ad96-45e3-a123-3d62b0e10c94 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:11.878282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59912107-ad96-45e3-a123-3d62b0e10c94 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:11.878734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59912107-ad96-45e3-a123-3d62b0e10c94 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:11.879155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59912107-ad96-45e3-a123-3d62b0e10c94 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:12.009934 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-59912107-ad96-45e3-a123-3d62b0e10c94 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:12.018135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-59912107-ad96-45e3-a123-3d62b0e10c94 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153105 Aug 24 06:28:12.018691 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 685/1364] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:11 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:13.039542 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8e58ef9e-5e87-4665-bd8c-4778e6382714 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:13.040148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8e58ef9e-5e87-4665-bd8c-4778e6382714 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:13.046763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e58ef9e-5e87-4665-bd8c-4778e6382714 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:13.047243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e58ef9e-5e87-4665-bd8c-4778e6382714 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:13.047676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e58ef9e-5e87-4665-bd8c-4778e6382714 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:13.048369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e58ef9e-5e87-4665-bd8c-4778e6382714 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:13.048851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e58ef9e-5e87-4665-bd8c-4778e6382714 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:13.049892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e58ef9e-5e87-4665-bd8c-4778e6382714 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:13.181202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8e58ef9e-5e87-4665-bd8c-4778e6382714 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:13.189750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8e58ef9e-5e87-4665-bd8c-4778e6382714 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154065 Aug 24 06:28:13.190291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 680/1365] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:13 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:14.210859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bec47e14-8b60-475d-a846-cbd5115f1e77 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:14.211493 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bec47e14-8b60-475d-a846-cbd5115f1e77 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:14.213909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=26 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:28:14.218683 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec47e14-8b60-475d-a846-cbd5115f1e77 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:14.219160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec47e14-8b60-475d-a846-cbd5115f1e77 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:14.219591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec47e14-8b60-475d-a846-cbd5115f1e77 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:14.220284 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec47e14-8b60-475d-a846-cbd5115f1e77 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:14.220756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec47e14-8b60-475d-a846-cbd5115f1e77 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:14.221172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bec47e14-8b60-475d-a846-cbd5115f1e77 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:14.359888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bec47e14-8b60-475d-a846-cbd5115f1e77 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:14.368871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bec47e14-8b60-475d-a846-cbd5115f1e77 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.161813 Aug 24 06:28:14.369447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 686/1366] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:14 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:15.389801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1f4035dc-72de-4928-a92b-202f827e367e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:15.390345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1f4035dc-72de-4928-a92b-202f827e367e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:15.397433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f4035dc-72de-4928-a92b-202f827e367e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:15.397911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f4035dc-72de-4928-a92b-202f827e367e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:15.398343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f4035dc-72de-4928-a92b-202f827e367e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:15.399031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f4035dc-72de-4928-a92b-202f827e367e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:15.399482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f4035dc-72de-4928-a92b-202f827e367e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:15.399905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f4035dc-72de-4928-a92b-202f827e367e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:15.528171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1f4035dc-72de-4928-a92b-202f827e367e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:15.536778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1f4035dc-72de-4928-a92b-202f827e367e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150894 Aug 24 06:28:15.537335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 681/1367] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:15 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:16.558775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9549618e-4934-4268-b733-a6d953c7bd1d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:16.559395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9549618e-4934-4268-b733-a6d953c7bd1d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:16.566484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9549618e-4934-4268-b733-a6d953c7bd1d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:16.566982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9549618e-4934-4268-b733-a6d953c7bd1d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:16.567449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9549618e-4934-4268-b733-a6d953c7bd1d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:16.568146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9549618e-4934-4268-b733-a6d953c7bd1d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:16.568631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9549618e-4934-4268-b733-a6d953c7bd1d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:16.569056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9549618e-4934-4268-b733-a6d953c7bd1d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:16.573032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=84 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:28:16.714083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9549618e-4934-4268-b733-a6d953c7bd1d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:16.724031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9549618e-4934-4268-b733-a6d953c7bd1d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.168720 Aug 24 06:28:16.724622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 687/1368] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:16 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:17.746150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-89e638fe-7945-462d-b451-dfde4bd591b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:17.746748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-89e638fe-7945-462d-b451-dfde4bd591b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:17.753878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e638fe-7945-462d-b451-dfde4bd591b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:17.754379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e638fe-7945-462d-b451-dfde4bd591b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:17.754814 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e638fe-7945-462d-b451-dfde4bd591b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:17.755503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e638fe-7945-462d-b451-dfde4bd591b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:17.756210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e638fe-7945-462d-b451-dfde4bd591b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:17.756659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89e638fe-7945-462d-b451-dfde4bd591b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:17.880085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-aeac0145-60e8-4cfa-9f58-8619f3e7b30f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:17.880673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-aeac0145-60e8-4cfa-9f58-8619f3e7b30f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:17.886639 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aeac0145-60e8-4cfa-9f58-8619f3e7b30f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:17.887118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aeac0145-60e8-4cfa-9f58-8619f3e7b30f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:17.887554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aeac0145-60e8-4cfa-9f58-8619f3e7b30f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:17.888248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aeac0145-60e8-4cfa-9f58-8619f3e7b30f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:17.888754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aeac0145-60e8-4cfa-9f58-8619f3e7b30f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:17.889182 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aeac0145-60e8-4cfa-9f58-8619f3e7b30f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:17.907649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-89e638fe-7945-462d-b451-dfde4bd591b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:17.916340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-89e638fe-7945-462d-b451-dfde4bd591b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.173915 Aug 24 06:28:17.916608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-aeac0145-60e8-4cfa-9f58-8619f3e7b30f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:28:17.916946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 682/1369] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:17 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:18.290279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-aeac0145-60e8-4cfa-9f58-8619f3e7b30f tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "DELETE /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 204 len: 0 microversion: 2.1 time: 0.414297 Aug 24 06:28:18.290886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 688/1370] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:28:17 2022] DELETE /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:28:18.301098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c6241b93-b414-4dea-8f75-67321af1bc97 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:18.301765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c6241b93-b414-4dea-8f75-67321af1bc97 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:18.308201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6241b93-b414-4dea-8f75-67321af1bc97 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:18.308736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6241b93-b414-4dea-8f75-67321af1bc97 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:18.309174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6241b93-b414-4dea-8f75-67321af1bc97 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:18.309877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6241b93-b414-4dea-8f75-67321af1bc97 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:18.310332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6241b93-b414-4dea-8f75-67321af1bc97 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:18.310752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6241b93-b414-4dea-8f75-67321af1bc97 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:18.440132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c6241b93-b414-4dea-8f75-67321af1bc97 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:18.448276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c6241b93-b414-4dea-8f75-67321af1bc97 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1673 microversion: 2.1 time: 0.151779 Aug 24 06:28:18.448879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 683/1371] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:18 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:18.939333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0697744b-49e8-44e7-9327-59d39eb24f47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:18.940032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0697744b-49e8-44e7-9327-59d39eb24f47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:18.947194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0697744b-49e8-44e7-9327-59d39eb24f47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:18.947783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0697744b-49e8-44e7-9327-59d39eb24f47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:18.948224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0697744b-49e8-44e7-9327-59d39eb24f47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:18.948958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0697744b-49e8-44e7-9327-59d39eb24f47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:18.949411 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0697744b-49e8-44e7-9327-59d39eb24f47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:18.949836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0697744b-49e8-44e7-9327-59d39eb24f47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:19.193522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0697744b-49e8-44e7-9327-59d39eb24f47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:19.202524 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0697744b-49e8-44e7-9327-59d39eb24f47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.267378 Aug 24 06:28:19.203134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 689/1372] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:18 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:19.470517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7a3e24f3-8f47-493e-ac99-1dadfcbbc431 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:19.471185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7a3e24f3-8f47-493e-ac99-1dadfcbbc431 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:19.477734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3e24f3-8f47-493e-ac99-1dadfcbbc431 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:19.478214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3e24f3-8f47-493e-ac99-1dadfcbbc431 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:19.478641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3e24f3-8f47-493e-ac99-1dadfcbbc431 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:19.479335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3e24f3-8f47-493e-ac99-1dadfcbbc431 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:19.479788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3e24f3-8f47-493e-ac99-1dadfcbbc431 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:19.480200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3e24f3-8f47-493e-ac99-1dadfcbbc431 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:19.542445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7a3e24f3-8f47-493e-ac99-1dadfcbbc431 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:19.550666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7a3e24f3-8f47-493e-ac99-1dadfcbbc431 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1606 microversion: 2.1 time: 0.084359 Aug 24 06:28:19.551555 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 684/1373] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:19 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1606 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:19.736962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-83ccbd76-564e-4703-8254-50a4fd8a222f req-520e2de0-1359-4df9-a797-9df9cedc11f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22824cc5-84ad-4f4e-8830-018742399d15", "name": "network-vif-deleted", "tag": "1f43ebfe-17fa-48a0-8031-d4a6e2750797"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:28:19.747251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-83ccbd76-564e-4703-8254-50a4fd8a222f req-520e2de0-1359-4df9-a797-9df9cedc11f4 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:19.747961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-83ccbd76-564e-4703-8254-50a4fd8a222f req-520e2de0-1359-4df9-a797-9df9cedc11f4 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:19.748381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-83ccbd76-564e-4703-8254-50a4fd8a222f req-520e2de0-1359-4df9-a797-9df9cedc11f4 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:19.760553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-83ccbd76-564e-4703-8254-50a4fd8a222f req-520e2de0-1359-4df9-a797-9df9cedc11f4 service nova] Creating event network-vif-deleted:1f43ebfe-17fa-48a0-8031-d4a6e2750797 for instance 22824cc5-84ad-4f4e-8830-018742399d15 on hv-cinder-85426 Aug 24 06:28:19.766565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-83ccbd76-564e-4703-8254-50a4fd8a222f req-520e2de0-1359-4df9-a797-9df9cedc11f4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033216 Aug 24 06:28:19.767540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 690/1374] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:28:20.365547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e438355f-b07a-4db6-8d2f-79b165eb27ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:20.366255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e438355f-b07a-4db6-8d2f-79b165eb27ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:20.372571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e438355f-b07a-4db6-8d2f-79b165eb27ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:20.373333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e438355f-b07a-4db6-8d2f-79b165eb27ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:20.374590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e438355f-b07a-4db6-8d2f-79b165eb27ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:20.374590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e438355f-b07a-4db6-8d2f-79b165eb27ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:20.375212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e438355f-b07a-4db6-8d2f-79b165eb27ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:20.375685 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e438355f-b07a-4db6-8d2f-79b165eb27ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:20.513331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e438355f-b07a-4db6-8d2f-79b165eb27ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:20.523228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e438355f-b07a-4db6-8d2f-79b165eb27ef tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.302422 Aug 24 06:28:20.523814 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 685/1375] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:20 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:20.575092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:20.575953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:20.586495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:20.586495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:20.586495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:20.586495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:20.586944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:20.587324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:20.621897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:20.622383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:20.622825 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:20.623276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.objects.instance [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lazy-loading 'fault' on Instance uuid 22824cc5-84ad-4f4e-8830-018742399d15 {{(pid=121151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:28:20.668649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25908fb02f7f46f5b9e483811302a67e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff194aa4a2d744caaa09e0ceee54b1d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:20.676898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-480e8bb1-ea00-46ec-a0a7-627f2fc668a5 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 200 len: 1328 microversion: 2.1 time: 0.106552 Aug 24 06:28:20.677456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 691/1376] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:20 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:21.544548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-03afee13-3572-4167-9a7a-457a64ae21ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:21.545290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-03afee13-3572-4167-9a7a-457a64ae21ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:21.551880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03afee13-3572-4167-9a7a-457a64ae21ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:21.552358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03afee13-3572-4167-9a7a-457a64ae21ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:21.552823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03afee13-3572-4167-9a7a-457a64ae21ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:21.553512 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03afee13-3572-4167-9a7a-457a64ae21ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:21.553962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03afee13-3572-4167-9a7a-457a64ae21ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:21.554384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03afee13-3572-4167-9a7a-457a64ae21ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:21.680694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-03afee13-3572-4167-9a7a-457a64ae21ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:21.689281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-03afee13-3572-4167-9a7a-457a64ae21ae tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.148625 Aug 24 06:28:21.689853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 686/1377] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:21 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:21.698074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:21.698683 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:21.705210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:21.705935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:21.706860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:21.707564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:21.708013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:21.708431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:21.722988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] HTTP exception thrown: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Request method failure captured: Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 HTTP/1.1 Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcI_I9huvEuUVzRrBxRPdTG5qqUGpAdOvZQwpwndKekqpzx6nxYwOufm6cj1diqelUoat7BmXfCuCCyfQbzUbJH2Ne0wS3vk3thmsR_zFKt8mIthbCrQxYL6szHbAdh8cneu1yTM3W9rwToG1VfOG6HV0xiq0AWyQLRFhlAE9aP36Wc Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:28:21.724729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ff194aa4a2d744caaa09e0ceee54b1d2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 25908fb02f7f46f5b9e483811302a67e Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:28:21.726358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '22824cc5-84ad-4f4e-8830-018742399d15'} Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:28:21.727232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:28:21.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:28:21.729686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Returning 404 to user: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:28:21.729686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-68104e06-5461-4f66-80a8-ed15911d5957 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 404 len: 111 microversion: 2.1 time: 0.031932 Aug 24 06:28:21.729686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 692/1378] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:21 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:28:21.735164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c1fb2368-5af4-4b70-937b-68565fe1f58e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '.version_select at 0x7fcddc18c820>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:21.914674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c1fb2368-5af4-4b70-937b-68565fe1f58e tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500610231" status: 202 len: 0 microversion: 2.1 time: 0.183219 Aug 24 06:28:21.915263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 687/1379] 10.222.0.62 () {58 vars in 1221 bytes} [Wed Aug 24 06:28:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500610231 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:28:22.710318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-51ff56db-9df3-497e-9717-72d0d90b525b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:22.710932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-51ff56db-9df3-497e-9717-72d0d90b525b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:22.717129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ff56db-9df3-497e-9717-72d0d90b525b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:22.717602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ff56db-9df3-497e-9717-72d0d90b525b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:22.718094 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ff56db-9df3-497e-9717-72d0d90b525b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:22.718792 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ff56db-9df3-497e-9717-72d0d90b525b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:22.719232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ff56db-9df3-497e-9717-72d0d90b525b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:22.719818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ff56db-9df3-497e-9717-72d0d90b525b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:22.864028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-51ff56db-9df3-497e-9717-72d0d90b525b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:22.872409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-51ff56db-9df3-497e-9717-72d0d90b525b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.166719 Aug 24 06:28:22.873007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 693/1380] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:22 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:23.901050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9ed63415-25e3-499a-a91c-115586f9e1fc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:23.901665 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9ed63415-25e3-499a-a91c-115586f9e1fc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:23.907907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed63415-25e3-499a-a91c-115586f9e1fc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:23.908389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed63415-25e3-499a-a91c-115586f9e1fc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:23.908843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed63415-25e3-499a-a91c-115586f9e1fc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:23.909543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed63415-25e3-499a-a91c-115586f9e1fc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:23.909998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed63415-25e3-499a-a91c-115586f9e1fc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:23.910419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed63415-25e3-499a-a91c-115586f9e1fc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:24.044147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9ed63415-25e3-499a-a91c-115586f9e1fc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:24.053071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9ed63415-25e3-499a-a91c-115586f9e1fc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156428 Aug 24 06:28:24.053642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 688/1381] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:23 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:25.075126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-127fcf3a-4f4e-4ef9-aacc-19f91d249bd8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:25.075722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-127fcf3a-4f4e-4ef9-aacc-19f91d249bd8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:25.082900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-127fcf3a-4f4e-4ef9-aacc-19f91d249bd8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:25.083387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-127fcf3a-4f4e-4ef9-aacc-19f91d249bd8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:25.083840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-127fcf3a-4f4e-4ef9-aacc-19f91d249bd8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:25.084587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-127fcf3a-4f4e-4ef9-aacc-19f91d249bd8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:25.085037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-127fcf3a-4f4e-4ef9-aacc-19f91d249bd8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:25.085462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-127fcf3a-4f4e-4ef9-aacc-19f91d249bd8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:25.218991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-127fcf3a-4f4e-4ef9-aacc-19f91d249bd8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:25.227282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-127fcf3a-4f4e-4ef9-aacc-19f91d249bd8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155977 Aug 24 06:28:25.227779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 694/1382] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:25 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:26.248440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-af503317-721b-4b36-bf96-77b512961622 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:26.249096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-af503317-721b-4b36-bf96-77b512961622 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:26.256936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af503317-721b-4b36-bf96-77b512961622 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:26.257418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af503317-721b-4b36-bf96-77b512961622 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:26.257854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af503317-721b-4b36-bf96-77b512961622 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:26.258573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af503317-721b-4b36-bf96-77b512961622 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:26.259029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af503317-721b-4b36-bf96-77b512961622 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:26.259450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af503317-721b-4b36-bf96-77b512961622 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:26.395018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-af503317-721b-4b36-bf96-77b512961622 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:26.403183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-af503317-721b-4b36-bf96-77b512961622 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158555 Aug 24 06:28:26.403747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 689/1383] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:26 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:27.424183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5e16734f-fd3d-4a5d-a891-c89bdf19e2e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:27.425466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5e16734f-fd3d-4a5d-a891-c89bdf19e2e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:27.431839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5e16734f-fd3d-4a5d-a891-c89bdf19e2e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:27.432605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5e16734f-fd3d-4a5d-a891-c89bdf19e2e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:27.433036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5e16734f-fd3d-4a5d-a891-c89bdf19e2e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:27.433716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5e16734f-fd3d-4a5d-a891-c89bdf19e2e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:27.434160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5e16734f-fd3d-4a5d-a891-c89bdf19e2e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:27.434575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5e16734f-fd3d-4a5d-a891-c89bdf19e2e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:27.561453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5e16734f-fd3d-4a5d-a891-c89bdf19e2e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:27.570365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5e16734f-fd3d-4a5d-a891-c89bdf19e2e0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150020 Aug 24 06:28:27.570924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 695/1384] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:27 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:28.593540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8c8a3bd9-db78-4b75-838f-ffa7f0bb9b3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:28.594099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8c8a3bd9-db78-4b75-838f-ffa7f0bb9b3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:28.600451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c8a3bd9-db78-4b75-838f-ffa7f0bb9b3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:28.600967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c8a3bd9-db78-4b75-838f-ffa7f0bb9b3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:28.601402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c8a3bd9-db78-4b75-838f-ffa7f0bb9b3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:28.602096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c8a3bd9-db78-4b75-838f-ffa7f0bb9b3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:28.602550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c8a3bd9-db78-4b75-838f-ffa7f0bb9b3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:28.602973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c8a3bd9-db78-4b75-838f-ffa7f0bb9b3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:28.734663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8c8a3bd9-db78-4b75-838f-ffa7f0bb9b3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:28.743251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8c8a3bd9-db78-4b75-838f-ffa7f0bb9b3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155078 Aug 24 06:28:28.743814 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 690/1385] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:28 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:29.766519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3fc5bdd3-2162-42ff-af82-4f3e371ea874 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:29.767278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3fc5bdd3-2162-42ff-af82-4f3e371ea874 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:29.774373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc5bdd3-2162-42ff-af82-4f3e371ea874 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:29.774848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc5bdd3-2162-42ff-af82-4f3e371ea874 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:29.775283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc5bdd3-2162-42ff-af82-4f3e371ea874 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:29.775978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc5bdd3-2162-42ff-af82-4f3e371ea874 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:29.776424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc5bdd3-2162-42ff-af82-4f3e371ea874 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:29.776874 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fc5bdd3-2162-42ff-af82-4f3e371ea874 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:29.912188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3fc5bdd3-2162-42ff-af82-4f3e371ea874 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:29.920643 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3fc5bdd3-2162-42ff-af82-4f3e371ea874 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157959 Aug 24 06:28:29.921207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 696/1386] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:29 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:30.941993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b8471e48-877a-4413-b9e5-0374c928d270 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:30.942607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b8471e48-877a-4413-b9e5-0374c928d270 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:30.950323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8471e48-877a-4413-b9e5-0374c928d270 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:30.950810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8471e48-877a-4413-b9e5-0374c928d270 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:30.951246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8471e48-877a-4413-b9e5-0374c928d270 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:30.951957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8471e48-877a-4413-b9e5-0374c928d270 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:30.952411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8471e48-877a-4413-b9e5-0374c928d270 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:30.952968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8471e48-877a-4413-b9e5-0374c928d270 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:31.082114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b8471e48-877a-4413-b9e5-0374c928d270 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:31.090404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b8471e48-877a-4413-b9e5-0374c928d270 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152263 Aug 24 06:28:31.090971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 691/1387] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:30 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:32.112817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-85fab6b6-cfa0-4597-922e-add527cd406c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:32.113457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-85fab6b6-cfa0-4597-922e-add527cd406c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:32.119823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85fab6b6-cfa0-4597-922e-add527cd406c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:32.120300 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85fab6b6-cfa0-4597-922e-add527cd406c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:32.120773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85fab6b6-cfa0-4597-922e-add527cd406c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:32.121464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85fab6b6-cfa0-4597-922e-add527cd406c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:32.121915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85fab6b6-cfa0-4597-922e-add527cd406c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:32.122334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85fab6b6-cfa0-4597-922e-add527cd406c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:32.248430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-85fab6b6-cfa0-4597-922e-add527cd406c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:32.258874 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-85fab6b6-cfa0-4597-922e-add527cd406c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150409 Aug 24 06:28:32.259441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 697/1388] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:32 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:33.279303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e9d3a893-d019-4862-86f1-b0c6f215c3d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:33.279844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e9d3a893-d019-4862-86f1-b0c6f215c3d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:33.285965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9d3a893-d019-4862-86f1-b0c6f215c3d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:33.286463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9d3a893-d019-4862-86f1-b0c6f215c3d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:33.286891 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9d3a893-d019-4862-86f1-b0c6f215c3d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:33.287573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9d3a893-d019-4862-86f1-b0c6f215c3d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:33.288022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9d3a893-d019-4862-86f1-b0c6f215c3d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:33.288441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9d3a893-d019-4862-86f1-b0c6f215c3d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:33.422370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e9d3a893-d019-4862-86f1-b0c6f215c3d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:33.431003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e9d3a893-d019-4862-86f1-b0c6f215c3d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155666 Aug 24 06:28:33.431557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 692/1389] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:33 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:34.453752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6a38414e-5abd-48c9-94d5-130a5bd0938d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:34.454384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6a38414e-5abd-48c9-94d5-130a5bd0938d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:34.461500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a38414e-5abd-48c9-94d5-130a5bd0938d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:34.461981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a38414e-5abd-48c9-94d5-130a5bd0938d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:34.462415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a38414e-5abd-48c9-94d5-130a5bd0938d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:34.463105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a38414e-5abd-48c9-94d5-130a5bd0938d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:34.463555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a38414e-5abd-48c9-94d5-130a5bd0938d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:34.464007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a38414e-5abd-48c9-94d5-130a5bd0938d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:34.595712 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6a38414e-5abd-48c9-94d5-130a5bd0938d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:34.604124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6a38414e-5abd-48c9-94d5-130a5bd0938d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154286 Aug 24 06:28:34.604777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 698/1390] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:34 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:35.625813 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-44bd6e38-b9a0-4b5f-a7c5-0584819326a9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:35.626442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-44bd6e38-b9a0-4b5f-a7c5-0584819326a9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:35.633084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44bd6e38-b9a0-4b5f-a7c5-0584819326a9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:35.633558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44bd6e38-b9a0-4b5f-a7c5-0584819326a9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:35.633984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44bd6e38-b9a0-4b5f-a7c5-0584819326a9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:35.634667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44bd6e38-b9a0-4b5f-a7c5-0584819326a9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:35.635110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44bd6e38-b9a0-4b5f-a7c5-0584819326a9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:35.635525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-44bd6e38-b9a0-4b5f-a7c5-0584819326a9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:35.769791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-44bd6e38-b9a0-4b5f-a7c5-0584819326a9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:35.777870 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-44bd6e38-b9a0-4b5f-a7c5-0584819326a9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156012 Aug 24 06:28:35.778429 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 693/1391] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:35 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:36.799142 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3b9be130-b26f-4958-b45e-f40967db02b8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:36.799792 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3b9be130-b26f-4958-b45e-f40967db02b8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:36.807136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b9be130-b26f-4958-b45e-f40967db02b8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:36.807910 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b9be130-b26f-4958-b45e-f40967db02b8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:36.808358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b9be130-b26f-4958-b45e-f40967db02b8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:36.809102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b9be130-b26f-4958-b45e-f40967db02b8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:36.809583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b9be130-b26f-4958-b45e-f40967db02b8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:36.810029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b9be130-b26f-4958-b45e-f40967db02b8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:36.937283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3b9be130-b26f-4958-b45e-f40967db02b8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:36.945880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3b9be130-b26f-4958-b45e-f40967db02b8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150714 Aug 24 06:28:36.946478 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 699/1392] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:36 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:28:37.967243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-38d40282-5eae-4947-9dae-2233215d697f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:37.967951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-38d40282-5eae-4947-9dae-2233215d697f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:37.970506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:28:37.975151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d40282-5eae-4947-9dae-2233215d697f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:37.976285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d40282-5eae-4947-9dae-2233215d697f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:37.976748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d40282-5eae-4947-9dae-2233215d697f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:37.977428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d40282-5eae-4947-9dae-2233215d697f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:37.977870 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d40282-5eae-4947-9dae-2233215d697f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:37.978283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d40282-5eae-4947-9dae-2233215d697f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:37.982144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=96 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:28:38.112003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-38d40282-5eae-4947-9dae-2233215d697f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:38.120317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-38d40282-5eae-4947-9dae-2233215d697f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156937 Aug 24 06:28:38.120918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 694/1393] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:37 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:39.143862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8578ffff-13f3-40bc-b1d8-566420a17352 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:39.144461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8578ffff-13f3-40bc-b1d8-566420a17352 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:39.151314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8578ffff-13f3-40bc-b1d8-566420a17352 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:39.151802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8578ffff-13f3-40bc-b1d8-566420a17352 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:39.152234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8578ffff-13f3-40bc-b1d8-566420a17352 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:39.152966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8578ffff-13f3-40bc-b1d8-566420a17352 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:39.153426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8578ffff-13f3-40bc-b1d8-566420a17352 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:39.153829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8578ffff-13f3-40bc-b1d8-566420a17352 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:39.297523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8578ffff-13f3-40bc-b1d8-566420a17352 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:39.306420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8578ffff-13f3-40bc-b1d8-566420a17352 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.167780 Aug 24 06:28:39.306997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 700/1394] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:39 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:39.463883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:28:39.464481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:28:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:28:40.328347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-527d202a-c4ee-4bc0-b815-b09217be2fd9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:40.328981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-527d202a-c4ee-4bc0-b815-b09217be2fd9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:40.335970 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-527d202a-c4ee-4bc0-b815-b09217be2fd9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:40.336439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-527d202a-c4ee-4bc0-b815-b09217be2fd9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:40.336892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-527d202a-c4ee-4bc0-b815-b09217be2fd9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:40.337567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-527d202a-c4ee-4bc0-b815-b09217be2fd9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:40.338013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-527d202a-c4ee-4bc0-b815-b09217be2fd9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:40.338427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-527d202a-c4ee-4bc0-b815-b09217be2fd9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:40.464849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-527d202a-c4ee-4bc0-b815-b09217be2fd9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:40.473206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-527d202a-c4ee-4bc0-b815-b09217be2fd9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.148646 Aug 24 06:28:40.473774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 695/1395] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:40 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:41.495484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a722880e-99d6-4d44-a35a-aab6d81423b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:41.496070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a722880e-99d6-4d44-a35a-aab6d81423b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:41.502622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a722880e-99d6-4d44-a35a-aab6d81423b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:41.503099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a722880e-99d6-4d44-a35a-aab6d81423b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:41.503529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a722880e-99d6-4d44-a35a-aab6d81423b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:41.504216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a722880e-99d6-4d44-a35a-aab6d81423b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:41.504696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a722880e-99d6-4d44-a35a-aab6d81423b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:41.505119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a722880e-99d6-4d44-a35a-aab6d81423b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:41.632844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a722880e-99d6-4d44-a35a-aab6d81423b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:41.640986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a722880e-99d6-4d44-a35a-aab6d81423b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149986 Aug 24 06:28:41.641542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 701/1396] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:41 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:42.662079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-58b77733-d6aa-45e2-b802-1a3af9e176bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:42.662676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-58b77733-d6aa-45e2-b802-1a3af9e176bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:42.669523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58b77733-d6aa-45e2-b802-1a3af9e176bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:42.670003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58b77733-d6aa-45e2-b802-1a3af9e176bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:42.670437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58b77733-d6aa-45e2-b802-1a3af9e176bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:42.671130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58b77733-d6aa-45e2-b802-1a3af9e176bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:42.671581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58b77733-d6aa-45e2-b802-1a3af9e176bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:42.672032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58b77733-d6aa-45e2-b802-1a3af9e176bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:42.815303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-58b77733-d6aa-45e2-b802-1a3af9e176bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:42.824482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-58b77733-d6aa-45e2-b802-1a3af9e176bd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.166345 Aug 24 06:28:42.825423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 696/1397] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:42 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:43.844807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c2900029-77c7-4de6-ba09-44a6c17f80b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:43.845420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c2900029-77c7-4de6-ba09-44a6c17f80b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:43.852139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2900029-77c7-4de6-ba09-44a6c17f80b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:43.856551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2900029-77c7-4de6-ba09-44a6c17f80b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:43.856551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2900029-77c7-4de6-ba09-44a6c17f80b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:43.856551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2900029-77c7-4de6-ba09-44a6c17f80b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:43.856551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2900029-77c7-4de6-ba09-44a6c17f80b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:43.856964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2900029-77c7-4de6-ba09-44a6c17f80b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:43.984192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c2900029-77c7-4de6-ba09-44a6c17f80b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:43.993529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c2900029-77c7-4de6-ba09-44a6c17f80b1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152604 Aug 24 06:28:43.994091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 702/1398] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:43 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:45.015149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e8b2b7ce-dc8d-4e7e-a414-899992502b50 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:45.015766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e8b2b7ce-dc8d-4e7e-a414-899992502b50 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:45.022239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8b2b7ce-dc8d-4e7e-a414-899992502b50 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:45.022720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8b2b7ce-dc8d-4e7e-a414-899992502b50 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:45.023156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8b2b7ce-dc8d-4e7e-a414-899992502b50 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:45.023846 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8b2b7ce-dc8d-4e7e-a414-899992502b50 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:45.024300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8b2b7ce-dc8d-4e7e-a414-899992502b50 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:45.024754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8b2b7ce-dc8d-4e7e-a414-899992502b50 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:45.156454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e8b2b7ce-dc8d-4e7e-a414-899992502b50 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:45.164627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e8b2b7ce-dc8d-4e7e-a414-899992502b50 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153353 Aug 24 06:28:45.165182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 697/1399] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:45 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:46.185739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0c92b760-a64d-4986-bc4b-870ddbbd424e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:46.186345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0c92b760-a64d-4986-bc4b-870ddbbd424e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:46.188870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:28:46.193579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c92b760-a64d-4986-bc4b-870ddbbd424e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:46.194132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c92b760-a64d-4986-bc4b-870ddbbd424e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:46.195266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c92b760-a64d-4986-bc4b-870ddbbd424e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:46.196020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c92b760-a64d-4986-bc4b-870ddbbd424e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:46.196475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c92b760-a64d-4986-bc4b-870ddbbd424e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:46.196928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c92b760-a64d-4986-bc4b-870ddbbd424e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:46.200915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:28:46.329325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0c92b760-a64d-4986-bc4b-870ddbbd424e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:46.337444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0c92b760-a64d-4986-bc4b-870ddbbd424e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155795 Aug 24 06:28:46.338020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 703/1400] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:46 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:47.358692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e2918350-6a94-4aa7-aad1-0da325d47f2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:47.359337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e2918350-6a94-4aa7-aad1-0da325d47f2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:47.365894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2918350-6a94-4aa7-aad1-0da325d47f2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:47.366375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2918350-6a94-4aa7-aad1-0da325d47f2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:47.366800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2918350-6a94-4aa7-aad1-0da325d47f2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:47.367493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2918350-6a94-4aa7-aad1-0da325d47f2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:47.367941 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2918350-6a94-4aa7-aad1-0da325d47f2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:47.368391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2918350-6a94-4aa7-aad1-0da325d47f2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:47.493362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e2918350-6a94-4aa7-aad1-0da325d47f2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:47.501456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e2918350-6a94-4aa7-aad1-0da325d47f2a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.146678 Aug 24 06:28:47.502069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 698/1401] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:47 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:48.524200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-675a387f-7d68-4bbd-9f70-7dc61b31e502 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:48.524891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-675a387f-7d68-4bbd-9f70-7dc61b31e502 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:48.531001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675a387f-7d68-4bbd-9f70-7dc61b31e502 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:48.531476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675a387f-7d68-4bbd-9f70-7dc61b31e502 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:48.531913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675a387f-7d68-4bbd-9f70-7dc61b31e502 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:48.532632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675a387f-7d68-4bbd-9f70-7dc61b31e502 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:48.533117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675a387f-7d68-4bbd-9f70-7dc61b31e502 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:48.533613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-675a387f-7d68-4bbd-9f70-7dc61b31e502 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:48.661862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-675a387f-7d68-4bbd-9f70-7dc61b31e502 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:48.671827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-675a387f-7d68-4bbd-9f70-7dc61b31e502 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152527 Aug 24 06:28:48.672392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 704/1402] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:48 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:49.693004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-407c58a7-4c44-471f-b592-dd864c3c8ef7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:49.693610 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-407c58a7-4c44-471f-b592-dd864c3c8ef7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:49.700076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-407c58a7-4c44-471f-b592-dd864c3c8ef7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:49.700587 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-407c58a7-4c44-471f-b592-dd864c3c8ef7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:49.701020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-407c58a7-4c44-471f-b592-dd864c3c8ef7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:49.701747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-407c58a7-4c44-471f-b592-dd864c3c8ef7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:49.702143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-407c58a7-4c44-471f-b592-dd864c3c8ef7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:49.702565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-407c58a7-4c44-471f-b592-dd864c3c8ef7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:49.835016 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-407c58a7-4c44-471f-b592-dd864c3c8ef7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:49.844050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-407c58a7-4c44-471f-b592-dd864c3c8ef7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154890 Aug 24 06:28:49.844626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 699/1403] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:49 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:50.864636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-079638fe-c04d-4a08-aae5-19ed9dcacd46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:50.865391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-079638fe-c04d-4a08-aae5-19ed9dcacd46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:50.873083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-079638fe-c04d-4a08-aae5-19ed9dcacd46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:50.873557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-079638fe-c04d-4a08-aae5-19ed9dcacd46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:50.873985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-079638fe-c04d-4a08-aae5-19ed9dcacd46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:50.874702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-079638fe-c04d-4a08-aae5-19ed9dcacd46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:50.875140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-079638fe-c04d-4a08-aae5-19ed9dcacd46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:50.875559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-079638fe-c04d-4a08-aae5-19ed9dcacd46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:51.010652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-079638fe-c04d-4a08-aae5-19ed9dcacd46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:51.018943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-079638fe-c04d-4a08-aae5-19ed9dcacd46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158750 Aug 24 06:28:51.019531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 705/1404] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:50 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:52.041212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-18884b73-48a7-4bd8-884e-8a3abef71a1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:52.041750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-18884b73-48a7-4bd8-884e-8a3abef71a1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:52.048713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18884b73-48a7-4bd8-884e-8a3abef71a1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:52.049195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18884b73-48a7-4bd8-884e-8a3abef71a1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:52.049621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18884b73-48a7-4bd8-884e-8a3abef71a1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:52.050304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18884b73-48a7-4bd8-884e-8a3abef71a1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:52.050757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18884b73-48a7-4bd8-884e-8a3abef71a1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:52.051172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18884b73-48a7-4bd8-884e-8a3abef71a1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:52.176719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-18884b73-48a7-4bd8-884e-8a3abef71a1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:52.185275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-18884b73-48a7-4bd8-884e-8a3abef71a1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.148644 Aug 24 06:28:52.185840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 700/1405] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:52 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:53.206613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a40ba23b-f869-4fbf-b7a0-4658b77eb361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:53.207230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a40ba23b-f869-4fbf-b7a0-4658b77eb361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:53.214285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a40ba23b-f869-4fbf-b7a0-4658b77eb361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:53.214763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a40ba23b-f869-4fbf-b7a0-4658b77eb361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:53.215198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a40ba23b-f869-4fbf-b7a0-4658b77eb361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:53.215963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a40ba23b-f869-4fbf-b7a0-4658b77eb361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:53.216413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a40ba23b-f869-4fbf-b7a0-4658b77eb361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:53.216863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a40ba23b-f869-4fbf-b7a0-4658b77eb361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:53.345020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a40ba23b-f869-4fbf-b7a0-4658b77eb361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:53.353995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a40ba23b-f869-4fbf-b7a0-4658b77eb361 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151243 Aug 24 06:28:53.354551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 706/1406] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:53 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:54.373958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-76c100fe-a83a-40ca-acaa-f4e356c9f9fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:54.374561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-76c100fe-a83a-40ca-acaa-f4e356c9f9fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:54.380942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76c100fe-a83a-40ca-acaa-f4e356c9f9fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:54.381418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76c100fe-a83a-40ca-acaa-f4e356c9f9fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:54.381847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76c100fe-a83a-40ca-acaa-f4e356c9f9fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:54.382532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76c100fe-a83a-40ca-acaa-f4e356c9f9fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:54.382979 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76c100fe-a83a-40ca-acaa-f4e356c9f9fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:54.383392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76c100fe-a83a-40ca-acaa-f4e356c9f9fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:54.537574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-76c100fe-a83a-40ca-acaa-f4e356c9f9fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:54.546294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-76c100fe-a83a-40ca-acaa-f4e356c9f9fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.176082 Aug 24 06:28:54.546860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 701/1407] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:54 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:55.567968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a498a535-78f5-47e4-a57e-e9de4e8df824 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:55.568598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a498a535-78f5-47e4-a57e-e9de4e8df824 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:55.575548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a498a535-78f5-47e4-a57e-e9de4e8df824 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:55.576027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a498a535-78f5-47e4-a57e-e9de4e8df824 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:55.576464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a498a535-78f5-47e4-a57e-e9de4e8df824 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:55.577178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a498a535-78f5-47e4-a57e-e9de4e8df824 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:55.577630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a498a535-78f5-47e4-a57e-e9de4e8df824 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:55.578085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a498a535-78f5-47e4-a57e-e9de4e8df824 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:55.706718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a498a535-78f5-47e4-a57e-e9de4e8df824 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:55.721467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a498a535-78f5-47e4-a57e-e9de4e8df824 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157180 Aug 24 06:28:55.722050 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 707/1408] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:55 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:56.742812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2d946a0d-e0c2-492d-a9ef-e10036ee294e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:56.743498 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2d946a0d-e0c2-492d-a9ef-e10036ee294e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:56.749985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d946a0d-e0c2-492d-a9ef-e10036ee294e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:56.750467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d946a0d-e0c2-492d-a9ef-e10036ee294e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:56.750903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d946a0d-e0c2-492d-a9ef-e10036ee294e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:56.751594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d946a0d-e0c2-492d-a9ef-e10036ee294e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:56.752045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d946a0d-e0c2-492d-a9ef-e10036ee294e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:56.752484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d946a0d-e0c2-492d-a9ef-e10036ee294e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:56.882061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2d946a0d-e0c2-492d-a9ef-e10036ee294e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:56.890074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2d946a0d-e0c2-492d-a9ef-e10036ee294e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151333 Aug 24 06:28:56.890638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 702/1409] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:56 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:57.911879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6da3cd3f-5511-4d05-b82a-ecd9a7961503 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:57.913391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6da3cd3f-5511-4d05-b82a-ecd9a7961503 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:57.919857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6da3cd3f-5511-4d05-b82a-ecd9a7961503 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:57.920343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6da3cd3f-5511-4d05-b82a-ecd9a7961503 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:57.920807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6da3cd3f-5511-4d05-b82a-ecd9a7961503 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:57.921581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6da3cd3f-5511-4d05-b82a-ecd9a7961503 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:57.922040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6da3cd3f-5511-4d05-b82a-ecd9a7961503 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:57.922463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6da3cd3f-5511-4d05-b82a-ecd9a7961503 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:58.051421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6da3cd3f-5511-4d05-b82a-ecd9a7961503 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:58.059789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6da3cd3f-5511-4d05-b82a-ecd9a7961503 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151843 Aug 24 06:28:58.060345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 708/1410] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:57 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:28:59.081789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dcff20b0-6a64-4366-bc33-d40306577aed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:28:59.082378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dcff20b0-6a64-4366-bc33-d40306577aed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:28:59.089503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcff20b0-6a64-4366-bc33-d40306577aed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:59.089923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcff20b0-6a64-4366-bc33-d40306577aed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:59.090350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcff20b0-6a64-4366-bc33-d40306577aed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:59.091032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcff20b0-6a64-4366-bc33-d40306577aed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:28:59.091481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcff20b0-6a64-4366-bc33-d40306577aed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:28:59.091905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dcff20b0-6a64-4366-bc33-d40306577aed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:28:59.219014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dcff20b0-6a64-4366-bc33-d40306577aed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:28:59.227363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dcff20b0-6a64-4366-bc33-d40306577aed tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149778 Aug 24 06:28:59.232315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 703/1411] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:28:59 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:00.248886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7bad5e90-3651-4625-a6ec-ac2ee3b22e18 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:00.249517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7bad5e90-3651-4625-a6ec-ac2ee3b22e18 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:00.255850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bad5e90-3651-4625-a6ec-ac2ee3b22e18 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:00.256333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bad5e90-3651-4625-a6ec-ac2ee3b22e18 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:00.256795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bad5e90-3651-4625-a6ec-ac2ee3b22e18 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:00.257487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bad5e90-3651-4625-a6ec-ac2ee3b22e18 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:00.257938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bad5e90-3651-4625-a6ec-ac2ee3b22e18 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:00.258362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bad5e90-3651-4625-a6ec-ac2ee3b22e18 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:00.388395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7bad5e90-3651-4625-a6ec-ac2ee3b22e18 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:00.396620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7bad5e90-3651-4625-a6ec-ac2ee3b22e18 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151507 Aug 24 06:29:00.397164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 709/1412] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:00 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:01.418784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cb6560ca-1226-4fa0-bc2c-eae972b9c969 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:01.419395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cb6560ca-1226-4fa0-bc2c-eae972b9c969 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:01.426210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb6560ca-1226-4fa0-bc2c-eae972b9c969 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:01.426690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb6560ca-1226-4fa0-bc2c-eae972b9c969 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:01.427119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb6560ca-1226-4fa0-bc2c-eae972b9c969 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:01.427824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb6560ca-1226-4fa0-bc2c-eae972b9c969 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:01.428269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb6560ca-1226-4fa0-bc2c-eae972b9c969 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:01.428717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb6560ca-1226-4fa0-bc2c-eae972b9c969 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:01.556944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cb6560ca-1226-4fa0-bc2c-eae972b9c969 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:01.565338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cb6560ca-1226-4fa0-bc2c-eae972b9c969 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150390 Aug 24 06:29:01.565888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 704/1413] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:01 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:02.587679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-13c8609f-36a6-4ce0-a9cc-39acbde18231 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:02.588322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-13c8609f-36a6-4ce0-a9cc-39acbde18231 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:02.595243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13c8609f-36a6-4ce0-a9cc-39acbde18231 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:02.595756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13c8609f-36a6-4ce0-a9cc-39acbde18231 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:02.596184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13c8609f-36a6-4ce0-a9cc-39acbde18231 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:02.596924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13c8609f-36a6-4ce0-a9cc-39acbde18231 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:02.597370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13c8609f-36a6-4ce0-a9cc-39acbde18231 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:02.597785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13c8609f-36a6-4ce0-a9cc-39acbde18231 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:02.994136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-13c8609f-36a6-4ce0-a9cc-39acbde18231 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:03.002659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-13c8609f-36a6-4ce0-a9cc-39acbde18231 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.419374 Aug 24 06:29:03.003238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 710/1414] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:02 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:04.024108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-76ea4642-5761-4071-be9e-cdb9061fd3a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:04.024653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-76ea4642-5761-4071-be9e-cdb9061fd3a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:04.031178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76ea4642-5761-4071-be9e-cdb9061fd3a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:04.031652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76ea4642-5761-4071-be9e-cdb9061fd3a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:04.032080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76ea4642-5761-4071-be9e-cdb9061fd3a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:04.032783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76ea4642-5761-4071-be9e-cdb9061fd3a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:04.033227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76ea4642-5761-4071-be9e-cdb9061fd3a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:04.033646 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76ea4642-5761-4071-be9e-cdb9061fd3a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:04.158691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-76ea4642-5761-4071-be9e-cdb9061fd3a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:04.167011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-76ea4642-5761-4071-be9e-cdb9061fd3a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.147018 Aug 24 06:29:04.167564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 705/1415] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:04 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:05.188834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-19dda4f4-e047-489c-921e-10d6c200fc87 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:05.189476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-19dda4f4-e047-489c-921e-10d6c200fc87 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:05.197130 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19dda4f4-e047-489c-921e-10d6c200fc87 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:05.198093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19dda4f4-e047-489c-921e-10d6c200fc87 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:05.198525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19dda4f4-e047-489c-921e-10d6c200fc87 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:05.199419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19dda4f4-e047-489c-921e-10d6c200fc87 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:05.199756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19dda4f4-e047-489c-921e-10d6c200fc87 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:05.200179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19dda4f4-e047-489c-921e-10d6c200fc87 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:05.331557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-19dda4f4-e047-489c-921e-10d6c200fc87 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:05.340630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-19dda4f4-e047-489c-921e-10d6c200fc87 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155707 Aug 24 06:29:05.341210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 711/1416] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:05 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:06.361556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cef1aa12-535a-4efc-9d80-11efa61e2fc9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:06.362168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cef1aa12-535a-4efc-9d80-11efa61e2fc9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:06.368665 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cef1aa12-535a-4efc-9d80-11efa61e2fc9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:06.369635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cef1aa12-535a-4efc-9d80-11efa61e2fc9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:06.370072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cef1aa12-535a-4efc-9d80-11efa61e2fc9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:06.370809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cef1aa12-535a-4efc-9d80-11efa61e2fc9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:06.371258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cef1aa12-535a-4efc-9d80-11efa61e2fc9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:06.371680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cef1aa12-535a-4efc-9d80-11efa61e2fc9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:06.501477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cef1aa12-535a-4efc-9d80-11efa61e2fc9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:06.510362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cef1aa12-535a-4efc-9d80-11efa61e2fc9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152098 Aug 24 06:29:06.510952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 706/1417] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:06 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:07.531716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fa5aef6d-c52a-464f-8d15-c84624878c0e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:07.532325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fa5aef6d-c52a-464f-8d15-c84624878c0e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:07.538873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa5aef6d-c52a-464f-8d15-c84624878c0e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:07.539289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa5aef6d-c52a-464f-8d15-c84624878c0e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:07.539725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa5aef6d-c52a-464f-8d15-c84624878c0e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:07.540412 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa5aef6d-c52a-464f-8d15-c84624878c0e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:07.540885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa5aef6d-c52a-464f-8d15-c84624878c0e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:07.541366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa5aef6d-c52a-464f-8d15-c84624878c0e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:07.674425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fa5aef6d-c52a-464f-8d15-c84624878c0e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:07.683675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fa5aef6d-c52a-464f-8d15-c84624878c0e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155580 Aug 24 06:29:07.688190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 712/1418] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:07 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:08.708698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1d35548e-e4a4-4985-8aed-53825d46044d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:08.709151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1d35548e-e4a4-4985-8aed-53825d46044d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:08.712384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=26 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:29:08.715775 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d35548e-e4a4-4985-8aed-53825d46044d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:08.716254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d35548e-e4a4-4985-8aed-53825d46044d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:08.716723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d35548e-e4a4-4985-8aed-53825d46044d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:08.717421 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d35548e-e4a4-4985-8aed-53825d46044d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:08.717875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d35548e-e4a4-4985-8aed-53825d46044d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:08.718299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d35548e-e4a4-4985-8aed-53825d46044d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:08.720901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=78 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:29:08.847177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1d35548e-e4a4-4985-8aed-53825d46044d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:08.855223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1d35548e-e4a4-4985-8aed-53825d46044d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150577 Aug 24 06:29:08.855786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 707/1419] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:08 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:09.875996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-55a0499e-dbf1-40eb-b55b-2beed200268e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:09.876623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-55a0499e-dbf1-40eb-b55b-2beed200268e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:09.882990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55a0499e-dbf1-40eb-b55b-2beed200268e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:09.883460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55a0499e-dbf1-40eb-b55b-2beed200268e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:09.883885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55a0499e-dbf1-40eb-b55b-2beed200268e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:09.885152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55a0499e-dbf1-40eb-b55b-2beed200268e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:09.885600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55a0499e-dbf1-40eb-b55b-2beed200268e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:09.886013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55a0499e-dbf1-40eb-b55b-2beed200268e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:10.011669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-55a0499e-dbf1-40eb-b55b-2beed200268e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:10.019957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-55a0499e-dbf1-40eb-b55b-2beed200268e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.147845 Aug 24 06:29:10.023746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 713/1420] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:09 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:11.041693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-404dc1e3-d3e3-4e7b-b079-5d572f173025 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:11.042300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-404dc1e3-d3e3-4e7b-b079-5d572f173025 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:11.048742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-404dc1e3-d3e3-4e7b-b079-5d572f173025 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:11.049219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-404dc1e3-d3e3-4e7b-b079-5d572f173025 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:11.049650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-404dc1e3-d3e3-4e7b-b079-5d572f173025 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:11.050338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-404dc1e3-d3e3-4e7b-b079-5d572f173025 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:11.050781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-404dc1e3-d3e3-4e7b-b079-5d572f173025 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:11.051199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-404dc1e3-d3e3-4e7b-b079-5d572f173025 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:11.184932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-404dc1e3-d3e3-4e7b-b079-5d572f173025 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:11.193459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-404dc1e3-d3e3-4e7b-b079-5d572f173025 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156289 Aug 24 06:29:11.194087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 708/1421] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:11 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:12.215022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0c55b10e-520d-4603-9997-a725e8d830df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:12.215636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0c55b10e-520d-4603-9997-a725e8d830df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:12.221995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c55b10e-520d-4603-9997-a725e8d830df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:12.222469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c55b10e-520d-4603-9997-a725e8d830df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:12.223146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c55b10e-520d-4603-9997-a725e8d830df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:12.223588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c55b10e-520d-4603-9997-a725e8d830df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:12.224027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c55b10e-520d-4603-9997-a725e8d830df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:12.224442 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c55b10e-520d-4603-9997-a725e8d830df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:12.355740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0c55b10e-520d-4603-9997-a725e8d830df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:12.363899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0c55b10e-520d-4603-9997-a725e8d830df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152784 Aug 24 06:29:12.364455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 714/1422] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:12 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:13.385370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3fde8106-58b7-44bc-b1d9-4f381745117b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:13.385982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3fde8106-58b7-44bc-b1d9-4f381745117b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:13.392538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fde8106-58b7-44bc-b1d9-4f381745117b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:13.393026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fde8106-58b7-44bc-b1d9-4f381745117b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:13.393463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fde8106-58b7-44bc-b1d9-4f381745117b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:13.394151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fde8106-58b7-44bc-b1d9-4f381745117b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:13.394603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fde8106-58b7-44bc-b1d9-4f381745117b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:13.395024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fde8106-58b7-44bc-b1d9-4f381745117b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:13.522887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3fde8106-58b7-44bc-b1d9-4f381745117b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:13.531034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3fde8106-58b7-44bc-b1d9-4f381745117b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150100 Aug 24 06:29:13.531545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 709/1423] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:13 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:14.552344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9fb43db4-6329-4286-a20f-8b38f4906eaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:14.553003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9fb43db4-6329-4286-a20f-8b38f4906eaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:14.560292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9fb43db4-6329-4286-a20f-8b38f4906eaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:14.560791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9fb43db4-6329-4286-a20f-8b38f4906eaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:14.561232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9fb43db4-6329-4286-a20f-8b38f4906eaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:14.561911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9fb43db4-6329-4286-a20f-8b38f4906eaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:14.562365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9fb43db4-6329-4286-a20f-8b38f4906eaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:14.562766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9fb43db4-6329-4286-a20f-8b38f4906eaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:14.694138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9fb43db4-6329-4286-a20f-8b38f4906eaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:14.703327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9fb43db4-6329-4286-a20f-8b38f4906eaa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154723 Aug 24 06:29:14.704220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 715/1424] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:14 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:15.723151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c1ffafd1-47c8-4965-8bae-fd72691179dd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:15.723762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c1ffafd1-47c8-4965-8bae-fd72691179dd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:15.730290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1ffafd1-47c8-4965-8bae-fd72691179dd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:15.730767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1ffafd1-47c8-4965-8bae-fd72691179dd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:15.731201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1ffafd1-47c8-4965-8bae-fd72691179dd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:15.731887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1ffafd1-47c8-4965-8bae-fd72691179dd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:15.732336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1ffafd1-47c8-4965-8bae-fd72691179dd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:15.732795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1ffafd1-47c8-4965-8bae-fd72691179dd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:15.865221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c1ffafd1-47c8-4965-8bae-fd72691179dd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:15.873522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c1ffafd1-47c8-4965-8bae-fd72691179dd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154198 Aug 24 06:29:15.877541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 710/1425] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:15 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:16.897653 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ee4f8430-05e2-45ea-a4df-f0b7140b3ead tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:16.898360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ee4f8430-05e2-45ea-a4df-f0b7140b3ead tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:16.901306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=26 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:29:16.906170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee4f8430-05e2-45ea-a4df-f0b7140b3ead tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:16.906658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee4f8430-05e2-45ea-a4df-f0b7140b3ead tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:16.907091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee4f8430-05e2-45ea-a4df-f0b7140b3ead tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:16.907806 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee4f8430-05e2-45ea-a4df-f0b7140b3ead tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:16.908258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee4f8430-05e2-45ea-a4df-f0b7140b3ead tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:16.908788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee4f8430-05e2-45ea-a4df-f0b7140b3ead tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:17.039582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ee4f8430-05e2-45ea-a4df-f0b7140b3ead tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:17.048518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ee4f8430-05e2-45ea-a4df-f0b7140b3ead tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154687 Aug 24 06:29:17.049092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 716/1426] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:16 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:18.069533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dd97b2ce-2a6f-4acc-9e37-87ff94574a4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:18.070146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dd97b2ce-2a6f-4acc-9e37-87ff94574a4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:18.076691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd97b2ce-2a6f-4acc-9e37-87ff94574a4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:18.077172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd97b2ce-2a6f-4acc-9e37-87ff94574a4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:18.077606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd97b2ce-2a6f-4acc-9e37-87ff94574a4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:18.078294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd97b2ce-2a6f-4acc-9e37-87ff94574a4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:18.078743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd97b2ce-2a6f-4acc-9e37-87ff94574a4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:18.079188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dd97b2ce-2a6f-4acc-9e37-87ff94574a4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:18.209476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dd97b2ce-2a6f-4acc-9e37-87ff94574a4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:18.217668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dd97b2ce-2a6f-4acc-9e37-87ff94574a4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151968 Aug 24 06:29:18.218228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 711/1427] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:18 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:19.239404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-968ff26e-2410-4f90-b5f7-75ced006b668 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:19.240011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-968ff26e-2410-4f90-b5f7-75ced006b668 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:19.246613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968ff26e-2410-4f90-b5f7-75ced006b668 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:19.247084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968ff26e-2410-4f90-b5f7-75ced006b668 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:19.247511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968ff26e-2410-4f90-b5f7-75ced006b668 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:19.248186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968ff26e-2410-4f90-b5f7-75ced006b668 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:19.248662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968ff26e-2410-4f90-b5f7-75ced006b668 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:19.249075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-968ff26e-2410-4f90-b5f7-75ced006b668 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:19.253009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=84 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:29:19.381647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-968ff26e-2410-4f90-b5f7-75ced006b668 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:19.390344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-968ff26e-2410-4f90-b5f7-75ced006b668 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154776 Aug 24 06:29:19.390911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 717/1428] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:19 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:20.410946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-db8319cd-4ff3-44c8-982b-8ca0d78002db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:20.411619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-db8319cd-4ff3-44c8-982b-8ca0d78002db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:20.417901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db8319cd-4ff3-44c8-982b-8ca0d78002db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:20.418375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db8319cd-4ff3-44c8-982b-8ca0d78002db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:20.418801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db8319cd-4ff3-44c8-982b-8ca0d78002db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:20.419473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db8319cd-4ff3-44c8-982b-8ca0d78002db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:20.419917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db8319cd-4ff3-44c8-982b-8ca0d78002db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:20.420330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db8319cd-4ff3-44c8-982b-8ca0d78002db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:20.547720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-db8319cd-4ff3-44c8-982b-8ca0d78002db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:20.556061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-db8319cd-4ff3-44c8-982b-8ca0d78002db tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.148871 Aug 24 06:29:20.556652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 712/1429] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:20 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:21.577980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cb915f99-7686-44df-b46d-8f81dacb813b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:21.578561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cb915f99-7686-44df-b46d-8f81dacb813b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:21.585247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb915f99-7686-44df-b46d-8f81dacb813b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:21.585726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb915f99-7686-44df-b46d-8f81dacb813b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:21.586157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb915f99-7686-44df-b46d-8f81dacb813b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:21.586849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb915f99-7686-44df-b46d-8f81dacb813b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:21.587348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb915f99-7686-44df-b46d-8f81dacb813b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:21.587771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb915f99-7686-44df-b46d-8f81dacb813b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:21.716182 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cb915f99-7686-44df-b46d-8f81dacb813b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:21.724444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cb915f99-7686-44df-b46d-8f81dacb813b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150272 Aug 24 06:29:21.725045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 718/1430] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:21 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:22.746294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-477e87ee-fb73-4983-bf5b-8ecf5d6eb39d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:22.746953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-477e87ee-fb73-4983-bf5b-8ecf5d6eb39d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:22.753926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-477e87ee-fb73-4983-bf5b-8ecf5d6eb39d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:22.754304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-477e87ee-fb73-4983-bf5b-8ecf5d6eb39d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:22.754736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-477e87ee-fb73-4983-bf5b-8ecf5d6eb39d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:22.755430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-477e87ee-fb73-4983-bf5b-8ecf5d6eb39d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:22.755879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-477e87ee-fb73-4983-bf5b-8ecf5d6eb39d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:22.756297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-477e87ee-fb73-4983-bf5b-8ecf5d6eb39d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:22.884623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-477e87ee-fb73-4983-bf5b-8ecf5d6eb39d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:22.892722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-477e87ee-fb73-4983-bf5b-8ecf5d6eb39d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150805 Aug 24 06:29:22.893285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 713/1431] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:22 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:23.915355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-40f98db8-8998-43e3-8c2e-60e4fc36395a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:23.916597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-40f98db8-8998-43e3-8c2e-60e4fc36395a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:23.922926 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40f98db8-8998-43e3-8c2e-60e4fc36395a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:23.923398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40f98db8-8998-43e3-8c2e-60e4fc36395a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:23.923827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40f98db8-8998-43e3-8c2e-60e4fc36395a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:23.924531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40f98db8-8998-43e3-8c2e-60e4fc36395a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:23.924985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40f98db8-8998-43e3-8c2e-60e4fc36395a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:23.925401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40f98db8-8998-43e3-8c2e-60e4fc36395a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:24.055835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-40f98db8-8998-43e3-8c2e-60e4fc36395a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:24.064861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-40f98db8-8998-43e3-8c2e-60e4fc36395a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153489 Aug 24 06:29:24.065424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 719/1432] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:23 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:25.085350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7f2d7c5d-88e3-4f74-9903-89ab68c03e25 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:25.085963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7f2d7c5d-88e3-4f74-9903-89ab68c03e25 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:25.092627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2d7c5d-88e3-4f74-9903-89ab68c03e25 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:25.093109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2d7c5d-88e3-4f74-9903-89ab68c03e25 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:25.093541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2d7c5d-88e3-4f74-9903-89ab68c03e25 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:25.094229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2d7c5d-88e3-4f74-9903-89ab68c03e25 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:25.094677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2d7c5d-88e3-4f74-9903-89ab68c03e25 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:25.095097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f2d7c5d-88e3-4f74-9903-89ab68c03e25 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:25.225801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7f2d7c5d-88e3-4f74-9903-89ab68c03e25 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:25.234163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7f2d7c5d-88e3-4f74-9903-89ab68c03e25 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152703 Aug 24 06:29:25.234726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 714/1433] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:25 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:26.256179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-be3615ca-8fe0-483b-b3c6-36e577645752 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:26.256841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-be3615ca-8fe0-483b-b3c6-36e577645752 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:26.263695 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be3615ca-8fe0-483b-b3c6-36e577645752 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:26.264172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be3615ca-8fe0-483b-b3c6-36e577645752 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:26.264632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be3615ca-8fe0-483b-b3c6-36e577645752 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:26.265323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be3615ca-8fe0-483b-b3c6-36e577645752 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:26.265772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be3615ca-8fe0-483b-b3c6-36e577645752 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:26.266195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be3615ca-8fe0-483b-b3c6-36e577645752 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:26.395625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-be3615ca-8fe0-483b-b3c6-36e577645752 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:26.405087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-be3615ca-8fe0-483b-b3c6-36e577645752 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152731 Aug 24 06:29:26.405657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 720/1434] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:26 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:27.426473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-55b53d2b-2d96-4583-a608-dbf5092dcd65 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:27.427072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-55b53d2b-2d96-4583-a608-dbf5092dcd65 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:27.433722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55b53d2b-2d96-4583-a608-dbf5092dcd65 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:27.434211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55b53d2b-2d96-4583-a608-dbf5092dcd65 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:27.434627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55b53d2b-2d96-4583-a608-dbf5092dcd65 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:27.435423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55b53d2b-2d96-4583-a608-dbf5092dcd65 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:27.435866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55b53d2b-2d96-4583-a608-dbf5092dcd65 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:27.436278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55b53d2b-2d96-4583-a608-dbf5092dcd65 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:27.562753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-55b53d2b-2d96-4583-a608-dbf5092dcd65 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:27.570787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-55b53d2b-2d96-4583-a608-dbf5092dcd65 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.148439 Aug 24 06:29:27.571340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 715/1435] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:27 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:28.593201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e4319ec0-19fd-49f1-ae51-2679592fa1fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:28.593817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e4319ec0-19fd-49f1-ae51-2679592fa1fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:28.600446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4319ec0-19fd-49f1-ae51-2679592fa1fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:28.600965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4319ec0-19fd-49f1-ae51-2679592fa1fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:28.601404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4319ec0-19fd-49f1-ae51-2679592fa1fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:28.602102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4319ec0-19fd-49f1-ae51-2679592fa1fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:28.602554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4319ec0-19fd-49f1-ae51-2679592fa1fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:28.602978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4319ec0-19fd-49f1-ae51-2679592fa1fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:28.731285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e4319ec0-19fd-49f1-ae51-2679592fa1fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:28.739618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e4319ec0-19fd-49f1-ae51-2679592fa1fb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151140 Aug 24 06:29:28.740186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 721/1436] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:28 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:29.760984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-afb9e36f-1eaa-4ab0-a0b9-4d6e9a13691e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:29.761649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-afb9e36f-1eaa-4ab0-a0b9-4d6e9a13691e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:29.768215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-afb9e36f-1eaa-4ab0-a0b9-4d6e9a13691e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:29.768717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-afb9e36f-1eaa-4ab0-a0b9-4d6e9a13691e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:29.769140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-afb9e36f-1eaa-4ab0-a0b9-4d6e9a13691e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:29.769843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-afb9e36f-1eaa-4ab0-a0b9-4d6e9a13691e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:29.770284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-afb9e36f-1eaa-4ab0-a0b9-4d6e9a13691e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:29.770690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-afb9e36f-1eaa-4ab0-a0b9-4d6e9a13691e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:29.909752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-afb9e36f-1eaa-4ab0-a0b9-4d6e9a13691e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:29.918000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-afb9e36f-1eaa-4ab0-a0b9-4d6e9a13691e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.160981 Aug 24 06:29:29.918572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 716/1437] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:29 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:30.939518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-35ed4544-ee1d-4c10-8143-4cee9fbbc7cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:30.939994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-35ed4544-ee1d-4c10-8143-4cee9fbbc7cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:30.947306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35ed4544-ee1d-4c10-8143-4cee9fbbc7cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:30.947785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35ed4544-ee1d-4c10-8143-4cee9fbbc7cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:30.948218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35ed4544-ee1d-4c10-8143-4cee9fbbc7cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:30.948989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35ed4544-ee1d-4c10-8143-4cee9fbbc7cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:30.949679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35ed4544-ee1d-4c10-8143-4cee9fbbc7cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:30.950013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35ed4544-ee1d-4c10-8143-4cee9fbbc7cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:31.084238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-35ed4544-ee1d-4c10-8143-4cee9fbbc7cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:31.093078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-35ed4544-ee1d-4c10-8143-4cee9fbbc7cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157670 Aug 24 06:29:31.093641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 722/1438] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:30 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:32.113955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-acaf0c90-c433-4718-8d52-ac33d1007590 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:32.114561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-acaf0c90-c433-4718-8d52-ac33d1007590 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:32.121677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-acaf0c90-c433-4718-8d52-ac33d1007590 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:32.122156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-acaf0c90-c433-4718-8d52-ac33d1007590 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:32.122586 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-acaf0c90-c433-4718-8d52-ac33d1007590 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:32.123267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-acaf0c90-c433-4718-8d52-ac33d1007590 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:32.123713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-acaf0c90-c433-4718-8d52-ac33d1007590 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:32.124129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-acaf0c90-c433-4718-8d52-ac33d1007590 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:32.252431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-acaf0c90-c433-4718-8d52-ac33d1007590 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:32.260698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-acaf0c90-c433-4718-8d52-ac33d1007590 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150544 Aug 24 06:29:32.261459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 717/1439] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:32 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:33.282180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b2736dd2-b15a-4149-a017-696ab49746fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:33.282831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b2736dd2-b15a-4149-a017-696ab49746fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:33.289365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2736dd2-b15a-4149-a017-696ab49746fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:33.289833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2736dd2-b15a-4149-a017-696ab49746fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:33.290264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2736dd2-b15a-4149-a017-696ab49746fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:33.290955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2736dd2-b15a-4149-a017-696ab49746fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:33.291402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2736dd2-b15a-4149-a017-696ab49746fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:33.291868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2736dd2-b15a-4149-a017-696ab49746fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:33.425282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b2736dd2-b15a-4149-a017-696ab49746fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:33.433755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b2736dd2-b15a-4149-a017-696ab49746fa tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156114 Aug 24 06:29:33.434327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 723/1440] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:33 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:34.455693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d7c57b11-3935-47af-9ebb-c3abe810d79e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:34.456399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d7c57b11-3935-47af-9ebb-c3abe810d79e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:34.462397 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7c57b11-3935-47af-9ebb-c3abe810d79e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:34.462874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7c57b11-3935-47af-9ebb-c3abe810d79e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:34.463305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7c57b11-3935-47af-9ebb-c3abe810d79e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:34.463986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7c57b11-3935-47af-9ebb-c3abe810d79e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:34.464435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7c57b11-3935-47af-9ebb-c3abe810d79e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:34.464920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d7c57b11-3935-47af-9ebb-c3abe810d79e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:34.592672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d7c57b11-3935-47af-9ebb-c3abe810d79e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:34.600817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d7c57b11-3935-47af-9ebb-c3abe810d79e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149068 Aug 24 06:29:34.601374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 718/1441] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:34 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:35.622668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-324f0b02-14be-4d64-aaac-de28b5776384 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:35.623266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-324f0b02-14be-4d64-aaac-de28b5776384 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:35.629736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324f0b02-14be-4d64-aaac-de28b5776384 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:35.630205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324f0b02-14be-4d64-aaac-de28b5776384 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:35.630628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324f0b02-14be-4d64-aaac-de28b5776384 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:35.631305 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324f0b02-14be-4d64-aaac-de28b5776384 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:35.631749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324f0b02-14be-4d64-aaac-de28b5776384 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:35.632162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324f0b02-14be-4d64-aaac-de28b5776384 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:35.763857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-324f0b02-14be-4d64-aaac-de28b5776384 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:35.772042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-324f0b02-14be-4d64-aaac-de28b5776384 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153328 Aug 24 06:29:35.772661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 724/1442] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:35 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:36.793867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5281b448-31b0-4fa8-87d8-02f6b2a542a5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:36.794457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5281b448-31b0-4fa8-87d8-02f6b2a542a5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:36.801233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5281b448-31b0-4fa8-87d8-02f6b2a542a5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:36.801714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5281b448-31b0-4fa8-87d8-02f6b2a542a5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:36.802149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5281b448-31b0-4fa8-87d8-02f6b2a542a5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:36.802835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5281b448-31b0-4fa8-87d8-02f6b2a542a5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:36.803283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5281b448-31b0-4fa8-87d8-02f6b2a542a5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:36.803729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5281b448-31b0-4fa8-87d8-02f6b2a542a5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:36.931203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5281b448-31b0-4fa8-87d8-02f6b2a542a5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:36.940172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5281b448-31b0-4fa8-87d8-02f6b2a542a5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150700 Aug 24 06:29:36.940756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 719/1443] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:36 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:37.961038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-16e7a172-13f9-48de-8619-d664c6b8de56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:37.961669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-16e7a172-13f9-48de-8619-d664c6b8de56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:37.968510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-16e7a172-13f9-48de-8619-d664c6b8de56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:37.969647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-16e7a172-13f9-48de-8619-d664c6b8de56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:37.970085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-16e7a172-13f9-48de-8619-d664c6b8de56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:37.970793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-16e7a172-13f9-48de-8619-d664c6b8de56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:37.971240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-16e7a172-13f9-48de-8619-d664c6b8de56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:37.971693 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-16e7a172-13f9-48de-8619-d664c6b8de56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:38.103038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-16e7a172-13f9-48de-8619-d664c6b8de56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:38.111946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-16e7a172-13f9-48de-8619-d664c6b8de56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154771 Aug 24 06:29:38.112536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 725/1444] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:37 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:39.133340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-68082163-2b1e-4c40-8de0-f9d3794f6f24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:39.133959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-68082163-2b1e-4c40-8de0-f9d3794f6f24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:39.136238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=26 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:29:39.141526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68082163-2b1e-4c40-8de0-f9d3794f6f24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:39.147535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68082163-2b1e-4c40-8de0-f9d3794f6f24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:39.147535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68082163-2b1e-4c40-8de0-f9d3794f6f24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:39.147535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68082163-2b1e-4c40-8de0-f9d3794f6f24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:39.147535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68082163-2b1e-4c40-8de0-f9d3794f6f24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:39.148015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68082163-2b1e-4c40-8de0-f9d3794f6f24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:39.148015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=78 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:29:39.277901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-68082163-2b1e-4c40-8de0-f9d3794f6f24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:39.286189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-68082163-2b1e-4c40-8de0-f9d3794f6f24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156738 Aug 24 06:29:39.286945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 720/1445] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:39 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:40.307879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-42b67136-4bea-4a81-8222-7c1a4e97e436 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:40.308446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-42b67136-4bea-4a81-8222-7c1a4e97e436 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:40.315181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b67136-4bea-4a81-8222-7c1a4e97e436 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:40.315653 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b67136-4bea-4a81-8222-7c1a4e97e436 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:40.316080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b67136-4bea-4a81-8222-7c1a4e97e436 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:40.316799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b67136-4bea-4a81-8222-7c1a4e97e436 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:40.317244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b67136-4bea-4a81-8222-7c1a4e97e436 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:40.317687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b67136-4bea-4a81-8222-7c1a4e97e436 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:40.451876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-42b67136-4bea-4a81-8222-7c1a4e97e436 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:40.465122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-42b67136-4bea-4a81-8222-7c1a4e97e436 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156877 Aug 24 06:29:40.465122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 726/1446] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:40 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:41.481816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e589afbe-556a-4cfb-99b3-4dfbac850bd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:41.482422 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e589afbe-556a-4cfb-99b3-4dfbac850bd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:41.489216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e589afbe-556a-4cfb-99b3-4dfbac850bd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:41.489693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e589afbe-556a-4cfb-99b3-4dfbac850bd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:41.490123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e589afbe-556a-4cfb-99b3-4dfbac850bd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:41.490811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e589afbe-556a-4cfb-99b3-4dfbac850bd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:41.491264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e589afbe-556a-4cfb-99b3-4dfbac850bd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:41.491684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e589afbe-556a-4cfb-99b3-4dfbac850bd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:41.617776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e589afbe-556a-4cfb-99b3-4dfbac850bd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:41.625824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e589afbe-556a-4cfb-99b3-4dfbac850bd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.148468 Aug 24 06:29:41.626389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 721/1447] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:41 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:42.646243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9daac345-4054-4025-a344-314c9d3587c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:42.646889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9daac345-4054-4025-a344-314c9d3587c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:42.653378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9daac345-4054-4025-a344-314c9d3587c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:42.653855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9daac345-4054-4025-a344-314c9d3587c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:42.654289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9daac345-4054-4025-a344-314c9d3587c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:42.654989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9daac345-4054-4025-a344-314c9d3587c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:42.655592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9daac345-4054-4025-a344-314c9d3587c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:42.656021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9daac345-4054-4025-a344-314c9d3587c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:42.785647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9daac345-4054-4025-a344-314c9d3587c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:42.793925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9daac345-4054-4025-a344-314c9d3587c8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151582 Aug 24 06:29:42.794498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 727/1448] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:42 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:43.815062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6f571954-aba9-4400-97cb-865e294cabab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:43.815677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6f571954-aba9-4400-97cb-865e294cabab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:43.822751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f571954-aba9-4400-97cb-865e294cabab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:43.823267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f571954-aba9-4400-97cb-865e294cabab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:43.823701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f571954-aba9-4400-97cb-865e294cabab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:43.824428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f571954-aba9-4400-97cb-865e294cabab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:43.824910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f571954-aba9-4400-97cb-865e294cabab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:43.825675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f571954-aba9-4400-97cb-865e294cabab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:43.952928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6f571954-aba9-4400-97cb-865e294cabab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:43.961165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6f571954-aba9-4400-97cb-865e294cabab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150370 Aug 24 06:29:43.961738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 722/1449] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:43 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:44.983010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-af72ab53-8cc9-4e06-a948-bae640c8711b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:44.983656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-af72ab53-8cc9-4e06-a948-bae640c8711b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:44.990281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af72ab53-8cc9-4e06-a948-bae640c8711b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:44.990762 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af72ab53-8cc9-4e06-a948-bae640c8711b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:44.991201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af72ab53-8cc9-4e06-a948-bae640c8711b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:44.991900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af72ab53-8cc9-4e06-a948-bae640c8711b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:44.992348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af72ab53-8cc9-4e06-a948-bae640c8711b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:44.992804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af72ab53-8cc9-4e06-a948-bae640c8711b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:45.127286 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-af72ab53-8cc9-4e06-a948-bae640c8711b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:45.135441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-af72ab53-8cc9-4e06-a948-bae640c8711b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156994 Aug 24 06:29:45.136054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 728/1450] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:44 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:46.156515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-012895cc-3062-41d9-a378-3aeba5cb25a7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:46.157081 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-012895cc-3062-41d9-a378-3aeba5cb25a7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:46.164053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012895cc-3062-41d9-a378-3aeba5cb25a7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:46.164560 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012895cc-3062-41d9-a378-3aeba5cb25a7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:46.164995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012895cc-3062-41d9-a378-3aeba5cb25a7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:46.165686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012895cc-3062-41d9-a378-3aeba5cb25a7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:46.166188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012895cc-3062-41d9-a378-3aeba5cb25a7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:46.166607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012895cc-3062-41d9-a378-3aeba5cb25a7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:46.298170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-012895cc-3062-41d9-a378-3aeba5cb25a7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:46.306435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-012895cc-3062-41d9-a378-3aeba5cb25a7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154068 Aug 24 06:29:46.307034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 723/1451] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:46 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:47.328000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-31c39d0c-db2d-436c-a2f6-eed4abce2463 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:47.328587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-31c39d0c-db2d-436c-a2f6-eed4abce2463 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:47.330418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=26 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:29:47.335197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31c39d0c-db2d-436c-a2f6-eed4abce2463 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:47.335675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31c39d0c-db2d-436c-a2f6-eed4abce2463 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:47.336109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31c39d0c-db2d-436c-a2f6-eed4abce2463 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:47.336829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31c39d0c-db2d-436c-a2f6-eed4abce2463 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:47.337281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31c39d0c-db2d-436c-a2f6-eed4abce2463 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:47.337703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-31c39d0c-db2d-436c-a2f6-eed4abce2463 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:47.465203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-31c39d0c-db2d-436c-a2f6-eed4abce2463 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:47.473697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-31c39d0c-db2d-436c-a2f6-eed4abce2463 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150275 Aug 24 06:29:47.474257 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 729/1452] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:47 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:48.494327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-62c95bf2-41ee-4f34-bb33-07cdc6d03726 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:48.495021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-62c95bf2-41ee-4f34-bb33-07cdc6d03726 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:48.502140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c95bf2-41ee-4f34-bb33-07cdc6d03726 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:48.502625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c95bf2-41ee-4f34-bb33-07cdc6d03726 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:48.503045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c95bf2-41ee-4f34-bb33-07cdc6d03726 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:48.503727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c95bf2-41ee-4f34-bb33-07cdc6d03726 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:48.504172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c95bf2-41ee-4f34-bb33-07cdc6d03726 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:48.504619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c95bf2-41ee-4f34-bb33-07cdc6d03726 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:48.645991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-62c95bf2-41ee-4f34-bb33-07cdc6d03726 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:48.654730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-62c95bf2-41ee-4f34-bb33-07cdc6d03726 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.164296 Aug 24 06:29:48.659186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 724/1453] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:48 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:49.682403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e32f318b-464f-4b25-8ad0-acb010c13b1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:49.683315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e32f318b-464f-4b25-8ad0-acb010c13b1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:49.690355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e32f318b-464f-4b25-8ad0-acb010c13b1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:49.690983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e32f318b-464f-4b25-8ad0-acb010c13b1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:49.691421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e32f318b-464f-4b25-8ad0-acb010c13b1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:49.692116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e32f318b-464f-4b25-8ad0-acb010c13b1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:49.692594 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e32f318b-464f-4b25-8ad0-acb010c13b1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:49.693015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e32f318b-464f-4b25-8ad0-acb010c13b1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:49.695584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=78 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:29:49.822935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e32f318b-464f-4b25-8ad0-acb010c13b1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:49.831768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e32f318b-464f-4b25-8ad0-acb010c13b1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153535 Aug 24 06:29:49.832330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 730/1454] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:49 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:50.852692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-29a03ad6-85b0-495d-b274-52373e050e24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:50.853280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-29a03ad6-85b0-495d-b274-52373e050e24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:50.859642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-29a03ad6-85b0-495d-b274-52373e050e24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:50.860114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-29a03ad6-85b0-495d-b274-52373e050e24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:50.860568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-29a03ad6-85b0-495d-b274-52373e050e24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:50.861255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-29a03ad6-85b0-495d-b274-52373e050e24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:50.861707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-29a03ad6-85b0-495d-b274-52373e050e24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:50.862128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-29a03ad6-85b0-495d-b274-52373e050e24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:50.989662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-29a03ad6-85b0-495d-b274-52373e050e24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:50.997960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-29a03ad6-85b0-495d-b274-52373e050e24 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149244 Aug 24 06:29:50.998541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 725/1455] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:50 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:52.019138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c43b9a32-e7c3-487f-91ae-c5b5dbfe3d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:52.019814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c43b9a32-e7c3-487f-91ae-c5b5dbfe3d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:52.027829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c43b9a32-e7c3-487f-91ae-c5b5dbfe3d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:52.028315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c43b9a32-e7c3-487f-91ae-c5b5dbfe3d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:52.028784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c43b9a32-e7c3-487f-91ae-c5b5dbfe3d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:52.029492 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c43b9a32-e7c3-487f-91ae-c5b5dbfe3d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:52.029943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c43b9a32-e7c3-487f-91ae-c5b5dbfe3d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:52.030367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c43b9a32-e7c3-487f-91ae-c5b5dbfe3d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:52.166214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c43b9a32-e7c3-487f-91ae-c5b5dbfe3d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:52.175074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c43b9a32-e7c3-487f-91ae-c5b5dbfe3d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.159877 Aug 24 06:29:52.175646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 731/1456] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:52 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:53.196098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9001d892-d4e9-41e9-bdb9-24f93d3f4d83 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:53.196732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9001d892-d4e9-41e9-bdb9-24f93d3f4d83 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:53.203231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9001d892-d4e9-41e9-bdb9-24f93d3f4d83 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:53.203694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9001d892-d4e9-41e9-bdb9-24f93d3f4d83 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:53.204128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9001d892-d4e9-41e9-bdb9-24f93d3f4d83 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:53.204850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9001d892-d4e9-41e9-bdb9-24f93d3f4d83 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:53.205297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9001d892-d4e9-41e9-bdb9-24f93d3f4d83 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:53.205715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9001d892-d4e9-41e9-bdb9-24f93d3f4d83 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:53.334803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9001d892-d4e9-41e9-bdb9-24f93d3f4d83 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:53.343551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9001d892-d4e9-41e9-bdb9-24f93d3f4d83 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151318 Aug 24 06:29:53.344109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 726/1457] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:53 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:54.365063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6646f9fb-b4d3-4907-98da-8af89873d43b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:54.365668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6646f9fb-b4d3-4907-98da-8af89873d43b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:54.372432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6646f9fb-b4d3-4907-98da-8af89873d43b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:54.372933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6646f9fb-b4d3-4907-98da-8af89873d43b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:54.373373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6646f9fb-b4d3-4907-98da-8af89873d43b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:54.374047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6646f9fb-b4d3-4907-98da-8af89873d43b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:54.374488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6646f9fb-b4d3-4907-98da-8af89873d43b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:54.374904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6646f9fb-b4d3-4907-98da-8af89873d43b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:54.516409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6646f9fb-b4d3-4907-98da-8af89873d43b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:54.524572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6646f9fb-b4d3-4907-98da-8af89873d43b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.163236 Aug 24 06:29:54.525144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 732/1458] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:54 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:55.546103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c9eccb4c-335f-4184-9f74-e9575df69718 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:55.546662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c9eccb4c-335f-4184-9f74-e9575df69718 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:55.553223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eccb4c-335f-4184-9f74-e9575df69718 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:55.553701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eccb4c-335f-4184-9f74-e9575df69718 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:55.554129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eccb4c-335f-4184-9f74-e9575df69718 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:55.554809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eccb4c-335f-4184-9f74-e9575df69718 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:55.555258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eccb4c-335f-4184-9f74-e9575df69718 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:55.555675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9eccb4c-335f-4184-9f74-e9575df69718 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:55.681220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c9eccb4c-335f-4184-9f74-e9575df69718 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:55.690366 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c9eccb4c-335f-4184-9f74-e9575df69718 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.148657 Aug 24 06:29:55.690933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 727/1459] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:55 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:29:56.711175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3a731aa1-3cb4-4d82-85e4-3ebcfabd5a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:56.711794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3a731aa1-3cb4-4d82-85e4-3ebcfabd5a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:56.718348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a731aa1-3cb4-4d82-85e4-3ebcfabd5a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:56.718822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a731aa1-3cb4-4d82-85e4-3ebcfabd5a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:56.719261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a731aa1-3cb4-4d82-85e4-3ebcfabd5a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:56.719979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a731aa1-3cb4-4d82-85e4-3ebcfabd5a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:56.720427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a731aa1-3cb4-4d82-85e4-3ebcfabd5a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:56.720872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3a731aa1-3cb4-4d82-85e4-3ebcfabd5a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:56.851485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3a731aa1-3cb4-4d82-85e4-3ebcfabd5a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:56.859730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3a731aa1-3cb4-4d82-85e4-3ebcfabd5a86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152400 Aug 24 06:29:56.860400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 733/1460] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:56 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:57.880195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-deb4cacd-4fca-487a-9ebc-6607c6e19d7e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:57.880821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-deb4cacd-4fca-487a-9ebc-6607c6e19d7e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:57.888125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-deb4cacd-4fca-487a-9ebc-6607c6e19d7e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:57.888643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-deb4cacd-4fca-487a-9ebc-6607c6e19d7e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:57.889070 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-deb4cacd-4fca-487a-9ebc-6607c6e19d7e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:57.889766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-deb4cacd-4fca-487a-9ebc-6607c6e19d7e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:57.890209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-deb4cacd-4fca-487a-9ebc-6607c6e19d7e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:57.890624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-deb4cacd-4fca-487a-9ebc-6607c6e19d7e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:58.027226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-deb4cacd-4fca-487a-9ebc-6607c6e19d7e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:58.035501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-deb4cacd-4fca-487a-9ebc-6607c6e19d7e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.159104 Aug 24 06:29:58.036086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 728/1461] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:57 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:59.056463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e8e95bd4-fa7c-41e1-9a2a-bbcf0e991c5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:29:59.057131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e8e95bd4-fa7c-41e1-9a2a-bbcf0e991c5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:29:59.064234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e95bd4-fa7c-41e1-9a2a-bbcf0e991c5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:59.064850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e95bd4-fa7c-41e1-9a2a-bbcf0e991c5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:59.065188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e95bd4-fa7c-41e1-9a2a-bbcf0e991c5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:59.065992 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e95bd4-fa7c-41e1-9a2a-bbcf0e991c5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:29:59.066349 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e95bd4-fa7c-41e1-9a2a-bbcf0e991c5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:29:59.066782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e95bd4-fa7c-41e1-9a2a-bbcf0e991c5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:29:59.197876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e8e95bd4-fa7c-41e1-9a2a-bbcf0e991c5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:29:59.206678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e8e95bd4-fa7c-41e1-9a2a-bbcf0e991c5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154191 Aug 24 06:29:59.207256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 734/1462] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:29:59 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:29:59.898958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:29:59.899135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:30:00.227084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e98fa6d6-668c-4c33-ba60-cfd7a3119109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:00.227691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e98fa6d6-668c-4c33-ba60-cfd7a3119109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:00.234456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98fa6d6-668c-4c33-ba60-cfd7a3119109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:00.235188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98fa6d6-668c-4c33-ba60-cfd7a3119109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:00.235624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98fa6d6-668c-4c33-ba60-cfd7a3119109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:00.236314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98fa6d6-668c-4c33-ba60-cfd7a3119109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:00.236796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98fa6d6-668c-4c33-ba60-cfd7a3119109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:00.237288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e98fa6d6-668c-4c33-ba60-cfd7a3119109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:00.365660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e98fa6d6-668c-4c33-ba60-cfd7a3119109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:00.374576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e98fa6d6-668c-4c33-ba60-cfd7a3119109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151267 Aug 24 06:30:00.375159 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 729/1463] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:00 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:01.396079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ac7b8ea2-49d7-4b9f-85c8-9f65d699ecbc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:01.396711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ac7b8ea2-49d7-4b9f-85c8-9f65d699ecbc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:01.403979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac7b8ea2-49d7-4b9f-85c8-9f65d699ecbc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:01.404452 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac7b8ea2-49d7-4b9f-85c8-9f65d699ecbc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:01.404906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac7b8ea2-49d7-4b9f-85c8-9f65d699ecbc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:01.405584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac7b8ea2-49d7-4b9f-85c8-9f65d699ecbc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:01.406026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac7b8ea2-49d7-4b9f-85c8-9f65d699ecbc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:01.406439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ac7b8ea2-49d7-4b9f-85c8-9f65d699ecbc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:01.539313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ac7b8ea2-49d7-4b9f-85c8-9f65d699ecbc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:01.547975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ac7b8ea2-49d7-4b9f-85c8-9f65d699ecbc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155833 Aug 24 06:30:01.548544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 735/1464] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:01 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:02.570083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-efd75627-e4ea-47d5-9b8d-2b17f8a9fd63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:02.570619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-efd75627-e4ea-47d5-9b8d-2b17f8a9fd63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:02.578383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-efd75627-e4ea-47d5-9b8d-2b17f8a9fd63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:02.578885 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-efd75627-e4ea-47d5-9b8d-2b17f8a9fd63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:02.579319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-efd75627-e4ea-47d5-9b8d-2b17f8a9fd63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:02.580021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-efd75627-e4ea-47d5-9b8d-2b17f8a9fd63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:02.580519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-efd75627-e4ea-47d5-9b8d-2b17f8a9fd63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:02.580978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-efd75627-e4ea-47d5-9b8d-2b17f8a9fd63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:02.726332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-efd75627-e4ea-47d5-9b8d-2b17f8a9fd63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:02.739164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-efd75627-e4ea-47d5-9b8d-2b17f8a9fd63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.173104 Aug 24 06:30:02.739753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 730/1465] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:02 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:03.762211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-de35f12c-9f1b-46b4-a5e6-2391323c5635 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:03.762838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-de35f12c-9f1b-46b4-a5e6-2391323c5635 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:03.769423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de35f12c-9f1b-46b4-a5e6-2391323c5635 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:03.769912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de35f12c-9f1b-46b4-a5e6-2391323c5635 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:03.770354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de35f12c-9f1b-46b4-a5e6-2391323c5635 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:03.771065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de35f12c-9f1b-46b4-a5e6-2391323c5635 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:03.771519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de35f12c-9f1b-46b4-a5e6-2391323c5635 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:03.771946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de35f12c-9f1b-46b4-a5e6-2391323c5635 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:03.915354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-de35f12c-9f1b-46b4-a5e6-2391323c5635 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:03.923658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-de35f12c-9f1b-46b4-a5e6-2391323c5635 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.165983 Aug 24 06:30:03.924223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 736/1466] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:03 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:04.945344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b0317e4c-d2f6-46b6-a3bc-26b5f84d0bc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:04.945940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b0317e4c-d2f6-46b6-a3bc-26b5f84d0bc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:04.952446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b0317e4c-d2f6-46b6-a3bc-26b5f84d0bc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:04.952956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b0317e4c-d2f6-46b6-a3bc-26b5f84d0bc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:04.953391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b0317e4c-d2f6-46b6-a3bc-26b5f84d0bc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:04.954073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b0317e4c-d2f6-46b6-a3bc-26b5f84d0bc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:04.954517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b0317e4c-d2f6-46b6-a3bc-26b5f84d0bc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:04.954932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b0317e4c-d2f6-46b6-a3bc-26b5f84d0bc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:05.083710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b0317e4c-d2f6-46b6-a3bc-26b5f84d0bc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:05.092651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b0317e4c-d2f6-46b6-a3bc-26b5f84d0bc0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151111 Aug 24 06:30:05.093220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 731/1467] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:04 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:05.203877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:30:05.204466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:30:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:30:05.824050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:30:05.824336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:30:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:30:06.114178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6c116aaa-7a5c-4442-8888-23bf0877ae0d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:06.114701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6c116aaa-7a5c-4442-8888-23bf0877ae0d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:06.121240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c116aaa-7a5c-4442-8888-23bf0877ae0d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:06.121716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c116aaa-7a5c-4442-8888-23bf0877ae0d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:06.122145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c116aaa-7a5c-4442-8888-23bf0877ae0d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:06.122833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c116aaa-7a5c-4442-8888-23bf0877ae0d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:06.123280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c116aaa-7a5c-4442-8888-23bf0877ae0d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:06.123693 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c116aaa-7a5c-4442-8888-23bf0877ae0d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:06.259590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6c116aaa-7a5c-4442-8888-23bf0877ae0d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:06.268565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6c116aaa-7a5c-4442-8888-23bf0877ae0d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158355 Aug 24 06:30:06.269136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 737/1468] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:06 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:07.289739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e2fcd625-bdee-4b13-86ab-5279dee0bf63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:07.290346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e2fcd625-bdee-4b13-86ab-5279dee0bf63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:07.297361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2fcd625-bdee-4b13-86ab-5279dee0bf63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:07.297844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2fcd625-bdee-4b13-86ab-5279dee0bf63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:07.298278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2fcd625-bdee-4b13-86ab-5279dee0bf63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:07.298968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2fcd625-bdee-4b13-86ab-5279dee0bf63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:07.299416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2fcd625-bdee-4b13-86ab-5279dee0bf63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:07.299836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e2fcd625-bdee-4b13-86ab-5279dee0bf63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:07.438511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e2fcd625-bdee-4b13-86ab-5279dee0bf63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:07.446927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e2fcd625-bdee-4b13-86ab-5279dee0bf63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.161229 Aug 24 06:30:07.447496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 732/1469] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:07 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:08.467688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-52a32a66-f60d-41f1-80e1-4d5e880b8a62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:08.468299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-52a32a66-f60d-41f1-80e1-4d5e880b8a62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:08.474816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52a32a66-f60d-41f1-80e1-4d5e880b8a62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:08.475294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52a32a66-f60d-41f1-80e1-4d5e880b8a62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:08.475729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52a32a66-f60d-41f1-80e1-4d5e880b8a62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:08.476421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52a32a66-f60d-41f1-80e1-4d5e880b8a62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:08.476900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52a32a66-f60d-41f1-80e1-4d5e880b8a62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:08.477324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-52a32a66-f60d-41f1-80e1-4d5e880b8a62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:08.613510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-52a32a66-f60d-41f1-80e1-4d5e880b8a62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:08.622039 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-52a32a66-f60d-41f1-80e1-4d5e880b8a62 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158640 Aug 24 06:30:08.622825 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 738/1470] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:08 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:09.643169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2c7e3ccc-d142-46e9-85ca-774fc322e83e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:09.643763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2c7e3ccc-d142-46e9-85ca-774fc322e83e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:09.646051 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=26 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:30:09.650804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c7e3ccc-d142-46e9-85ca-774fc322e83e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:09.651277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c7e3ccc-d142-46e9-85ca-774fc322e83e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:09.652791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c7e3ccc-d142-46e9-85ca-774fc322e83e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:09.653010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c7e3ccc-d142-46e9-85ca-774fc322e83e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:09.653457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c7e3ccc-d142-46e9-85ca-774fc322e83e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:09.653876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c7e3ccc-d142-46e9-85ca-774fc322e83e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:09.656563 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=78 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:30:09.788095 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2c7e3ccc-d142-46e9-85ca-774fc322e83e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:09.797387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2c7e3ccc-d142-46e9-85ca-774fc322e83e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158046 Aug 24 06:30:09.797955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 733/1471] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:09 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:10.818995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-165fe727-9d6c-40ca-a6ec-5ced6070dfb0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:10.819656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-165fe727-9d6c-40ca-a6ec-5ced6070dfb0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:10.826265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-165fe727-9d6c-40ca-a6ec-5ced6070dfb0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:10.826741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-165fe727-9d6c-40ca-a6ec-5ced6070dfb0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:10.827171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-165fe727-9d6c-40ca-a6ec-5ced6070dfb0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:10.827869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-165fe727-9d6c-40ca-a6ec-5ced6070dfb0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:10.828318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-165fe727-9d6c-40ca-a6ec-5ced6070dfb0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:10.828774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-165fe727-9d6c-40ca-a6ec-5ced6070dfb0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:10.956394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-165fe727-9d6c-40ca-a6ec-5ced6070dfb0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:10.965272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-165fe727-9d6c-40ca-a6ec-5ced6070dfb0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150099 Aug 24 06:30:10.965785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 739/1472] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:10 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:11.986723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9f18e6e7-53d7-4bfb-9c08-f1b3bafd1dee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:11.987289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9f18e6e7-53d7-4bfb-9c08-f1b3bafd1dee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:11.994060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f18e6e7-53d7-4bfb-9c08-f1b3bafd1dee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:11.994539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f18e6e7-53d7-4bfb-9c08-f1b3bafd1dee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:11.995607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f18e6e7-53d7-4bfb-9c08-f1b3bafd1dee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:11.996307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f18e6e7-53d7-4bfb-9c08-f1b3bafd1dee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:11.996784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f18e6e7-53d7-4bfb-9c08-f1b3bafd1dee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:11.997199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f18e6e7-53d7-4bfb-9c08-f1b3bafd1dee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:12.138021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9f18e6e7-53d7-4bfb-9c08-f1b3bafd1dee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:12.146249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9f18e6e7-53d7-4bfb-9c08-f1b3bafd1dee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.163498 Aug 24 06:30:12.146814 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 734/1473] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:11 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:13.168316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4e8cc4ae-b741-4901-9d63-b8349033a623 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:13.168931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4e8cc4ae-b741-4901-9d63-b8349033a623 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:13.175406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e8cc4ae-b741-4901-9d63-b8349033a623 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:13.175883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e8cc4ae-b741-4901-9d63-b8349033a623 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:13.176310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e8cc4ae-b741-4901-9d63-b8349033a623 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:13.177030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e8cc4ae-b741-4901-9d63-b8349033a623 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:13.177476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e8cc4ae-b741-4901-9d63-b8349033a623 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:13.177894 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e8cc4ae-b741-4901-9d63-b8349033a623 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:13.312343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4e8cc4ae-b741-4901-9d63-b8349033a623 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:13.321161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4e8cc4ae-b741-4901-9d63-b8349033a623 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157252 Aug 24 06:30:13.321728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 740/1474] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:13 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:14.343540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-aaa2fd4f-99b8-43ae-be7f-9dca0bfa81c9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:14.344163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-aaa2fd4f-99b8-43ae-be7f-9dca0bfa81c9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:14.350923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaa2fd4f-99b8-43ae-be7f-9dca0bfa81c9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:14.351407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaa2fd4f-99b8-43ae-be7f-9dca0bfa81c9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:14.351838 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaa2fd4f-99b8-43ae-be7f-9dca0bfa81c9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:14.352554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaa2fd4f-99b8-43ae-be7f-9dca0bfa81c9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:14.353010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaa2fd4f-99b8-43ae-be7f-9dca0bfa81c9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:14.353433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aaa2fd4f-99b8-43ae-be7f-9dca0bfa81c9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:14.484912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-aaa2fd4f-99b8-43ae-be7f-9dca0bfa81c9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:14.493408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-aaa2fd4f-99b8-43ae-be7f-9dca0bfa81c9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154268 Aug 24 06:30:14.493971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 735/1475] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:14 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:15.515815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3c3e0d6d-8ed5-40e0-aebb-73f45be09393 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:15.516430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3c3e0d6d-8ed5-40e0-aebb-73f45be09393 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:15.523064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c3e0d6d-8ed5-40e0-aebb-73f45be09393 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:15.523546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c3e0d6d-8ed5-40e0-aebb-73f45be09393 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:15.523981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c3e0d6d-8ed5-40e0-aebb-73f45be09393 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:15.524711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c3e0d6d-8ed5-40e0-aebb-73f45be09393 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:15.525167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c3e0d6d-8ed5-40e0-aebb-73f45be09393 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:15.525592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c3e0d6d-8ed5-40e0-aebb-73f45be09393 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:15.653674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3c3e0d6d-8ed5-40e0-aebb-73f45be09393 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:15.661856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3c3e0d6d-8ed5-40e0-aebb-73f45be09393 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149909 Aug 24 06:30:15.662424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 741/1476] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:15 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:16.684098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-038b7b8a-ce34-4fa1-b912-55dd6983574f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:16.684832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-038b7b8a-ce34-4fa1-b912-55dd6983574f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:16.691820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-038b7b8a-ce34-4fa1-b912-55dd6983574f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:16.692291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-038b7b8a-ce34-4fa1-b912-55dd6983574f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:16.692750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-038b7b8a-ce34-4fa1-b912-55dd6983574f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:16.693431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-038b7b8a-ce34-4fa1-b912-55dd6983574f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:16.693880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-038b7b8a-ce34-4fa1-b912-55dd6983574f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:16.694292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-038b7b8a-ce34-4fa1-b912-55dd6983574f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:16.825897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-038b7b8a-ce34-4fa1-b912-55dd6983574f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:16.834128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-038b7b8a-ce34-4fa1-b912-55dd6983574f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154766 Aug 24 06:30:16.834687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 736/1477] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:16 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:17.855403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ee7c401e-ce37-418f-ac05-ef41a10425a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:17.855981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ee7c401e-ce37-418f-ac05-ef41a10425a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:17.858094 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=26 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:30:17.862971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee7c401e-ce37-418f-ac05-ef41a10425a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:17.863456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee7c401e-ce37-418f-ac05-ef41a10425a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:17.863898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee7c401e-ce37-418f-ac05-ef41a10425a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:17.864668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee7c401e-ce37-418f-ac05-ef41a10425a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:17.865131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee7c401e-ce37-418f-ac05-ef41a10425a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:17.865556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee7c401e-ce37-418f-ac05-ef41a10425a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:17.999380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ee7c401e-ce37-418f-ac05-ef41a10425a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:18.007440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ee7c401e-ce37-418f-ac05-ef41a10425a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156037 Aug 24 06:30:18.007999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 742/1478] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:17 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:19.029313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-db08d2b8-38e4-4ddd-9f98-ee0b3a06b087 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:19.029952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-db08d2b8-38e4-4ddd-9f98-ee0b3a06b087 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:19.036272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db08d2b8-38e4-4ddd-9f98-ee0b3a06b087 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:19.036782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db08d2b8-38e4-4ddd-9f98-ee0b3a06b087 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:19.037211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db08d2b8-38e4-4ddd-9f98-ee0b3a06b087 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:19.037890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db08d2b8-38e4-4ddd-9f98-ee0b3a06b087 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:19.038333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db08d2b8-38e4-4ddd-9f98-ee0b3a06b087 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:19.038747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db08d2b8-38e4-4ddd-9f98-ee0b3a06b087 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:19.168227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-db08d2b8-38e4-4ddd-9f98-ee0b3a06b087 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:19.177133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-db08d2b8-38e4-4ddd-9f98-ee0b3a06b087 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152190 Aug 24 06:30:19.179193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 737/1479] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:19 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:20.198928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-de27fd2c-d855-4e32-a62e-46a03ac7fad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:20.199516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-de27fd2c-d855-4e32-a62e-46a03ac7fad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:20.206071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de27fd2c-d855-4e32-a62e-46a03ac7fad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:20.206549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de27fd2c-d855-4e32-a62e-46a03ac7fad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:20.206982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de27fd2c-d855-4e32-a62e-46a03ac7fad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:20.207697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de27fd2c-d855-4e32-a62e-46a03ac7fad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:20.208145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de27fd2c-d855-4e32-a62e-46a03ac7fad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:20.208593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de27fd2c-d855-4e32-a62e-46a03ac7fad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:20.212424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=78 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:30:20.340935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-de27fd2c-d855-4e32-a62e-46a03ac7fad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:20.349063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-de27fd2c-d855-4e32-a62e-46a03ac7fad7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154494 Aug 24 06:30:20.349624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 743/1480] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:20 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:21.372430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2f621617-3339-47e6-934e-2845f001e9e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:21.373092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2f621617-3339-47e6-934e-2845f001e9e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:21.379513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f621617-3339-47e6-934e-2845f001e9e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:21.379990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f621617-3339-47e6-934e-2845f001e9e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:21.380410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f621617-3339-47e6-934e-2845f001e9e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:21.381112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f621617-3339-47e6-934e-2845f001e9e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:21.381556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f621617-3339-47e6-934e-2845f001e9e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:21.381970 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f621617-3339-47e6-934e-2845f001e9e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:21.511815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2f621617-3339-47e6-934e-2845f001e9e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:21.520110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2f621617-3339-47e6-934e-2845f001e9e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152474 Aug 24 06:30:21.520702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 738/1481] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:21 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:22.541571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d2b7c990-ca07-4822-8299-0019736967b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:22.542211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d2b7c990-ca07-4822-8299-0019736967b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:22.548622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2b7c990-ca07-4822-8299-0019736967b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:22.549108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2b7c990-ca07-4822-8299-0019736967b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:22.549543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2b7c990-ca07-4822-8299-0019736967b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:22.550243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2b7c990-ca07-4822-8299-0019736967b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:22.550696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2b7c990-ca07-4822-8299-0019736967b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:22.551119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2b7c990-ca07-4822-8299-0019736967b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:22.683297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d2b7c990-ca07-4822-8299-0019736967b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:22.692315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d2b7c990-ca07-4822-8299-0019736967b5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154477 Aug 24 06:30:22.694279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 744/1482] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:22 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:23.714806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9350de2a-47fd-4ae4-98a4-5717de488c66 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:23.715415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9350de2a-47fd-4ae4-98a4-5717de488c66 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:23.722437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9350de2a-47fd-4ae4-98a4-5717de488c66 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:23.722942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9350de2a-47fd-4ae4-98a4-5717de488c66 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:23.723358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9350de2a-47fd-4ae4-98a4-5717de488c66 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:23.724063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9350de2a-47fd-4ae4-98a4-5717de488c66 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:23.724543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9350de2a-47fd-4ae4-98a4-5717de488c66 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:23.724966 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9350de2a-47fd-4ae4-98a4-5717de488c66 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:23.857472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9350de2a-47fd-4ae4-98a4-5717de488c66 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:23.866392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9350de2a-47fd-4ae4-98a4-5717de488c66 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156116 Aug 24 06:30:23.866953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 739/1483] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:23 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:24.893273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cb7b7161-c79d-4bd7-a360-ce29a0131346 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:24.893923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cb7b7161-c79d-4bd7-a360-ce29a0131346 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:24.900378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb7b7161-c79d-4bd7-a360-ce29a0131346 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:24.901545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb7b7161-c79d-4bd7-a360-ce29a0131346 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:24.901983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb7b7161-c79d-4bd7-a360-ce29a0131346 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:24.902696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb7b7161-c79d-4bd7-a360-ce29a0131346 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:24.903153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb7b7161-c79d-4bd7-a360-ce29a0131346 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:24.903577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb7b7161-c79d-4bd7-a360-ce29a0131346 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:25.041084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cb7b7161-c79d-4bd7-a360-ce29a0131346 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:25.049424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cb7b7161-c79d-4bd7-a360-ce29a0131346 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.160031 Aug 24 06:30:25.050086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 745/1484] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:24 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:26.071343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d69adbc0-647e-4f1e-a113-55be920c545f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:26.071956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d69adbc0-647e-4f1e-a113-55be920c545f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:26.079425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d69adbc0-647e-4f1e-a113-55be920c545f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:26.079905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d69adbc0-647e-4f1e-a113-55be920c545f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:26.080410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d69adbc0-647e-4f1e-a113-55be920c545f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:26.081131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d69adbc0-647e-4f1e-a113-55be920c545f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:26.081580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d69adbc0-647e-4f1e-a113-55be920c545f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:26.081997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d69adbc0-647e-4f1e-a113-55be920c545f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:26.216823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d69adbc0-647e-4f1e-a113-55be920c545f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:26.224975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d69adbc0-647e-4f1e-a113-55be920c545f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157493 Aug 24 06:30:26.225540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 740/1485] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:26 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:27.246724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-de703f8a-b75e-4852-a7e1-37b711069e59 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:27.247329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-de703f8a-b75e-4852-a7e1-37b711069e59 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:27.254159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de703f8a-b75e-4852-a7e1-37b711069e59 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:27.254668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de703f8a-b75e-4852-a7e1-37b711069e59 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:27.255117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de703f8a-b75e-4852-a7e1-37b711069e59 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:27.255818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de703f8a-b75e-4852-a7e1-37b711069e59 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:27.256269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de703f8a-b75e-4852-a7e1-37b711069e59 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:27.256756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de703f8a-b75e-4852-a7e1-37b711069e59 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:27.394607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-de703f8a-b75e-4852-a7e1-37b711069e59 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:27.403016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-de703f8a-b75e-4852-a7e1-37b711069e59 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.160451 Aug 24 06:30:27.403586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 746/1486] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:27 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:28.424092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8a7c32f3-d581-4b5f-8ec6-48b448c6c12e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:28.424927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8a7c32f3-d581-4b5f-8ec6-48b448c6c12e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:28.431364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a7c32f3-d581-4b5f-8ec6-48b448c6c12e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:28.431923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a7c32f3-d581-4b5f-8ec6-48b448c6c12e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:28.433137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a7c32f3-d581-4b5f-8ec6-48b448c6c12e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:28.433843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a7c32f3-d581-4b5f-8ec6-48b448c6c12e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:28.434291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a7c32f3-d581-4b5f-8ec6-48b448c6c12e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:28.434708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a7c32f3-d581-4b5f-8ec6-48b448c6c12e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:28.584562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8a7c32f3-d581-4b5f-8ec6-48b448c6c12e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:28.593489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8a7c32f3-d581-4b5f-8ec6-48b448c6c12e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.173176 Aug 24 06:30:28.594077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 741/1487] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:28 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:29.615211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c005ea74-0f06-4c4e-9ec5-8c7d8212192d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:29.615862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c005ea74-0f06-4c4e-9ec5-8c7d8212192d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:29.623089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c005ea74-0f06-4c4e-9ec5-8c7d8212192d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:29.623574 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c005ea74-0f06-4c4e-9ec5-8c7d8212192d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:29.624007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c005ea74-0f06-4c4e-9ec5-8c7d8212192d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:29.624901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c005ea74-0f06-4c4e-9ec5-8c7d8212192d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:29.625348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c005ea74-0f06-4c4e-9ec5-8c7d8212192d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:29.625766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c005ea74-0f06-4c4e-9ec5-8c7d8212192d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:29.760692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c005ea74-0f06-4c4e-9ec5-8c7d8212192d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:29.772112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c005ea74-0f06-4c4e-9ec5-8c7d8212192d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.160714 Aug 24 06:30:29.778394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 747/1488] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:29 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:30.794799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-16aa70d7-c9b4-4ee6-aa3d-b87c852a59f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:30.795485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-16aa70d7-c9b4-4ee6-aa3d-b87c852a59f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:30.802214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16aa70d7-c9b4-4ee6-aa3d-b87c852a59f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:30.802700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16aa70d7-c9b4-4ee6-aa3d-b87c852a59f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:30.803133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16aa70d7-c9b4-4ee6-aa3d-b87c852a59f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:30.803836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16aa70d7-c9b4-4ee6-aa3d-b87c852a59f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:30.804284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16aa70d7-c9b4-4ee6-aa3d-b87c852a59f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:30.804745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16aa70d7-c9b4-4ee6-aa3d-b87c852a59f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:30.956401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-16aa70d7-c9b4-4ee6-aa3d-b87c852a59f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:30.965612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-16aa70d7-c9b4-4ee6-aa3d-b87c852a59f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.174659 Aug 24 06:30:30.966137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 742/1489] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:30 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:31.987981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7e77f6bd-b34f-4129-b082-198185c9c3d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:31.988554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7e77f6bd-b34f-4129-b082-198185c9c3d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:31.995754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e77f6bd-b34f-4129-b082-198185c9c3d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:31.996232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e77f6bd-b34f-4129-b082-198185c9c3d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:31.996697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e77f6bd-b34f-4129-b082-198185c9c3d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:31.997396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e77f6bd-b34f-4129-b082-198185c9c3d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:31.997845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e77f6bd-b34f-4129-b082-198185c9c3d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:31.998264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e77f6bd-b34f-4129-b082-198185c9c3d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:32.143187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7e77f6bd-b34f-4129-b082-198185c9c3d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:32.152156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7e77f6bd-b34f-4129-b082-198185c9c3d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.168548 Aug 24 06:30:32.152754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 748/1490] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:31 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:33.173772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2aeaa582-9aa4-480a-8a1e-0af5285dfd81 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:33.174543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2aeaa582-9aa4-480a-8a1e-0af5285dfd81 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:33.180823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aeaa582-9aa4-480a-8a1e-0af5285dfd81 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:33.181299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aeaa582-9aa4-480a-8a1e-0af5285dfd81 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:33.182238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aeaa582-9aa4-480a-8a1e-0af5285dfd81 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:33.183348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aeaa582-9aa4-480a-8a1e-0af5285dfd81 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:33.183798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aeaa582-9aa4-480a-8a1e-0af5285dfd81 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:33.184209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2aeaa582-9aa4-480a-8a1e-0af5285dfd81 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:33.321465 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2aeaa582-9aa4-480a-8a1e-0af5285dfd81 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:33.333584 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2aeaa582-9aa4-480a-8a1e-0af5285dfd81 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.163717 Aug 24 06:30:33.334162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 743/1491] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:33 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:30:34.354960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-51e10be9-6b2a-400a-937e-11093c93fdc6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:34.355525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-51e10be9-6b2a-400a-937e-11093c93fdc6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:34.362083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51e10be9-6b2a-400a-937e-11093c93fdc6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:34.362563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51e10be9-6b2a-400a-937e-11093c93fdc6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:34.362997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51e10be9-6b2a-400a-937e-11093c93fdc6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:34.363694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51e10be9-6b2a-400a-937e-11093c93fdc6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:34.364143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51e10be9-6b2a-400a-937e-11093c93fdc6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:34.364598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51e10be9-6b2a-400a-937e-11093c93fdc6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:34.500443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-51e10be9-6b2a-400a-937e-11093c93fdc6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:34.511993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-51e10be9-6b2a-400a-937e-11093c93fdc6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158146 Aug 24 06:30:34.511993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 749/1492] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:34 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:35.537265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-90fb30df-f940-4261-b590-179f784bf77e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:35.537951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-90fb30df-f940-4261-b590-179f784bf77e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:35.545245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90fb30df-f940-4261-b590-179f784bf77e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:35.545789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90fb30df-f940-4261-b590-179f784bf77e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:35.546287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90fb30df-f940-4261-b590-179f784bf77e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:35.546998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90fb30df-f940-4261-b590-179f784bf77e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:35.547441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90fb30df-f940-4261-b590-179f784bf77e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:35.547860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90fb30df-f940-4261-b590-179f784bf77e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:35.686995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-90fb30df-f940-4261-b590-179f784bf77e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:35.696084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-90fb30df-f940-4261-b590-179f784bf77e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.162586 Aug 24 06:30:35.696666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 744/1493] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:35 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:36.286123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:30:36.286731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:30:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:30:36.717141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7d5047db-65f6-4e15-b597-e4409fc78d21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:36.717744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7d5047db-65f6-4e15-b597-e4409fc78d21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:36.724153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d5047db-65f6-4e15-b597-e4409fc78d21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:36.724660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d5047db-65f6-4e15-b597-e4409fc78d21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:36.725110 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d5047db-65f6-4e15-b597-e4409fc78d21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:36.725787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d5047db-65f6-4e15-b597-e4409fc78d21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:36.726229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d5047db-65f6-4e15-b597-e4409fc78d21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:36.726643 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7d5047db-65f6-4e15-b597-e4409fc78d21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:36.856859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7d5047db-65f6-4e15-b597-e4409fc78d21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:36.864968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7d5047db-65f6-4e15-b597-e4409fc78d21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151724 Aug 24 06:30:36.865544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 750/1494] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:36 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:37.886748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bb27e085-776b-4570-a9f2-eefa47bebdf2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:37.887341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bb27e085-776b-4570-a9f2-eefa47bebdf2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:37.893791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb27e085-776b-4570-a9f2-eefa47bebdf2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:37.894204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb27e085-776b-4570-a9f2-eefa47bebdf2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:37.894627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb27e085-776b-4570-a9f2-eefa47bebdf2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:37.895302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb27e085-776b-4570-a9f2-eefa47bebdf2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:37.895744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb27e085-776b-4570-a9f2-eefa47bebdf2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:37.896156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb27e085-776b-4570-a9f2-eefa47bebdf2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:38.025948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bb27e085-776b-4570-a9f2-eefa47bebdf2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:38.034046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bb27e085-776b-4570-a9f2-eefa47bebdf2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151263 Aug 24 06:30:38.034603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 745/1495] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:37 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:39.055099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7a9b080a-e7bd-4b9c-87ff-5c44e9cb51da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:39.055698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7a9b080a-e7bd-4b9c-87ff-5c44e9cb51da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:39.062392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a9b080a-e7bd-4b9c-87ff-5c44e9cb51da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:39.062867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a9b080a-e7bd-4b9c-87ff-5c44e9cb51da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:39.063291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a9b080a-e7bd-4b9c-87ff-5c44e9cb51da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:39.064043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a9b080a-e7bd-4b9c-87ff-5c44e9cb51da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:39.064489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a9b080a-e7bd-4b9c-87ff-5c44e9cb51da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:39.064927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7a9b080a-e7bd-4b9c-87ff-5c44e9cb51da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:39.266986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7a9b080a-e7bd-4b9c-87ff-5c44e9cb51da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:39.275299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7a9b080a-e7bd-4b9c-87ff-5c44e9cb51da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.224028 Aug 24 06:30:39.275960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 751/1496] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:39 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:40.296318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8e46d4fd-58f8-451f-9b58-2f2e052c51cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:40.296983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8e46d4fd-58f8-451f-9b58-2f2e052c51cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:40.299277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=26 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:30:40.303953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e46d4fd-58f8-451f-9b58-2f2e052c51cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:40.304440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e46d4fd-58f8-451f-9b58-2f2e052c51cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:40.304909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e46d4fd-58f8-451f-9b58-2f2e052c51cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:40.305614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e46d4fd-58f8-451f-9b58-2f2e052c51cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:40.306059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e46d4fd-58f8-451f-9b58-2f2e052c51cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:40.306574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e46d4fd-58f8-451f-9b58-2f2e052c51cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:40.309577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=78 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:30:40.437318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8e46d4fd-58f8-451f-9b58-2f2e052c51cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:40.445374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8e46d4fd-58f8-451f-9b58-2f2e052c51cc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153030 Aug 24 06:30:40.445927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 746/1497] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:40 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:41.467669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b4584c2c-b5ec-487d-9e72-829a480274a8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:41.468283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b4584c2c-b5ec-487d-9e72-829a480274a8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:41.475032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4584c2c-b5ec-487d-9e72-829a480274a8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:41.475509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4584c2c-b5ec-487d-9e72-829a480274a8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:41.475938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4584c2c-b5ec-487d-9e72-829a480274a8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:41.476673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4584c2c-b5ec-487d-9e72-829a480274a8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:41.477120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4584c2c-b5ec-487d-9e72-829a480274a8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:41.477538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4584c2c-b5ec-487d-9e72-829a480274a8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:41.612032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b4584c2c-b5ec-487d-9e72-829a480274a8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:41.620673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b4584c2c-b5ec-487d-9e72-829a480274a8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156881 Aug 24 06:30:41.621258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 752/1498] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:41 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:42.646533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4309079d-1b85-427b-88a5-081b220262f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:42.646533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4309079d-1b85-427b-88a5-081b220262f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:42.649609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4309079d-1b85-427b-88a5-081b220262f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:42.650151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4309079d-1b85-427b-88a5-081b220262f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:42.650576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4309079d-1b85-427b-88a5-081b220262f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:42.651298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4309079d-1b85-427b-88a5-081b220262f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:42.651781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4309079d-1b85-427b-88a5-081b220262f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:42.652228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4309079d-1b85-427b-88a5-081b220262f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:42.791641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4309079d-1b85-427b-88a5-081b220262f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:42.799830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4309079d-1b85-427b-88a5-081b220262f2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.162763 Aug 24 06:30:42.800386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 747/1499] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:42 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:43.822004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f9ed7d76-23bb-4ecc-b76d-77b61131016c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:43.822571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f9ed7d76-23bb-4ecc-b76d-77b61131016c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:43.829514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f9ed7d76-23bb-4ecc-b76d-77b61131016c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:43.830172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f9ed7d76-23bb-4ecc-b76d-77b61131016c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:43.830598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f9ed7d76-23bb-4ecc-b76d-77b61131016c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:43.831320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f9ed7d76-23bb-4ecc-b76d-77b61131016c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:43.831796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f9ed7d76-23bb-4ecc-b76d-77b61131016c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:43.832207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f9ed7d76-23bb-4ecc-b76d-77b61131016c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:43.964060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f9ed7d76-23bb-4ecc-b76d-77b61131016c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:43.974212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f9ed7d76-23bb-4ecc-b76d-77b61131016c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154501 Aug 24 06:30:43.974832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 753/1500] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:43 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:44.995993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-38c0053f-a713-4e5f-8cfb-f360a84747e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:44.996697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-38c0053f-a713-4e5f-8cfb-f360a84747e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:45.003493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38c0053f-a713-4e5f-8cfb-f360a84747e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:45.003998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38c0053f-a713-4e5f-8cfb-f360a84747e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:45.004421 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38c0053f-a713-4e5f-8cfb-f360a84747e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:45.005212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38c0053f-a713-4e5f-8cfb-f360a84747e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:45.005654 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38c0053f-a713-4e5f-8cfb-f360a84747e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:45.006068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38c0053f-a713-4e5f-8cfb-f360a84747e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:45.158853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-38c0053f-a713-4e5f-8cfb-f360a84747e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:45.170261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-38c0053f-a713-4e5f-8cfb-f360a84747e9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.178858 Aug 24 06:30:45.172705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 748/1501] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:44 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:46.192251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-91468dfa-30c8-4001-b786-89368248682a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:46.192945 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-91468dfa-30c8-4001-b786-89368248682a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:46.204471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91468dfa-30c8-4001-b786-89368248682a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:46.205214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91468dfa-30c8-4001-b786-89368248682a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:46.205652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91468dfa-30c8-4001-b786-89368248682a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:46.206212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91468dfa-30c8-4001-b786-89368248682a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:46.206662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91468dfa-30c8-4001-b786-89368248682a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:46.207087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91468dfa-30c8-4001-b786-89368248682a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:46.348207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-91468dfa-30c8-4001-b786-89368248682a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:46.356924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-91468dfa-30c8-4001-b786-89368248682a tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.168381 Aug 24 06:30:46.357464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 754/1502] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:46 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:47.378471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-50868bf6-5fdf-430e-bccc-bb8e024c6388 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:47.379192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-50868bf6-5fdf-430e-bccc-bb8e024c6388 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:47.386153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-50868bf6-5fdf-430e-bccc-bb8e024c6388 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:47.386940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-50868bf6-5fdf-430e-bccc-bb8e024c6388 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:47.387520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-50868bf6-5fdf-430e-bccc-bb8e024c6388 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:47.388202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-50868bf6-5fdf-430e-bccc-bb8e024c6388 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:47.388691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-50868bf6-5fdf-430e-bccc-bb8e024c6388 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:47.389119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-50868bf6-5fdf-430e-bccc-bb8e024c6388 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:47.531153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-50868bf6-5fdf-430e-bccc-bb8e024c6388 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:47.539845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-50868bf6-5fdf-430e-bccc-bb8e024c6388 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.165243 Aug 24 06:30:47.541068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 749/1503] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:47 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:48.562584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fc1ffcd3-fa44-4fe9-a0d3-5ba2de993fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:48.563160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fc1ffcd3-fa44-4fe9-a0d3-5ba2de993fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:48.565089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=26 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:30:48.570026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc1ffcd3-fa44-4fe9-a0d3-5ba2de993fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:48.570511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc1ffcd3-fa44-4fe9-a0d3-5ba2de993fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:48.570939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc1ffcd3-fa44-4fe9-a0d3-5ba2de993fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:48.572156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc1ffcd3-fa44-4fe9-a0d3-5ba2de993fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:48.572658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc1ffcd3-fa44-4fe9-a0d3-5ba2de993fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:48.573080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fc1ffcd3-fa44-4fe9-a0d3-5ba2de993fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:48.710056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fc1ffcd3-fa44-4fe9-a0d3-5ba2de993fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:48.720991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fc1ffcd3-fa44-4fe9-a0d3-5ba2de993fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.162596 Aug 24 06:30:48.721866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 755/1504] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:48 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:30:49.744433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-68bc13a4-f4c0-4451-ac6e-74d998d8be56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:49.745090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-68bc13a4-f4c0-4451-ac6e-74d998d8be56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:49.752032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68bc13a4-f4c0-4451-ac6e-74d998d8be56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:49.752542 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68bc13a4-f4c0-4451-ac6e-74d998d8be56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:49.753010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68bc13a4-f4c0-4451-ac6e-74d998d8be56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:49.753745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68bc13a4-f4c0-4451-ac6e-74d998d8be56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:49.754132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68bc13a4-f4c0-4451-ac6e-74d998d8be56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:49.755101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68bc13a4-f4c0-4451-ac6e-74d998d8be56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:49.900322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-68bc13a4-f4c0-4451-ac6e-74d998d8be56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:49.915749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-68bc13a4-f4c0-4451-ac6e-74d998d8be56 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.176302 Aug 24 06:30:49.917319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 750/1505] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:49 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:50.938416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-dc882135-0b3f-42e4-9db9-6ca08581acfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:50.939022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-dc882135-0b3f-42e4-9db9-6ca08581acfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:50.945809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc882135-0b3f-42e4-9db9-6ca08581acfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:50.946293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc882135-0b3f-42e4-9db9-6ca08581acfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:50.947219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc882135-0b3f-42e4-9db9-6ca08581acfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:50.947912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc882135-0b3f-42e4-9db9-6ca08581acfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:50.948364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc882135-0b3f-42e4-9db9-6ca08581acfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:50.948812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc882135-0b3f-42e4-9db9-6ca08581acfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:50.951466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=78 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:30:51.082240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-dc882135-0b3f-42e4-9db9-6ca08581acfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:51.091225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-dc882135-0b3f-42e4-9db9-6ca08581acfb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156689 Aug 24 06:30:51.091796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 756/1506] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:50 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:52.113313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-933e2a92-8ae2-4ce9-8d8f-1a5eddadb87b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:52.113926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-933e2a92-8ae2-4ce9-8d8f-1a5eddadb87b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:52.120437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-933e2a92-8ae2-4ce9-8d8f-1a5eddadb87b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:52.120949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-933e2a92-8ae2-4ce9-8d8f-1a5eddadb87b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:52.121377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-933e2a92-8ae2-4ce9-8d8f-1a5eddadb87b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:52.122060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-933e2a92-8ae2-4ce9-8d8f-1a5eddadb87b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:52.122509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-933e2a92-8ae2-4ce9-8d8f-1a5eddadb87b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:52.122948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-933e2a92-8ae2-4ce9-8d8f-1a5eddadb87b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:52.256654 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-933e2a92-8ae2-4ce9-8d8f-1a5eddadb87b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:52.265546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-933e2a92-8ae2-4ce9-8d8f-1a5eddadb87b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156069 Aug 24 06:30:52.266124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 751/1507] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:52 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:53.286821 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-859f0142-2703-43e1-8c02-d4180bf67c21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:53.287428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-859f0142-2703-43e1-8c02-d4180bf67c21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:53.295091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-859f0142-2703-43e1-8c02-d4180bf67c21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:53.295581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-859f0142-2703-43e1-8c02-d4180bf67c21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:53.296059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-859f0142-2703-43e1-8c02-d4180bf67c21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:53.296977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-859f0142-2703-43e1-8c02-d4180bf67c21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:53.297525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-859f0142-2703-43e1-8c02-d4180bf67c21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:53.297993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-859f0142-2703-43e1-8c02-d4180bf67c21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:53.437098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-859f0142-2703-43e1-8c02-d4180bf67c21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:53.446177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-859f0142-2703-43e1-8c02-d4180bf67c21 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.163266 Aug 24 06:30:53.447587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 757/1508] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:53 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:54.469060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6f06d09a-7c1a-4888-9d45-ce41aefb1528 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:54.469699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6f06d09a-7c1a-4888-9d45-ce41aefb1528 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:54.476292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f06d09a-7c1a-4888-9d45-ce41aefb1528 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:54.476802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f06d09a-7c1a-4888-9d45-ce41aefb1528 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:54.477230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f06d09a-7c1a-4888-9d45-ce41aefb1528 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:54.477940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f06d09a-7c1a-4888-9d45-ce41aefb1528 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:54.478387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f06d09a-7c1a-4888-9d45-ce41aefb1528 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:54.478805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f06d09a-7c1a-4888-9d45-ce41aefb1528 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:54.611951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6f06d09a-7c1a-4888-9d45-ce41aefb1528 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:54.620757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6f06d09a-7c1a-4888-9d45-ce41aefb1528 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155472 Aug 24 06:30:54.621329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 752/1509] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:54 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:55.642329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8ba70ce8-dad0-4319-a028-480092a2ece2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:55.642911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8ba70ce8-dad0-4319-a028-480092a2ece2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:55.650545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8ba70ce8-dad0-4319-a028-480092a2ece2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:55.651038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8ba70ce8-dad0-4319-a028-480092a2ece2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:55.651477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8ba70ce8-dad0-4319-a028-480092a2ece2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:55.652180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8ba70ce8-dad0-4319-a028-480092a2ece2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:55.652668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8ba70ce8-dad0-4319-a028-480092a2ece2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:55.653096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8ba70ce8-dad0-4319-a028-480092a2ece2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:55.802180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8ba70ce8-dad0-4319-a028-480092a2ece2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:55.806974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8ba70ce8-dad0-4319-a028-480092a2ece2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.168634 Aug 24 06:30:55.807596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 758/1510] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:55 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:56.828074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6e1cc457-7751-4853-8fce-a5e2e5dba0d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:56.828749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6e1cc457-7751-4853-8fce-a5e2e5dba0d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:56.835465 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e1cc457-7751-4853-8fce-a5e2e5dba0d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:56.835943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e1cc457-7751-4853-8fce-a5e2e5dba0d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:56.836367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e1cc457-7751-4853-8fce-a5e2e5dba0d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:56.837685 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e1cc457-7751-4853-8fce-a5e2e5dba0d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:56.838140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e1cc457-7751-4853-8fce-a5e2e5dba0d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:56.838554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6e1cc457-7751-4853-8fce-a5e2e5dba0d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:56.962300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6e1cc457-7751-4853-8fce-a5e2e5dba0d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:56.970859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6e1cc457-7751-4853-8fce-a5e2e5dba0d5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.146587 Aug 24 06:30:56.971417 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 753/1511] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:56 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:57.991963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f32ba1e2-ad48-4b17-84e6-48a2aa454ee5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:57.992736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f32ba1e2-ad48-4b17-84e6-48a2aa454ee5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:57.999948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32ba1e2-ad48-4b17-84e6-48a2aa454ee5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:58.000485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32ba1e2-ad48-4b17-84e6-48a2aa454ee5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:58.001031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32ba1e2-ad48-4b17-84e6-48a2aa454ee5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:58.001782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32ba1e2-ad48-4b17-84e6-48a2aa454ee5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:58.002280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32ba1e2-ad48-4b17-84e6-48a2aa454ee5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:58.002743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32ba1e2-ad48-4b17-84e6-48a2aa454ee5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:58.133530 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f32ba1e2-ad48-4b17-84e6-48a2aa454ee5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:58.141599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f32ba1e2-ad48-4b17-84e6-48a2aa454ee5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153661 Aug 24 06:30:58.142168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 759/1512] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:57 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:30:59.162682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-28819926-d03a-4a50-ae62-a46d293d3fc8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:30:59.163279 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-28819926-d03a-4a50-ae62-a46d293d3fc8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:30:59.169720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28819926-d03a-4a50-ae62-a46d293d3fc8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:59.170189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28819926-d03a-4a50-ae62-a46d293d3fc8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:59.170611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28819926-d03a-4a50-ae62-a46d293d3fc8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:59.171290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28819926-d03a-4a50-ae62-a46d293d3fc8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:30:59.171733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28819926-d03a-4a50-ae62-a46d293d3fc8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:30:59.172174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28819926-d03a-4a50-ae62-a46d293d3fc8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:30:59.302000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-28819926-d03a-4a50-ae62-a46d293d3fc8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:30:59.310384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-28819926-d03a-4a50-ae62-a46d293d3fc8 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151556 Aug 24 06:30:59.310940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 754/1513] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:30:59 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:00.332408 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-eab74bae-4ae1-41d9-9269-39dd77ab87a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:00.333041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-eab74bae-4ae1-41d9-9269-39dd77ab87a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:00.340080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab74bae-4ae1-41d9-9269-39dd77ab87a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:00.340617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab74bae-4ae1-41d9-9269-39dd77ab87a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:00.341088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab74bae-4ae1-41d9-9269-39dd77ab87a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:00.341777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab74bae-4ae1-41d9-9269-39dd77ab87a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:00.342247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab74bae-4ae1-41d9-9269-39dd77ab87a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:00.342669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eab74bae-4ae1-41d9-9269-39dd77ab87a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:00.473834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-eab74bae-4ae1-41d9-9269-39dd77ab87a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:00.483023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-eab74bae-4ae1-41d9-9269-39dd77ab87a3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154185 Aug 24 06:31:00.483570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 760/1514] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:00 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:01.505161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7e19651e-5026-4a10-83b8-64d8ac5916fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:01.505771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7e19651e-5026-4a10-83b8-64d8ac5916fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:01.512448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e19651e-5026-4a10-83b8-64d8ac5916fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:01.512964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e19651e-5026-4a10-83b8-64d8ac5916fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:01.513388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e19651e-5026-4a10-83b8-64d8ac5916fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:01.514076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e19651e-5026-4a10-83b8-64d8ac5916fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:01.514520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e19651e-5026-4a10-83b8-64d8ac5916fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:01.514934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e19651e-5026-4a10-83b8-64d8ac5916fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:01.648271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7e19651e-5026-4a10-83b8-64d8ac5916fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:01.656604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7e19651e-5026-4a10-83b8-64d8ac5916fd tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155250 Aug 24 06:31:01.657182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 755/1515] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:01 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:02.678089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e531f8df-7ad8-4883-a201-75c43ec08362 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:02.678696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e531f8df-7ad8-4883-a201-75c43ec08362 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:02.686454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e531f8df-7ad8-4883-a201-75c43ec08362 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:02.686949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e531f8df-7ad8-4883-a201-75c43ec08362 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:02.687405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e531f8df-7ad8-4883-a201-75c43ec08362 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:02.688155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e531f8df-7ad8-4883-a201-75c43ec08362 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:02.688700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e531f8df-7ad8-4883-a201-75c43ec08362 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:02.689072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e531f8df-7ad8-4883-a201-75c43ec08362 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:02.825949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e531f8df-7ad8-4883-a201-75c43ec08362 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:02.834326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e531f8df-7ad8-4883-a201-75c43ec08362 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.160054 Aug 24 06:31:02.834900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 761/1516] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:02 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:03.855258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-124adaea-c5c7-4746-94bd-1de681fa2a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:03.855870 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-124adaea-c5c7-4746-94bd-1de681fa2a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:03.862182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-124adaea-c5c7-4746-94bd-1de681fa2a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:03.862659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-124adaea-c5c7-4746-94bd-1de681fa2a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:03.863092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-124adaea-c5c7-4746-94bd-1de681fa2a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:03.863779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-124adaea-c5c7-4746-94bd-1de681fa2a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:03.864227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-124adaea-c5c7-4746-94bd-1de681fa2a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:03.864765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-124adaea-c5c7-4746-94bd-1de681fa2a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:03.998670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-124adaea-c5c7-4746-94bd-1de681fa2a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:04.006999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-124adaea-c5c7-4746-94bd-1de681fa2a13 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155607 Aug 24 06:31:04.007556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 756/1517] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:03 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:31:05.028547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a0842dc5-b1ca-4ea4-a640-abe19c8a4615 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:05.029103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a0842dc5-b1ca-4ea4-a640-abe19c8a4615 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:05.035580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0842dc5-b1ca-4ea4-a640-abe19c8a4615 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:05.036060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0842dc5-b1ca-4ea4-a640-abe19c8a4615 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:05.036516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0842dc5-b1ca-4ea4-a640-abe19c8a4615 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:05.037205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0842dc5-b1ca-4ea4-a640-abe19c8a4615 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:05.037654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0842dc5-b1ca-4ea4-a640-abe19c8a4615 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:05.038075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a0842dc5-b1ca-4ea4-a640-abe19c8a4615 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:05.170716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a0842dc5-b1ca-4ea4-a640-abe19c8a4615 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:05.178792 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a0842dc5-b1ca-4ea4-a640-abe19c8a4615 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154660 Aug 24 06:31:05.179364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 762/1518] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:05 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:31:06.200287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a362cfc0-f933-4d71-b050-0feaff0b6c42 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:06.200949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a362cfc0-f933-4d71-b050-0feaff0b6c42 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:06.207414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a362cfc0-f933-4d71-b050-0feaff0b6c42 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:06.207891 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a362cfc0-f933-4d71-b050-0feaff0b6c42 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:06.208323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a362cfc0-f933-4d71-b050-0feaff0b6c42 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:06.209087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a362cfc0-f933-4d71-b050-0feaff0b6c42 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:06.209488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a362cfc0-f933-4d71-b050-0feaff0b6c42 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:06.209908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a362cfc0-f933-4d71-b050-0feaff0b6c42 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:06.342722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a362cfc0-f933-4d71-b050-0feaff0b6c42 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:06.351047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a362cfc0-f933-4d71-b050-0feaff0b6c42 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154791 Aug 24 06:31:06.351605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 757/1519] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:06 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:07.372419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2188c9b1-37c4-4dea-9a13-ac16ef0ec9c4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:07.373044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2188c9b1-37c4-4dea-9a13-ac16ef0ec9c4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:07.379271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2188c9b1-37c4-4dea-9a13-ac16ef0ec9c4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:07.379757 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2188c9b1-37c4-4dea-9a13-ac16ef0ec9c4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:07.380191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2188c9b1-37c4-4dea-9a13-ac16ef0ec9c4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:07.380921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2188c9b1-37c4-4dea-9a13-ac16ef0ec9c4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:07.381375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2188c9b1-37c4-4dea-9a13-ac16ef0ec9c4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:07.381800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2188c9b1-37c4-4dea-9a13-ac16ef0ec9c4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:07.510977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2188c9b1-37c4-4dea-9a13-ac16ef0ec9c4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:07.519335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2188c9b1-37c4-4dea-9a13-ac16ef0ec9c4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150739 Aug 24 06:31:07.519901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 763/1520] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:07 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:08.540397 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ed1f835c-5eeb-489c-badc-1e1eaaf54968 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:08.541165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ed1f835c-5eeb-489c-badc-1e1eaaf54968 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:08.547868 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed1f835c-5eeb-489c-badc-1e1eaaf54968 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:08.548357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed1f835c-5eeb-489c-badc-1e1eaaf54968 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:08.548813 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed1f835c-5eeb-489c-badc-1e1eaaf54968 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:08.549597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed1f835c-5eeb-489c-badc-1e1eaaf54968 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:08.550045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed1f835c-5eeb-489c-badc-1e1eaaf54968 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:08.550472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed1f835c-5eeb-489c-badc-1e1eaaf54968 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:08.683700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ed1f835c-5eeb-489c-badc-1e1eaaf54968 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:08.692207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ed1f835c-5eeb-489c-badc-1e1eaaf54968 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155685 Aug 24 06:31:08.692812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 758/1521] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:08 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:09.714710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1cabbd6f-714c-43df-a006-a528c78acb03 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:09.715332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1cabbd6f-714c-43df-a006-a528c78acb03 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:09.721988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cabbd6f-714c-43df-a006-a528c78acb03 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:09.722467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cabbd6f-714c-43df-a006-a528c78acb03 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:09.722918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cabbd6f-714c-43df-a006-a528c78acb03 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:09.723595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cabbd6f-714c-43df-a006-a528c78acb03 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:09.724039 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cabbd6f-714c-43df-a006-a528c78acb03 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:09.724462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1cabbd6f-714c-43df-a006-a528c78acb03 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:09.857262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1cabbd6f-714c-43df-a006-a528c78acb03 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:09.865848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1cabbd6f-714c-43df-a006-a528c78acb03 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155073 Aug 24 06:31:09.866428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 764/1522] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:09 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:10.887680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-59e600f0-ac3e-488c-99c3-dd104910b8b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:10.888288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-59e600f0-ac3e-488c-99c3-dd104910b8b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:10.890679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=26 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:31:10.895322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59e600f0-ac3e-488c-99c3-dd104910b8b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:10.895796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59e600f0-ac3e-488c-99c3-dd104910b8b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:10.896222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59e600f0-ac3e-488c-99c3-dd104910b8b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:10.896936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59e600f0-ac3e-488c-99c3-dd104910b8b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:10.897381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59e600f0-ac3e-488c-99c3-dd104910b8b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:10.903677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59e600f0-ac3e-488c-99c3-dd104910b8b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:10.903677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=78 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:31:11.026416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-59e600f0-ac3e-488c-99c3-dd104910b8b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:11.034515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-59e600f0-ac3e-488c-99c3-dd104910b8b9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151287 Aug 24 06:31:11.035067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 759/1523] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:10 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:12.055203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-482ae65f-b589-485f-9d0b-051599761f22 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:12.056444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-482ae65f-b589-485f-9d0b-051599761f22 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:12.063209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-482ae65f-b589-485f-9d0b-051599761f22 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:12.063685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-482ae65f-b589-485f-9d0b-051599761f22 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:12.064113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-482ae65f-b589-485f-9d0b-051599761f22 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:12.064838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-482ae65f-b589-485f-9d0b-051599761f22 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:12.065283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-482ae65f-b589-485f-9d0b-051599761f22 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:12.065708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-482ae65f-b589-485f-9d0b-051599761f22 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:12.198731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-482ae65f-b589-485f-9d0b-051599761f22 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:12.206860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-482ae65f-b589-485f-9d0b-051599761f22 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155557 Aug 24 06:31:12.207419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 765/1524] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:12 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:13.228805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e7327794-75d5-443f-81ee-e1cc28fb7d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:13.229265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e7327794-75d5-443f-81ee-e1cc28fb7d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:13.235842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7327794-75d5-443f-81ee-e1cc28fb7d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:13.236316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7327794-75d5-443f-81ee-e1cc28fb7d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:13.236768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7327794-75d5-443f-81ee-e1cc28fb7d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:13.237470 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7327794-75d5-443f-81ee-e1cc28fb7d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:13.237899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7327794-75d5-443f-81ee-e1cc28fb7d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:13.238310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e7327794-75d5-443f-81ee-e1cc28fb7d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:13.380849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e7327794-75d5-443f-81ee-e1cc28fb7d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:13.381800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e7327794-75d5-443f-81ee-e1cc28fb7d96 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157564 Aug 24 06:31:13.382362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 760/1525] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:13 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:14.403893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bb5da5c4-e3fb-4624-925f-c9d3434f7929 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:14.404627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bb5da5c4-e3fb-4624-925f-c9d3434f7929 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:14.411477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb5da5c4-e3fb-4624-925f-c9d3434f7929 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:14.411970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb5da5c4-e3fb-4624-925f-c9d3434f7929 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:14.412405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb5da5c4-e3fb-4624-925f-c9d3434f7929 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:14.413132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb5da5c4-e3fb-4624-925f-c9d3434f7929 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:14.413584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb5da5c4-e3fb-4624-925f-c9d3434f7929 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:14.414004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb5da5c4-e3fb-4624-925f-c9d3434f7929 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:14.543694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bb5da5c4-e3fb-4624-925f-c9d3434f7929 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:14.552135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bb5da5c4-e3fb-4624-925f-c9d3434f7929 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152123 Aug 24 06:31:14.552728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 766/1526] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:14 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:15.574726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-58586f6d-6f73-4033-a1a5-7b057d2fafdb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:15.575268 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-58586f6d-6f73-4033-a1a5-7b057d2fafdb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:15.581742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58586f6d-6f73-4033-a1a5-7b057d2fafdb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:15.582254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58586f6d-6f73-4033-a1a5-7b057d2fafdb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:15.582691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58586f6d-6f73-4033-a1a5-7b057d2fafdb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:15.583381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58586f6d-6f73-4033-a1a5-7b057d2fafdb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:15.583835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58586f6d-6f73-4033-a1a5-7b057d2fafdb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:15.584261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58586f6d-6f73-4033-a1a5-7b057d2fafdb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:15.713655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-58586f6d-6f73-4033-a1a5-7b057d2fafdb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:15.722140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-58586f6d-6f73-4033-a1a5-7b057d2fafdb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151795 Aug 24 06:31:15.722608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 761/1527] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:15 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:16.743837 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5cb6cefa-b9d2-41aa-a746-e39eb0325126 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:16.747719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5cb6cefa-b9d2-41aa-a746-e39eb0325126 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:16.750883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cb6cefa-b9d2-41aa-a746-e39eb0325126 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:16.751369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cb6cefa-b9d2-41aa-a746-e39eb0325126 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:16.751804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cb6cefa-b9d2-41aa-a746-e39eb0325126 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:16.752519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cb6cefa-b9d2-41aa-a746-e39eb0325126 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:16.753000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cb6cefa-b9d2-41aa-a746-e39eb0325126 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:16.753425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cb6cefa-b9d2-41aa-a746-e39eb0325126 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:16.893507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5cb6cefa-b9d2-41aa-a746-e39eb0325126 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:16.901826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5cb6cefa-b9d2-41aa-a746-e39eb0325126 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.162562 Aug 24 06:31:16.902392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 767/1528] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:16 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:17.923435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0d84e19b-ab89-4cf8-9a6b-7bf659946a2c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:17.924123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0d84e19b-ab89-4cf8-9a6b-7bf659946a2c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:17.930625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d84e19b-ab89-4cf8-9a6b-7bf659946a2c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:17.931094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d84e19b-ab89-4cf8-9a6b-7bf659946a2c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:17.931522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d84e19b-ab89-4cf8-9a6b-7bf659946a2c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:17.932206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d84e19b-ab89-4cf8-9a6b-7bf659946a2c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:17.932678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d84e19b-ab89-4cf8-9a6b-7bf659946a2c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:17.933345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d84e19b-ab89-4cf8-9a6b-7bf659946a2c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:18.062781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0d84e19b-ab89-4cf8-9a6b-7bf659946a2c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:18.071494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0d84e19b-ab89-4cf8-9a6b-7bf659946a2c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152060 Aug 24 06:31:18.072056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 762/1529] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:17 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:19.093710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-96c5417d-0167-4441-a22a-2ca0ac547d97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:19.094329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-96c5417d-0167-4441-a22a-2ca0ac547d97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:19.096213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=26 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:31:19.101024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96c5417d-0167-4441-a22a-2ca0ac547d97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:19.101489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96c5417d-0167-4441-a22a-2ca0ac547d97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:19.101923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96c5417d-0167-4441-a22a-2ca0ac547d97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:19.102677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96c5417d-0167-4441-a22a-2ca0ac547d97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:19.103070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96c5417d-0167-4441-a22a-2ca0ac547d97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:19.103491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-96c5417d-0167-4441-a22a-2ca0ac547d97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:19.232146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-96c5417d-0167-4441-a22a-2ca0ac547d97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:19.240329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-96c5417d-0167-4441-a22a-2ca0ac547d97 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151250 Aug 24 06:31:19.240934 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 768/1530] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:19 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:20.261694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-868a01ab-d2b0-486a-bc7a-af700b9bdc60 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:20.262260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-868a01ab-d2b0-486a-bc7a-af700b9bdc60 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:20.268784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-868a01ab-d2b0-486a-bc7a-af700b9bdc60 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:20.269260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-868a01ab-d2b0-486a-bc7a-af700b9bdc60 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:20.269686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-868a01ab-d2b0-486a-bc7a-af700b9bdc60 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:20.270372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-868a01ab-d2b0-486a-bc7a-af700b9bdc60 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:20.270819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-868a01ab-d2b0-486a-bc7a-af700b9bdc60 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:20.271232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-868a01ab-d2b0-486a-bc7a-af700b9bdc60 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:20.401450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-868a01ab-d2b0-486a-bc7a-af700b9bdc60 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:20.409546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-868a01ab-d2b0-486a-bc7a-af700b9bdc60 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152329 Aug 24 06:31:20.410105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 763/1531] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:20 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:21.431158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4cdee560-2f36-49f1-a1b6-4a4afdcb9948 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:21.431877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4cdee560-2f36-49f1-a1b6-4a4afdcb9948 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:21.438492 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdee560-2f36-49f1-a1b6-4a4afdcb9948 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:21.438966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdee560-2f36-49f1-a1b6-4a4afdcb9948 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:21.439395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdee560-2f36-49f1-a1b6-4a4afdcb9948 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:21.441259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdee560-2f36-49f1-a1b6-4a4afdcb9948 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:21.441259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdee560-2f36-49f1-a1b6-4a4afdcb9948 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:21.441259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cdee560-2f36-49f1-a1b6-4a4afdcb9948 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:21.444781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=78 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:31:21.572018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4cdee560-2f36-49f1-a1b6-4a4afdcb9948 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:21.580150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4cdee560-2f36-49f1-a1b6-4a4afdcb9948 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153448 Aug 24 06:31:21.580740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 769/1532] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:21 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:22.602364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ca2f6568-ac24-4a6a-861c-194cf96afc46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:22.602996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ca2f6568-ac24-4a6a-861c-194cf96afc46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:22.609687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca2f6568-ac24-4a6a-861c-194cf96afc46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:22.610162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca2f6568-ac24-4a6a-861c-194cf96afc46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:22.610593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca2f6568-ac24-4a6a-861c-194cf96afc46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:22.611272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca2f6568-ac24-4a6a-861c-194cf96afc46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:22.611713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca2f6568-ac24-4a6a-861c-194cf96afc46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:22.612124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca2f6568-ac24-4a6a-861c-194cf96afc46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:22.753002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ca2f6568-ac24-4a6a-861c-194cf96afc46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:22.761924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ca2f6568-ac24-4a6a-861c-194cf96afc46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.163927 Aug 24 06:31:22.762486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 764/1533] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:22 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:23.783123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c65022a7-15aa-456d-9bc9-8a07446d7fbb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:23.783761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c65022a7-15aa-456d-9bc9-8a07446d7fbb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:23.790474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c65022a7-15aa-456d-9bc9-8a07446d7fbb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:23.790953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c65022a7-15aa-456d-9bc9-8a07446d7fbb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:23.791383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c65022a7-15aa-456d-9bc9-8a07446d7fbb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:23.792078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c65022a7-15aa-456d-9bc9-8a07446d7fbb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:23.792550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c65022a7-15aa-456d-9bc9-8a07446d7fbb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:23.792970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c65022a7-15aa-456d-9bc9-8a07446d7fbb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:23.922328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c65022a7-15aa-456d-9bc9-8a07446d7fbb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:23.931159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c65022a7-15aa-456d-9bc9-8a07446d7fbb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151933 Aug 24 06:31:23.931727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 770/1534] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:23 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:24.952630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b26b4d25-75f0-474d-817d-d183f656ff69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:25.041198 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b26b4d25-75f0-474d-817d-d183f656ff69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:25.041198 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26b4d25-75f0-474d-817d-d183f656ff69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:25.041198 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26b4d25-75f0-474d-817d-d183f656ff69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:25.041198 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26b4d25-75f0-474d-817d-d183f656ff69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:25.041608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26b4d25-75f0-474d-817d-d183f656ff69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:25.041608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26b4d25-75f0-474d-817d-d183f656ff69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:25.041608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b26b4d25-75f0-474d-817d-d183f656ff69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:25.090097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b26b4d25-75f0-474d-817d-d183f656ff69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:25.098217 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b26b4d25-75f0-474d-817d-d183f656ff69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149590 Aug 24 06:31:25.098781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 765/1535] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:24 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:26.119971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8b702ed6-6709-46b8-b670-2e589c177d54 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:26.120613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8b702ed6-6709-46b8-b670-2e589c177d54 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:26.127301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b702ed6-6709-46b8-b670-2e589c177d54 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:26.127782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b702ed6-6709-46b8-b670-2e589c177d54 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:26.128213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b702ed6-6709-46b8-b670-2e589c177d54 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:26.128927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b702ed6-6709-46b8-b670-2e589c177d54 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:26.129376 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b702ed6-6709-46b8-b670-2e589c177d54 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:26.129802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b702ed6-6709-46b8-b670-2e589c177d54 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:26.261149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8b702ed6-6709-46b8-b670-2e589c177d54 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:26.269287 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8b702ed6-6709-46b8-b670-2e589c177d54 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153604 Aug 24 06:31:26.269786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 771/1536] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:26 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:27.290273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4322e214-0b99-4d46-90ca-a221899c0c72 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:27.290881 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4322e214-0b99-4d46-90ca-a221899c0c72 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:27.297363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4322e214-0b99-4d46-90ca-a221899c0c72 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:27.298946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4322e214-0b99-4d46-90ca-a221899c0c72 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:27.298946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4322e214-0b99-4d46-90ca-a221899c0c72 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:27.298946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4322e214-0b99-4d46-90ca-a221899c0c72 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:27.299380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4322e214-0b99-4d46-90ca-a221899c0c72 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:27.299758 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4322e214-0b99-4d46-90ca-a221899c0c72 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:27.648873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4322e214-0b99-4d46-90ca-a221899c0c72 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:27.656991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4322e214-0b99-4d46-90ca-a221899c0c72 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.370676 Aug 24 06:31:27.657554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 766/1537] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:27 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:28.679027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d2eb8ffa-43ae-4fe5-b568-57134cc886e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:28.680225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d2eb8ffa-43ae-4fe5-b568-57134cc886e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:28.687154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2eb8ffa-43ae-4fe5-b568-57134cc886e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:28.687643 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2eb8ffa-43ae-4fe5-b568-57134cc886e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:28.688084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2eb8ffa-43ae-4fe5-b568-57134cc886e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:28.688822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2eb8ffa-43ae-4fe5-b568-57134cc886e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:28.689278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2eb8ffa-43ae-4fe5-b568-57134cc886e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:28.689700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2eb8ffa-43ae-4fe5-b568-57134cc886e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:28.817280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d2eb8ffa-43ae-4fe5-b568-57134cc886e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:28.825930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d2eb8ffa-43ae-4fe5-b568-57134cc886e5 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150849 Aug 24 06:31:28.826510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 772/1538] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:28 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:29.848987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ab28bad7-14f9-4cc1-8512-283f2c45b4ca tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:29.849540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ab28bad7-14f9-4cc1-8512-283f2c45b4ca tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:29.855873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab28bad7-14f9-4cc1-8512-283f2c45b4ca tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:29.856344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab28bad7-14f9-4cc1-8512-283f2c45b4ca tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:29.856818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab28bad7-14f9-4cc1-8512-283f2c45b4ca tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:29.857505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab28bad7-14f9-4cc1-8512-283f2c45b4ca tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:29.857953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab28bad7-14f9-4cc1-8512-283f2c45b4ca tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:29.858373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab28bad7-14f9-4cc1-8512-283f2c45b4ca tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:29.985973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ab28bad7-14f9-4cc1-8512-283f2c45b4ca tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:29.994722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ab28bad7-14f9-4cc1-8512-283f2c45b4ca tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149696 Aug 24 06:31:29.995299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 767/1539] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:29 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:31.015878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e3cc2099-fd55-49d2-8f1b-cad3bab72a7c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:31.016484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e3cc2099-fd55-49d2-8f1b-cad3bab72a7c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:31.023771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3cc2099-fd55-49d2-8f1b-cad3bab72a7c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:31.024253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3cc2099-fd55-49d2-8f1b-cad3bab72a7c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:31.024732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3cc2099-fd55-49d2-8f1b-cad3bab72a7c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:31.025426 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3cc2099-fd55-49d2-8f1b-cad3bab72a7c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:31.025879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3cc2099-fd55-49d2-8f1b-cad3bab72a7c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:31.026297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3cc2099-fd55-49d2-8f1b-cad3bab72a7c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:31.155913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e3cc2099-fd55-49d2-8f1b-cad3bab72a7c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:31.164324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e3cc2099-fd55-49d2-8f1b-cad3bab72a7c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152255 Aug 24 06:31:31.164948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 773/1540] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:31 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:32.186224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2e15b5da-3d63-4a89-b485-8a32cf35d381 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:32.186824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2e15b5da-3d63-4a89-b485-8a32cf35d381 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:32.193175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e15b5da-3d63-4a89-b485-8a32cf35d381 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:32.193647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e15b5da-3d63-4a89-b485-8a32cf35d381 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:32.194064 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e15b5da-3d63-4a89-b485-8a32cf35d381 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:32.195336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e15b5da-3d63-4a89-b485-8a32cf35d381 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:32.195787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e15b5da-3d63-4a89-b485-8a32cf35d381 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:32.196199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e15b5da-3d63-4a89-b485-8a32cf35d381 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:32.233267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:31:32.233430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:31:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 (ip 10.222.0.62) !!! Aug 24 06:31:32.335243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2e15b5da-3d63-4a89-b485-8a32cf35d381 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:32.343397 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2e15b5da-3d63-4a89-b485-8a32cf35d381 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.161295 Aug 24 06:31:32.343961 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 768/1541] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:32 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:33.364394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2f7aee84-3394-45d0-bb83-a152fd7728f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:33.365085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2f7aee84-3394-45d0-bb83-a152fd7728f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:33.372095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f7aee84-3394-45d0-bb83-a152fd7728f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:33.372632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f7aee84-3394-45d0-bb83-a152fd7728f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:33.373078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f7aee84-3394-45d0-bb83-a152fd7728f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:33.373843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f7aee84-3394-45d0-bb83-a152fd7728f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:33.374226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f7aee84-3394-45d0-bb83-a152fd7728f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:33.374648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f7aee84-3394-45d0-bb83-a152fd7728f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:33.521333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2f7aee84-3394-45d0-bb83-a152fd7728f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:33.531815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2f7aee84-3394-45d0-bb83-a152fd7728f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.171340 Aug 24 06:31:33.537836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 774/1542] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:33 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:34.553642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8b10caa9-5374-49a9-8aed-8b577c87518f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:34.554819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8b10caa9-5374-49a9-8aed-8b577c87518f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:34.561326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b10caa9-5374-49a9-8aed-8b577c87518f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:34.561806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b10caa9-5374-49a9-8aed-8b577c87518f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:34.562229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b10caa9-5374-49a9-8aed-8b577c87518f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:34.562912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b10caa9-5374-49a9-8aed-8b577c87518f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:34.563357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b10caa9-5374-49a9-8aed-8b577c87518f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:34.563771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b10caa9-5374-49a9-8aed-8b577c87518f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:34.748946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8b10caa9-5374-49a9-8aed-8b577c87518f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:34.757223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8b10caa9-5374-49a9-8aed-8b577c87518f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.207508 Aug 24 06:31:34.757913 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 769/1543] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:34 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:35.777991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-88997bfc-9eb7-4618-8c65-75409e5b9f19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:35.778623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-88997bfc-9eb7-4618-8c65-75409e5b9f19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:35.785064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88997bfc-9eb7-4618-8c65-75409e5b9f19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:35.785534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88997bfc-9eb7-4618-8c65-75409e5b9f19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:35.785961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88997bfc-9eb7-4618-8c65-75409e5b9f19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:35.786638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88997bfc-9eb7-4618-8c65-75409e5b9f19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:35.787082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88997bfc-9eb7-4618-8c65-75409e5b9f19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:35.787498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88997bfc-9eb7-4618-8c65-75409e5b9f19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:35.916815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-88997bfc-9eb7-4618-8c65-75409e5b9f19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:35.925128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-88997bfc-9eb7-4618-8c65-75409e5b9f19 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150962 Aug 24 06:31:35.925697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 775/1544] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:35 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:36.946991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ccd9406e-f830-4ac1-928f-faae61a633df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:36.947588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ccd9406e-f830-4ac1-928f-faae61a633df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:36.953971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd9406e-f830-4ac1-928f-faae61a633df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:36.954443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd9406e-f830-4ac1-928f-faae61a633df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:36.954867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd9406e-f830-4ac1-928f-faae61a633df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:36.955547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd9406e-f830-4ac1-928f-faae61a633df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:36.955989 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd9406e-f830-4ac1-928f-faae61a633df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:36.956402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ccd9406e-f830-4ac1-928f-faae61a633df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:37.093065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ccd9406e-f830-4ac1-928f-faae61a633df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:37.101504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ccd9406e-f830-4ac1-928f-faae61a633df tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158444 Aug 24 06:31:37.102089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 770/1545] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:36 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:38.123264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-df0e3640-dcfc-4b40-afc6-091ceec08109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:38.125451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-df0e3640-dcfc-4b40-afc6-091ceec08109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:38.132432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df0e3640-dcfc-4b40-afc6-091ceec08109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:38.132946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df0e3640-dcfc-4b40-afc6-091ceec08109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:38.133378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df0e3640-dcfc-4b40-afc6-091ceec08109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:38.134072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df0e3640-dcfc-4b40-afc6-091ceec08109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:38.134518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df0e3640-dcfc-4b40-afc6-091ceec08109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:38.134932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df0e3640-dcfc-4b40-afc6-091ceec08109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:38.266183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-df0e3640-dcfc-4b40-afc6-091ceec08109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:38.274985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-df0e3640-dcfc-4b40-afc6-091ceec08109 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155674 Aug 24 06:31:38.275555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 776/1546] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:38 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:39.296599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-541433a7-2066-4d78-a797-6640e39aef3d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:39.297165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-541433a7-2066-4d78-a797-6640e39aef3d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:39.303452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-541433a7-2066-4d78-a797-6640e39aef3d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:39.304576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-541433a7-2066-4d78-a797-6640e39aef3d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:39.305013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-541433a7-2066-4d78-a797-6640e39aef3d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:39.305700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-541433a7-2066-4d78-a797-6640e39aef3d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:39.306152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-541433a7-2066-4d78-a797-6640e39aef3d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:39.306573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-541433a7-2066-4d78-a797-6640e39aef3d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:39.431923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-541433a7-2066-4d78-a797-6640e39aef3d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:39.440315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-541433a7-2066-4d78-a797-6640e39aef3d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.147765 Aug 24 06:31:39.440907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 771/1547] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:39 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:40.461730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f2ae3646-6498-432a-bda4-44e4c334d4f7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:40.462285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f2ae3646-6498-432a-bda4-44e4c334d4f7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:40.468601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f2ae3646-6498-432a-bda4-44e4c334d4f7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:40.469076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f2ae3646-6498-432a-bda4-44e4c334d4f7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:40.469507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f2ae3646-6498-432a-bda4-44e4c334d4f7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:40.470188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f2ae3646-6498-432a-bda4-44e4c334d4f7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:40.470635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f2ae3646-6498-432a-bda4-44e4c334d4f7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:40.471051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f2ae3646-6498-432a-bda4-44e4c334d4f7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:40.647144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f2ae3646-6498-432a-bda4-44e4c334d4f7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:40.656713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f2ae3646-6498-432a-bda4-44e4c334d4f7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.199068 Aug 24 06:31:40.667471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 777/1548] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:40 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:41.678540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0797282c-b4c6-45c7-aa32-21409f526744 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:41.679227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0797282c-b4c6-45c7-aa32-21409f526744 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:41.681495 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=26 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:31:41.686600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0797282c-b4c6-45c7-aa32-21409f526744 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:41.687086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0797282c-b4c6-45c7-aa32-21409f526744 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:41.687531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0797282c-b4c6-45c7-aa32-21409f526744 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:41.688241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0797282c-b4c6-45c7-aa32-21409f526744 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:41.688719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0797282c-b4c6-45c7-aa32-21409f526744 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:41.689202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0797282c-b4c6-45c7-aa32-21409f526744 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:41.691974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=78 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:31:41.823647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0797282c-b4c6-45c7-aa32-21409f526744 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:41.832105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0797282c-b4c6-45c7-aa32-21409f526744 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157482 Aug 24 06:31:41.833070 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 772/1549] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:41 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:42.853894 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-477a96d4-dff3-4882-90fe-5a77eae5ab4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:42.854475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-477a96d4-dff3-4882-90fe-5a77eae5ab4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:42.860921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-477a96d4-dff3-4882-90fe-5a77eae5ab4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:42.861430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-477a96d4-dff3-4882-90fe-5a77eae5ab4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:42.861858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-477a96d4-dff3-4882-90fe-5a77eae5ab4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:42.862539 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-477a96d4-dff3-4882-90fe-5a77eae5ab4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:42.862984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-477a96d4-dff3-4882-90fe-5a77eae5ab4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:42.863394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-477a96d4-dff3-4882-90fe-5a77eae5ab4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:42.990999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-477a96d4-dff3-4882-90fe-5a77eae5ab4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:42.999688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-477a96d4-dff3-4882-90fe-5a77eae5ab4d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149645 Aug 24 06:31:43.000268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 778/1550] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:42 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:44.020672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-55a4df39-4318-430e-828c-03edcb27f9ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:44.021277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-55a4df39-4318-430e-828c-03edcb27f9ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:44.028305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a4df39-4318-430e-828c-03edcb27f9ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:44.028803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a4df39-4318-430e-828c-03edcb27f9ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:44.029231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a4df39-4318-430e-828c-03edcb27f9ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:44.029907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a4df39-4318-430e-828c-03edcb27f9ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:44.030350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a4df39-4318-430e-828c-03edcb27f9ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:44.030762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a4df39-4318-430e-828c-03edcb27f9ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:44.163134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-55a4df39-4318-430e-828c-03edcb27f9ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:44.171101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-55a4df39-4318-430e-828c-03edcb27f9ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154317 Aug 24 06:31:44.171651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 773/1551] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:44 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:31:45.191920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bb0615bd-66ee-4d80-9be0-d58a823b6b63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:45.192544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bb0615bd-66ee-4d80-9be0-d58a823b6b63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:45.199520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb0615bd-66ee-4d80-9be0-d58a823b6b63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:45.199993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb0615bd-66ee-4d80-9be0-d58a823b6b63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:45.200423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb0615bd-66ee-4d80-9be0-d58a823b6b63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:45.201130 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb0615bd-66ee-4d80-9be0-d58a823b6b63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:45.201575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb0615bd-66ee-4d80-9be0-d58a823b6b63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:45.201988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bb0615bd-66ee-4d80-9be0-d58a823b6b63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:45.336913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bb0615bd-66ee-4d80-9be0-d58a823b6b63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:45.345000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bb0615bd-66ee-4d80-9be0-d58a823b6b63 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156985 Aug 24 06:31:45.345756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 779/1552] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:45 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:46.366036 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-36c32301-bc07-4984-9ebd-e758ff76b92b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:46.366609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-36c32301-bc07-4984-9ebd-e758ff76b92b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:46.373107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36c32301-bc07-4984-9ebd-e758ff76b92b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:46.373583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36c32301-bc07-4984-9ebd-e758ff76b92b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:46.374010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36c32301-bc07-4984-9ebd-e758ff76b92b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:46.374693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36c32301-bc07-4984-9ebd-e758ff76b92b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:46.375141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36c32301-bc07-4984-9ebd-e758ff76b92b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:46.375557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-36c32301-bc07-4984-9ebd-e758ff76b92b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:46.503695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-36c32301-bc07-4984-9ebd-e758ff76b92b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:46.512041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-36c32301-bc07-4984-9ebd-e758ff76b92b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149929 Aug 24 06:31:46.512826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 774/1553] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:46 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:47.534576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-32e6c905-3007-47d8-93d2-3bd92be3bebe tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:47.535193 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-32e6c905-3007-47d8-93d2-3bd92be3bebe tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:47.542360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e6c905-3007-47d8-93d2-3bd92be3bebe tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:47.542853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e6c905-3007-47d8-93d2-3bd92be3bebe tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:47.543293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e6c905-3007-47d8-93d2-3bd92be3bebe tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:47.543995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e6c905-3007-47d8-93d2-3bd92be3bebe tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:47.544451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e6c905-3007-47d8-93d2-3bd92be3bebe tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:47.544911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32e6c905-3007-47d8-93d2-3bd92be3bebe tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:47.679277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-32e6c905-3007-47d8-93d2-3bd92be3bebe tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:47.687995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-32e6c905-3007-47d8-93d2-3bd92be3bebe tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157269 Aug 24 06:31:47.688776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 780/1554] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:47 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:48.709114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ddd1b0d5-f207-4f5c-8266-6acef68ed578 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:48.710051 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ddd1b0d5-f207-4f5c-8266-6acef68ed578 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:48.716629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddd1b0d5-f207-4f5c-8266-6acef68ed578 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:48.717104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddd1b0d5-f207-4f5c-8266-6acef68ed578 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:48.717537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddd1b0d5-f207-4f5c-8266-6acef68ed578 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:48.718227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddd1b0d5-f207-4f5c-8266-6acef68ed578 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:48.718677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddd1b0d5-f207-4f5c-8266-6acef68ed578 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:48.719095 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ddd1b0d5-f207-4f5c-8266-6acef68ed578 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:48.849236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ddd1b0d5-f207-4f5c-8266-6acef68ed578 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:48.857998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ddd1b0d5-f207-4f5c-8266-6acef68ed578 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153055 Aug 24 06:31:48.858578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 775/1555] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:48 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:49.879029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e3338907-75d4-427e-84ab-207f3867e0d1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:49.879616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e3338907-75d4-427e-84ab-207f3867e0d1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:49.882639 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=26 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:31:49.893009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3338907-75d4-427e-84ab-207f3867e0d1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:49.893009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3338907-75d4-427e-84ab-207f3867e0d1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:49.893009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3338907-75d4-427e-84ab-207f3867e0d1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:49.893009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3338907-75d4-427e-84ab-207f3867e0d1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:49.893466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3338907-75d4-427e-84ab-207f3867e0d1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:49.893466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3338907-75d4-427e-84ab-207f3867e0d1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:50.030781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e3338907-75d4-427e-84ab-207f3867e0d1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:50.039809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e3338907-75d4-427e-84ab-207f3867e0d1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.164588 Aug 24 06:31:50.040381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 781/1556] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:49 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:51.060817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8e4ab822-74fa-4123-ac78-8441bb6b2cce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:51.061409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8e4ab822-74fa-4123-ac78-8441bb6b2cce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:51.068242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4ab822-74fa-4123-ac78-8441bb6b2cce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:51.068751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4ab822-74fa-4123-ac78-8441bb6b2cce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:51.069177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4ab822-74fa-4123-ac78-8441bb6b2cce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:51.069867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4ab822-74fa-4123-ac78-8441bb6b2cce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:51.070388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4ab822-74fa-4123-ac78-8441bb6b2cce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:51.071412 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4ab822-74fa-4123-ac78-8441bb6b2cce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:51.206348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8e4ab822-74fa-4123-ac78-8441bb6b2cce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:51.214908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8e4ab822-74fa-4123-ac78-8441bb6b2cce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158183 Aug 24 06:31:51.215784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 776/1557] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:51 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:52.235845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4e7738ef-308a-4f30-97b8-a18a6729de89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:52.236457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4e7738ef-308a-4f30-97b8-a18a6729de89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:52.242992 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e7738ef-308a-4f30-97b8-a18a6729de89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:52.243465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e7738ef-308a-4f30-97b8-a18a6729de89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:52.243893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e7738ef-308a-4f30-97b8-a18a6729de89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:52.244614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e7738ef-308a-4f30-97b8-a18a6729de89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:52.245060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e7738ef-308a-4f30-97b8-a18a6729de89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:52.245477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e7738ef-308a-4f30-97b8-a18a6729de89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:52.248086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=78 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:31:52.376987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4e7738ef-308a-4f30-97b8-a18a6729de89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:52.385970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4e7738ef-308a-4f30-97b8-a18a6729de89 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153938 Aug 24 06:31:52.386543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 782/1558] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:52 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:53.407306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-79c3abaa-975e-41f0-8234-7b823a874c98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:53.407834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-79c3abaa-975e-41f0-8234-7b823a874c98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:53.414304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c3abaa-975e-41f0-8234-7b823a874c98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:53.415473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c3abaa-975e-41f0-8234-7b823a874c98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:53.415904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c3abaa-975e-41f0-8234-7b823a874c98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:53.416628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c3abaa-975e-41f0-8234-7b823a874c98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:53.417077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c3abaa-975e-41f0-8234-7b823a874c98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:53.417491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79c3abaa-975e-41f0-8234-7b823a874c98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:53.571201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-79c3abaa-975e-41f0-8234-7b823a874c98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:53.579522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-79c3abaa-975e-41f0-8234-7b823a874c98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.176144 Aug 24 06:31:53.580094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 777/1559] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:53 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:54.601008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-518a6870-a432-43f0-81f9-fdde3702e687 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:54.601740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-518a6870-a432-43f0-81f9-fdde3702e687 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:54.608251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a6870-a432-43f0-81f9-fdde3702e687 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:54.608773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a6870-a432-43f0-81f9-fdde3702e687 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:54.609209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a6870-a432-43f0-81f9-fdde3702e687 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:54.609901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a6870-a432-43f0-81f9-fdde3702e687 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:54.610352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a6870-a432-43f0-81f9-fdde3702e687 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:54.610774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a6870-a432-43f0-81f9-fdde3702e687 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:54.746726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-518a6870-a432-43f0-81f9-fdde3702e687 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:54.755273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-518a6870-a432-43f0-81f9-fdde3702e687 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158224 Aug 24 06:31:54.755857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 783/1560] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:54 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:55.776028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-58996a72-70ab-4ffc-969c-6fea6ea73987 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:55.776687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-58996a72-70ab-4ffc-969c-6fea6ea73987 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:55.783078 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58996a72-70ab-4ffc-969c-6fea6ea73987 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:55.783550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58996a72-70ab-4ffc-969c-6fea6ea73987 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:55.783977 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58996a72-70ab-4ffc-969c-6fea6ea73987 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:55.784695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58996a72-70ab-4ffc-969c-6fea6ea73987 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:55.785142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58996a72-70ab-4ffc-969c-6fea6ea73987 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:55.785557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58996a72-70ab-4ffc-969c-6fea6ea73987 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:55.917143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-58996a72-70ab-4ffc-969c-6fea6ea73987 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:55.925661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-58996a72-70ab-4ffc-969c-6fea6ea73987 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153930 Aug 24 06:31:55.926231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 778/1561] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:55 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:56.947749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-78dbc0b7-58df-4ea3-8a1d-77d0a23fc716 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:56.948347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-78dbc0b7-58df-4ea3-8a1d-77d0a23fc716 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:56.954784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78dbc0b7-58df-4ea3-8a1d-77d0a23fc716 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:56.955263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78dbc0b7-58df-4ea3-8a1d-77d0a23fc716 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:56.955696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78dbc0b7-58df-4ea3-8a1d-77d0a23fc716 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:56.956415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78dbc0b7-58df-4ea3-8a1d-77d0a23fc716 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:56.956889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78dbc0b7-58df-4ea3-8a1d-77d0a23fc716 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:56.957311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78dbc0b7-58df-4ea3-8a1d-77d0a23fc716 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:57.093877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-78dbc0b7-58df-4ea3-8a1d-77d0a23fc716 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:57.102298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-78dbc0b7-58df-4ea3-8a1d-77d0a23fc716 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158910 Aug 24 06:31:57.110488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 784/1562] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:56 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:58.123544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-59cfa8cd-c8fb-406d-9a6a-f0327f3dc9ee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:58.124062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-59cfa8cd-c8fb-406d-9a6a-f0327f3dc9ee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:58.130228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59cfa8cd-c8fb-406d-9a6a-f0327f3dc9ee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:58.130709 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59cfa8cd-c8fb-406d-9a6a-f0327f3dc9ee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:58.131140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59cfa8cd-c8fb-406d-9a6a-f0327f3dc9ee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:58.131833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59cfa8cd-c8fb-406d-9a6a-f0327f3dc9ee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:58.132290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59cfa8cd-c8fb-406d-9a6a-f0327f3dc9ee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:58.132735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59cfa8cd-c8fb-406d-9a6a-f0327f3dc9ee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:58.258501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-59cfa8cd-c8fb-406d-9a6a-f0327f3dc9ee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:58.266518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-59cfa8cd-c8fb-406d-9a6a-f0327f3dc9ee tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.147612 Aug 24 06:31:58.267070 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 779/1563] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:58 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:59.288615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-88f226cc-3f8b-426e-a663-14c62eccef69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:31:59.289853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-88f226cc-3f8b-426e-a663-14c62eccef69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:31:59.296344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88f226cc-3f8b-426e-a663-14c62eccef69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:59.296851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88f226cc-3f8b-426e-a663-14c62eccef69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:59.297287 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88f226cc-3f8b-426e-a663-14c62eccef69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:59.297975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88f226cc-3f8b-426e-a663-14c62eccef69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:31:59.298432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88f226cc-3f8b-426e-a663-14c62eccef69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:31:59.298855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88f226cc-3f8b-426e-a663-14c62eccef69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:31:59.424894 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-88f226cc-3f8b-426e-a663-14c62eccef69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:31:59.433975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-88f226cc-3f8b-426e-a663-14c62eccef69 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149179 Aug 24 06:31:59.434543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 785/1564] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:31:59 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:31:59.471817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:31:59.472331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:31:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:32:00.454938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f6e3d5de-a414-4888-8f63-742179a158f6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:00.455538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f6e3d5de-a414-4888-8f63-742179a158f6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:00.462201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e3d5de-a414-4888-8f63-742179a158f6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:00.462690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e3d5de-a414-4888-8f63-742179a158f6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:00.463124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e3d5de-a414-4888-8f63-742179a158f6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:00.463818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e3d5de-a414-4888-8f63-742179a158f6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:00.464271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e3d5de-a414-4888-8f63-742179a158f6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:00.464732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e3d5de-a414-4888-8f63-742179a158f6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:00.595281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f6e3d5de-a414-4888-8f63-742179a158f6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:00.604204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f6e3d5de-a414-4888-8f63-742179a158f6 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153053 Aug 24 06:32:00.604816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 780/1565] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:00 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:01.625756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d1faf6d7-efeb-4334-9de3-8f3905fe58ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:01.626290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d1faf6d7-efeb-4334-9de3-8f3905fe58ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:01.633391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1faf6d7-efeb-4334-9de3-8f3905fe58ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:01.633875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1faf6d7-efeb-4334-9de3-8f3905fe58ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:01.634306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1faf6d7-efeb-4334-9de3-8f3905fe58ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:01.634999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1faf6d7-efeb-4334-9de3-8f3905fe58ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:01.635448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1faf6d7-efeb-4334-9de3-8f3905fe58ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:01.635868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1faf6d7-efeb-4334-9de3-8f3905fe58ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:01.767329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d1faf6d7-efeb-4334-9de3-8f3905fe58ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:01.775499 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d1faf6d7-efeb-4334-9de3-8f3905fe58ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153711 Aug 24 06:32:01.776062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 786/1566] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:01 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:02.796565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f6f16ef6-0e75-43f0-a93e-a32d4f6047ff tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:02.797178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f6f16ef6-0e75-43f0-a93e-a32d4f6047ff tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:02.803344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6f16ef6-0e75-43f0-a93e-a32d4f6047ff tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:02.803818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6f16ef6-0e75-43f0-a93e-a32d4f6047ff tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:02.804248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6f16ef6-0e75-43f0-a93e-a32d4f6047ff tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:02.805460 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6f16ef6-0e75-43f0-a93e-a32d4f6047ff tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:02.805963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6f16ef6-0e75-43f0-a93e-a32d4f6047ff tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:02.806382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6f16ef6-0e75-43f0-a93e-a32d4f6047ff tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:02.940396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f6f16ef6-0e75-43f0-a93e-a32d4f6047ff tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:02.949184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f6f16ef6-0e75-43f0-a93e-a32d4f6047ff tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156478 Aug 24 06:32:02.950000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 781/1567] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:02 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:03.969570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3fdef6f7-f164-47aa-9561-b1fc10e9729f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:03.970134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3fdef6f7-f164-47aa-9561-b1fc10e9729f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:03.977075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fdef6f7-f164-47aa-9561-b1fc10e9729f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:03.977556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fdef6f7-f164-47aa-9561-b1fc10e9729f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:03.977989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fdef6f7-f164-47aa-9561-b1fc10e9729f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:03.978680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fdef6f7-f164-47aa-9561-b1fc10e9729f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:03.979127 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fdef6f7-f164-47aa-9561-b1fc10e9729f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:03.979549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fdef6f7-f164-47aa-9561-b1fc10e9729f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:04.116535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3fdef6f7-f164-47aa-9561-b1fc10e9729f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:04.126279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3fdef6f7-f164-47aa-9561-b1fc10e9729f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.160662 Aug 24 06:32:04.126857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 787/1568] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:03 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:05.147180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-70112a68-8e8e-4a1a-a1b7-07dccb1810f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:05.147781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-70112a68-8e8e-4a1a-a1b7-07dccb1810f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:05.154368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70112a68-8e8e-4a1a-a1b7-07dccb1810f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:05.154843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70112a68-8e8e-4a1a-a1b7-07dccb1810f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:05.155299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70112a68-8e8e-4a1a-a1b7-07dccb1810f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:05.155979 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70112a68-8e8e-4a1a-a1b7-07dccb1810f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:05.156420 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70112a68-8e8e-4a1a-a1b7-07dccb1810f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:05.156856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70112a68-8e8e-4a1a-a1b7-07dccb1810f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:05.292473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-70112a68-8e8e-4a1a-a1b7-07dccb1810f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:05.298104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-70112a68-8e8e-4a1a-a1b7-07dccb1810f1 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154719 Aug 24 06:32:05.298665 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 782/1569] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:05 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:06.320686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5343d14a-a5b8-4209-a77d-165e2a98c72e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:06.321468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5343d14a-a5b8-4209-a77d-165e2a98c72e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:06.327853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5343d14a-a5b8-4209-a77d-165e2a98c72e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:06.328327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5343d14a-a5b8-4209-a77d-165e2a98c72e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:06.328786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5343d14a-a5b8-4209-a77d-165e2a98c72e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:06.329475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5343d14a-a5b8-4209-a77d-165e2a98c72e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:06.329918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5343d14a-a5b8-4209-a77d-165e2a98c72e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:06.330334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5343d14a-a5b8-4209-a77d-165e2a98c72e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:06.464072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5343d14a-a5b8-4209-a77d-165e2a98c72e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:06.472558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5343d14a-a5b8-4209-a77d-165e2a98c72e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156347 Aug 24 06:32:06.477517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 788/1570] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:06 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:07.493725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-93eb16f0-959e-470c-b91b-75d93be66ac9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:07.494342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-93eb16f0-959e-470c-b91b-75d93be66ac9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:07.500860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93eb16f0-959e-470c-b91b-75d93be66ac9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:07.501338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93eb16f0-959e-470c-b91b-75d93be66ac9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:07.501780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93eb16f0-959e-470c-b91b-75d93be66ac9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:07.502445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93eb16f0-959e-470c-b91b-75d93be66ac9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:07.502888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93eb16f0-959e-470c-b91b-75d93be66ac9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:07.503300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93eb16f0-959e-470c-b91b-75d93be66ac9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:07.637241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-93eb16f0-959e-470c-b91b-75d93be66ac9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:07.646302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-93eb16f0-959e-470c-b91b-75d93be66ac9 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156387 Aug 24 06:32:07.646890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 783/1571] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:07 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:08.667874 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-eade54d0-62f0-4c8c-9657-20b8aa9b00e3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:08.668554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-eade54d0-62f0-4c8c-9657-20b8aa9b00e3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:08.675184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eade54d0-62f0-4c8c-9657-20b8aa9b00e3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:08.675658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eade54d0-62f0-4c8c-9657-20b8aa9b00e3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:08.676087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eade54d0-62f0-4c8c-9657-20b8aa9b00e3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:08.676804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eade54d0-62f0-4c8c-9657-20b8aa9b00e3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:08.677252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eade54d0-62f0-4c8c-9657-20b8aa9b00e3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:08.677670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eade54d0-62f0-4c8c-9657-20b8aa9b00e3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:08.818819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-eade54d0-62f0-4c8c-9657-20b8aa9b00e3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:08.828511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-eade54d0-62f0-4c8c-9657-20b8aa9b00e3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.164445 Aug 24 06:32:08.829090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 789/1572] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:08 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:09.860028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6a60f1d3-2e61-4c95-bd34-b81fbc2f7415 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:09.860677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6a60f1d3-2e61-4c95-bd34-b81fbc2f7415 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:09.867938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a60f1d3-2e61-4c95-bd34-b81fbc2f7415 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:09.868429 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a60f1d3-2e61-4c95-bd34-b81fbc2f7415 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:09.868893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a60f1d3-2e61-4c95-bd34-b81fbc2f7415 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:09.869605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a60f1d3-2e61-4c95-bd34-b81fbc2f7415 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:09.870061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a60f1d3-2e61-4c95-bd34-b81fbc2f7415 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:09.870489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a60f1d3-2e61-4c95-bd34-b81fbc2f7415 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:10.028433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6a60f1d3-2e61-4c95-bd34-b81fbc2f7415 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:10.037235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6a60f1d3-2e61-4c95-bd34-b81fbc2f7415 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.181465 Aug 24 06:32:10.037853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 784/1573] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:09 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:11.059790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2b72f71c-4d54-43a0-8a74-2b4130bb6b47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:11.060390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2b72f71c-4d54-43a0-8a74-2b4130bb6b47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:11.066936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b72f71c-4d54-43a0-8a74-2b4130bb6b47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:11.067414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b72f71c-4d54-43a0-8a74-2b4130bb6b47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:11.067845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b72f71c-4d54-43a0-8a74-2b4130bb6b47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:11.068581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b72f71c-4d54-43a0-8a74-2b4130bb6b47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:11.069028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b72f71c-4d54-43a0-8a74-2b4130bb6b47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:11.069454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b72f71c-4d54-43a0-8a74-2b4130bb6b47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:11.202586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2b72f71c-4d54-43a0-8a74-2b4130bb6b47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:11.211147 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2b72f71c-4d54-43a0-8a74-2b4130bb6b47 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155529 Aug 24 06:32:11.211726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 790/1574] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:11 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:12.231840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-09816e29-014e-43ba-a4b1-dd31e14c5fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:12.232398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-09816e29-014e-43ba-a4b1-dd31e14c5fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:12.234897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=26 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:32:12.239911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09816e29-014e-43ba-a4b1-dd31e14c5fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:12.243219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09816e29-014e-43ba-a4b1-dd31e14c5fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:12.243219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09816e29-014e-43ba-a4b1-dd31e14c5fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:12.243219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09816e29-014e-43ba-a4b1-dd31e14c5fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:12.243219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09816e29-014e-43ba-a4b1-dd31e14c5fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:12.243781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-09816e29-014e-43ba-a4b1-dd31e14c5fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:12.245331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=78 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:32:12.382980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-09816e29-014e-43ba-a4b1-dd31e14c5fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:12.391678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-09816e29-014e-43ba-a4b1-dd31e14c5fce tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.164175 Aug 24 06:32:12.392267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 785/1575] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:12 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:13.413776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-19420c7a-b5bf-4758-a95f-b972f256dc5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:13.414409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-19420c7a-b5bf-4758-a95f-b972f256dc5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:13.421088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19420c7a-b5bf-4758-a95f-b972f256dc5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:13.421566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19420c7a-b5bf-4758-a95f-b972f256dc5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:13.421996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19420c7a-b5bf-4758-a95f-b972f256dc5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:13.422691 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19420c7a-b5bf-4758-a95f-b972f256dc5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:13.423139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19420c7a-b5bf-4758-a95f-b972f256dc5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:13.423555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19420c7a-b5bf-4758-a95f-b972f256dc5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:13.558120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-19420c7a-b5bf-4758-a95f-b972f256dc5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:13.566709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-19420c7a-b5bf-4758-a95f-b972f256dc5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156779 Aug 24 06:32:13.567301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 791/1576] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:13 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:14.588249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-460c1206-ed70-4161-ad6f-453028c1ed3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:14.588879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-460c1206-ed70-4161-ad6f-453028c1ed3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:14.595437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-460c1206-ed70-4161-ad6f-453028c1ed3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:14.595916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-460c1206-ed70-4161-ad6f-453028c1ed3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:14.596347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-460c1206-ed70-4161-ad6f-453028c1ed3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:14.597072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-460c1206-ed70-4161-ad6f-453028c1ed3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:14.597522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-460c1206-ed70-4161-ad6f-453028c1ed3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:14.597941 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-460c1206-ed70-4161-ad6f-453028c1ed3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:14.731326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-460c1206-ed70-4161-ad6f-453028c1ed3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:14.739552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-460c1206-ed70-4161-ad6f-453028c1ed3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155124 Aug 24 06:32:14.740119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 786/1577] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:14 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:15.763439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2c5549a6-5bb3-4f88-a3f0-744eedb24d31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:15.764037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2c5549a6-5bb3-4f88-a3f0-744eedb24d31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:15.770554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c5549a6-5bb3-4f88-a3f0-744eedb24d31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:15.771027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c5549a6-5bb3-4f88-a3f0-744eedb24d31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:15.771452 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c5549a6-5bb3-4f88-a3f0-744eedb24d31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:15.772135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c5549a6-5bb3-4f88-a3f0-744eedb24d31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:15.772607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c5549a6-5bb3-4f88-a3f0-744eedb24d31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:15.773027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c5549a6-5bb3-4f88-a3f0-744eedb24d31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:15.901867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2c5549a6-5bb3-4f88-a3f0-744eedb24d31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:15.910166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2c5549a6-5bb3-4f88-a3f0-744eedb24d31 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150572 Aug 24 06:32:15.910738 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 792/1578] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:15 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:16.935815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-90a5e2ab-8f0f-4923-8614-0fff92610b55 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:16.935815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-90a5e2ab-8f0f-4923-8614-0fff92610b55 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:16.940264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90a5e2ab-8f0f-4923-8614-0fff92610b55 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:16.940784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90a5e2ab-8f0f-4923-8614-0fff92610b55 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:16.941219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90a5e2ab-8f0f-4923-8614-0fff92610b55 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:16.941910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90a5e2ab-8f0f-4923-8614-0fff92610b55 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:16.942364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90a5e2ab-8f0f-4923-8614-0fff92610b55 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:16.942781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90a5e2ab-8f0f-4923-8614-0fff92610b55 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:17.073762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-90a5e2ab-8f0f-4923-8614-0fff92610b55 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:17.082260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-90a5e2ab-8f0f-4923-8614-0fff92610b55 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153594 Aug 24 06:32:17.082825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 787/1579] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:16 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:18.103385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-24b12eae-5442-4654-92bc-fe05939bef5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:18.103995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-24b12eae-5442-4654-92bc-fe05939bef5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:18.110445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24b12eae-5442-4654-92bc-fe05939bef5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:18.110937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24b12eae-5442-4654-92bc-fe05939bef5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:18.111377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24b12eae-5442-4654-92bc-fe05939bef5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:18.112089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24b12eae-5442-4654-92bc-fe05939bef5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:18.112566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24b12eae-5442-4654-92bc-fe05939bef5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:18.112991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24b12eae-5442-4654-92bc-fe05939bef5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:18.250610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-24b12eae-5442-4654-92bc-fe05939bef5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:18.261227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-24b12eae-5442-4654-92bc-fe05939bef5c tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.161666 Aug 24 06:32:18.261813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 793/1580] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:18 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:19.282523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8ea45b80-cfe7-4211-b14d-f247dda56a98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:19.283117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8ea45b80-cfe7-4211-b14d-f247dda56a98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:19.290172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ea45b80-cfe7-4211-b14d-f247dda56a98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:19.290659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ea45b80-cfe7-4211-b14d-f247dda56a98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:19.291086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ea45b80-cfe7-4211-b14d-f247dda56a98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:19.291812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ea45b80-cfe7-4211-b14d-f247dda56a98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:19.292262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ea45b80-cfe7-4211-b14d-f247dda56a98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:19.292714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ea45b80-cfe7-4211-b14d-f247dda56a98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:19.440021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8ea45b80-cfe7-4211-b14d-f247dda56a98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:19.449103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8ea45b80-cfe7-4211-b14d-f247dda56a98 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.170269 Aug 24 06:32:19.449685 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 788/1581] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:19 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:20.473176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-29fcfb08-b577-4096-92b6-2376a76a06d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:20.473176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-29fcfb08-b577-4096-92b6-2376a76a06d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:20.477438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=26 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:32:20.481067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29fcfb08-b577-4096-92b6-2376a76a06d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:20.481551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29fcfb08-b577-4096-92b6-2376a76a06d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:20.481988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29fcfb08-b577-4096-92b6-2376a76a06d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:20.482750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29fcfb08-b577-4096-92b6-2376a76a06d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:20.483203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29fcfb08-b577-4096-92b6-2376a76a06d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:20.483628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29fcfb08-b577-4096-92b6-2376a76a06d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:20.617068 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-29fcfb08-b577-4096-92b6-2376a76a06d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:20.625368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-29fcfb08-b577-4096-92b6-2376a76a06d0 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157918 Aug 24 06:32:20.625942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 794/1582] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:20 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:21.649232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-125b17d4-8ea5-4f68-99a2-ec35b87db991 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:21.649892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-125b17d4-8ea5-4f68-99a2-ec35b87db991 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:21.656721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-125b17d4-8ea5-4f68-99a2-ec35b87db991 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:21.657204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-125b17d4-8ea5-4f68-99a2-ec35b87db991 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:21.657633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-125b17d4-8ea5-4f68-99a2-ec35b87db991 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:21.658331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-125b17d4-8ea5-4f68-99a2-ec35b87db991 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:21.658764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-125b17d4-8ea5-4f68-99a2-ec35b87db991 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:21.659175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-125b17d4-8ea5-4f68-99a2-ec35b87db991 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:21.798805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-125b17d4-8ea5-4f68-99a2-ec35b87db991 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:21.807574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-125b17d4-8ea5-4f68-99a2-ec35b87db991 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.162910 Aug 24 06:32:21.808639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 789/1583] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:21 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:22.830588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f11a7fd4-2ff7-4091-b09c-5fd17573c705 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:22.831161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f11a7fd4-2ff7-4091-b09c-5fd17573c705 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:22.838272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f11a7fd4-2ff7-4091-b09c-5fd17573c705 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:22.838754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f11a7fd4-2ff7-4091-b09c-5fd17573c705 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:22.839194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f11a7fd4-2ff7-4091-b09c-5fd17573c705 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:22.839883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f11a7fd4-2ff7-4091-b09c-5fd17573c705 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:22.840336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f11a7fd4-2ff7-4091-b09c-5fd17573c705 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:22.840788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f11a7fd4-2ff7-4091-b09c-5fd17573c705 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:22.848151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=78 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:32:22.979843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f11a7fd4-2ff7-4091-b09c-5fd17573c705 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:22.988267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f11a7fd4-2ff7-4091-b09c-5fd17573c705 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.161633 Aug 24 06:32:22.988900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 795/1584] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:22 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:24.008611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5ebcf16a-b4b1-47b7-8896-692be3827984 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:24.009205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5ebcf16a-b4b1-47b7-8896-692be3827984 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:24.015585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebcf16a-b4b1-47b7-8896-692be3827984 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:24.016057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebcf16a-b4b1-47b7-8896-692be3827984 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:24.016483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebcf16a-b4b1-47b7-8896-692be3827984 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:24.017188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebcf16a-b4b1-47b7-8896-692be3827984 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:24.017634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebcf16a-b4b1-47b7-8896-692be3827984 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:24.018057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebcf16a-b4b1-47b7-8896-692be3827984 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:24.147791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5ebcf16a-b4b1-47b7-8896-692be3827984 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:24.155999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5ebcf16a-b4b1-47b7-8896-692be3827984 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151261 Aug 24 06:32:24.156740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 790/1585] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:24 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:25.178165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-94fee085-a339-4d08-8cb7-42de874c1dd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:25.178836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-94fee085-a339-4d08-8cb7-42de874c1dd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:25.185679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94fee085-a339-4d08-8cb7-42de874c1dd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:25.192018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94fee085-a339-4d08-8cb7-42de874c1dd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:25.192018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94fee085-a339-4d08-8cb7-42de874c1dd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:25.192018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94fee085-a339-4d08-8cb7-42de874c1dd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:25.192018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94fee085-a339-4d08-8cb7-42de874c1dd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:25.192419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94fee085-a339-4d08-8cb7-42de874c1dd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:25.320062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-94fee085-a339-4d08-8cb7-42de874c1dd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:25.328244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-94fee085-a339-4d08-8cb7-42de874c1dd3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153994 Aug 24 06:32:25.328841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 796/1586] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:25 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:26.349069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dc719fa0-9071-4485-acdd-c4dec3aa4ba2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:26.349707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dc719fa0-9071-4485-acdd-c4dec3aa4ba2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:26.356098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc719fa0-9071-4485-acdd-c4dec3aa4ba2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:26.356606 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc719fa0-9071-4485-acdd-c4dec3aa4ba2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:26.357041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc719fa0-9071-4485-acdd-c4dec3aa4ba2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:26.357726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc719fa0-9071-4485-acdd-c4dec3aa4ba2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:26.358175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc719fa0-9071-4485-acdd-c4dec3aa4ba2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:26.358594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc719fa0-9071-4485-acdd-c4dec3aa4ba2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:26.493042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dc719fa0-9071-4485-acdd-c4dec3aa4ba2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:26.503551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dc719fa0-9071-4485-acdd-c4dec3aa4ba2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158310 Aug 24 06:32:26.504120 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 791/1587] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:26 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:27.530281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e1c84790-1b8a-4a60-aa65-b5b9984e84b7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:27.530958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e1c84790-1b8a-4a60-aa65-b5b9984e84b7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:27.537741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1c84790-1b8a-4a60-aa65-b5b9984e84b7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:27.538227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1c84790-1b8a-4a60-aa65-b5b9984e84b7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:27.538667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1c84790-1b8a-4a60-aa65-b5b9984e84b7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:27.539402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1c84790-1b8a-4a60-aa65-b5b9984e84b7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:27.539854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1c84790-1b8a-4a60-aa65-b5b9984e84b7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:27.540279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1c84790-1b8a-4a60-aa65-b5b9984e84b7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:27.667956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e1c84790-1b8a-4a60-aa65-b5b9984e84b7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:27.676035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e1c84790-1b8a-4a60-aa65-b5b9984e84b7 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149609 Aug 24 06:32:27.676622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 797/1588] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:27 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:28.697879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e1c5959a-40c2-418b-b711-db16d4d50f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:28.698492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e1c5959a-40c2-418b-b711-db16d4d50f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:28.705251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1c5959a-40c2-418b-b711-db16d4d50f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:28.705741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1c5959a-40c2-418b-b711-db16d4d50f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:28.706179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1c5959a-40c2-418b-b711-db16d4d50f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:28.706872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1c5959a-40c2-418b-b711-db16d4d50f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:28.707321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1c5959a-40c2-418b-b711-db16d4d50f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:28.707740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1c5959a-40c2-418b-b711-db16d4d50f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:28.837513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e1c5959a-40c2-418b-b711-db16d4d50f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:28.845891 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e1c5959a-40c2-418b-b711-db16d4d50f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151960 Aug 24 06:32:28.846463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 792/1589] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:28 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:29.867459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fda7da4c-309c-43e4-9d96-bf72b6f84f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:29.868074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fda7da4c-309c-43e4-9d96-bf72b6f84f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:29.874648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fda7da4c-309c-43e4-9d96-bf72b6f84f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:29.875139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fda7da4c-309c-43e4-9d96-bf72b6f84f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:29.875572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fda7da4c-309c-43e4-9d96-bf72b6f84f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:29.876369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fda7da4c-309c-43e4-9d96-bf72b6f84f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:29.876864 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fda7da4c-309c-43e4-9d96-bf72b6f84f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:29.877292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fda7da4c-309c-43e4-9d96-bf72b6f84f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:30.019133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fda7da4c-309c-43e4-9d96-bf72b6f84f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:30.027974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fda7da4c-309c-43e4-9d96-bf72b6f84f1e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.164620 Aug 24 06:32:30.028684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 798/1590] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:29 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:31.049077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7c18025c-d7b9-4812-bf45-87ae69dbcf09 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:31.049738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7c18025c-d7b9-4812-bf45-87ae69dbcf09 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:31.055780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c18025c-d7b9-4812-bf45-87ae69dbcf09 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:31.056262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c18025c-d7b9-4812-bf45-87ae69dbcf09 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:31.056731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c18025c-d7b9-4812-bf45-87ae69dbcf09 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:31.057426 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c18025c-d7b9-4812-bf45-87ae69dbcf09 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:31.057876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c18025c-d7b9-4812-bf45-87ae69dbcf09 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:31.058722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c18025c-d7b9-4812-bf45-87ae69dbcf09 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:31.185332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7c18025c-d7b9-4812-bf45-87ae69dbcf09 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:31.193388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7c18025c-d7b9-4812-bf45-87ae69dbcf09 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.148026 Aug 24 06:32:31.194442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 793/1591] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:31 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:32.214658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1ec2cb2c-3d8e-4b36-9472-1639324860c2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:32.215273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1ec2cb2c-3d8e-4b36-9472-1639324860c2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:32.221775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ec2cb2c-3d8e-4b36-9472-1639324860c2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:32.222253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ec2cb2c-3d8e-4b36-9472-1639324860c2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:32.222689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ec2cb2c-3d8e-4b36-9472-1639324860c2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:32.223374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ec2cb2c-3d8e-4b36-9472-1639324860c2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:32.223824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ec2cb2c-3d8e-4b36-9472-1639324860c2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:32.224244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ec2cb2c-3d8e-4b36-9472-1639324860c2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:32.350896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1ec2cb2c-3d8e-4b36-9472-1639324860c2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:32.359354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1ec2cb2c-3d8e-4b36-9472-1639324860c2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.148540 Aug 24 06:32:32.359924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 799/1592] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:32 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:33.383041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c116cc4c-e89b-40e8-9d74-823697cbc573 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:33.383599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c116cc4c-e89b-40e8-9d74-823697cbc573 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:33.389666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c116cc4c-e89b-40e8-9d74-823697cbc573 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:33.390143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c116cc4c-e89b-40e8-9d74-823697cbc573 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:33.390574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c116cc4c-e89b-40e8-9d74-823697cbc573 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:33.391283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c116cc4c-e89b-40e8-9d74-823697cbc573 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:33.391729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c116cc4c-e89b-40e8-9d74-823697cbc573 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:33.392139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c116cc4c-e89b-40e8-9d74-823697cbc573 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:33.531146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c116cc4c-e89b-40e8-9d74-823697cbc573 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:33.535313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c116cc4c-e89b-40e8-9d74-823697cbc573 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157457 Aug 24 06:32:33.535874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 794/1593] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:33 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:34.556827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-01880747-3230-4348-89b0-a408b31716eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:34.557432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-01880747-3230-4348-89b0-a408b31716eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:34.564153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01880747-3230-4348-89b0-a408b31716eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:34.564674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01880747-3230-4348-89b0-a408b31716eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:34.565115 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01880747-3230-4348-89b0-a408b31716eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:34.565843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01880747-3230-4348-89b0-a408b31716eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:34.566291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01880747-3230-4348-89b0-a408b31716eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:34.566711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01880747-3230-4348-89b0-a408b31716eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:34.698485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-01880747-3230-4348-89b0-a408b31716eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:34.706741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-01880747-3230-4348-89b0-a408b31716eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153793 Aug 24 06:32:34.707311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 800/1594] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:34 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:34.780110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b570d352-a620-4f33-9ba6-69a07499ecee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:34.780627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b570d352-a620-4f33-9ba6-69a07499ecee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:34.786940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b570d352-a620-4f33-9ba6-69a07499ecee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:34.787418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b570d352-a620-4f33-9ba6-69a07499ecee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:34.787872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b570d352-a620-4f33-9ba6-69a07499ecee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:34.788585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b570d352-a620-4f33-9ba6-69a07499ecee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:34.789063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b570d352-a620-4f33-9ba6-69a07499ecee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:34.789482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b570d352-a620-4f33-9ba6-69a07499ecee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:34.813509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b570d352-a620-4f33-9ba6-69a07499ecee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Going to try to terminate instance {{(pid=121150) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:32:35.137135 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b570d352-a620-4f33-9ba6-69a07499ecee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 204 len: 0 microversion: 2.1 time: 0.360449 Aug 24 06:32:35.137716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 795/1595] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:32:34 2022] DELETE /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:32:35.148614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-592f02e6-f413-4dcd-a966-6b3f2621636b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:35.149655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-592f02e6-f413-4dcd-a966-6b3f2621636b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:35.155951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592f02e6-f413-4dcd-a966-6b3f2621636b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:35.156443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592f02e6-f413-4dcd-a966-6b3f2621636b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:35.156880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592f02e6-f413-4dcd-a966-6b3f2621636b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:35.157563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592f02e6-f413-4dcd-a966-6b3f2621636b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:35.158040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592f02e6-f413-4dcd-a966-6b3f2621636b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:35.158453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592f02e6-f413-4dcd-a966-6b3f2621636b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:35.252075 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2ec24969-daec-414f-ace7-90273b5ee17b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:35.252962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2ec24969-daec-414f-ace7-90273b5ee17b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:35.261274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ec24969-daec-414f-ace7-90273b5ee17b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:35.261969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ec24969-daec-414f-ace7-90273b5ee17b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:35.262390 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ec24969-daec-414f-ace7-90273b5ee17b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:35.263434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ec24969-daec-414f-ace7-90273b5ee17b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:35.264430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ec24969-daec-414f-ace7-90273b5ee17b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:35.265056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ec24969-daec-414f-ace7-90273b5ee17b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:35.296074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-592f02e6-f413-4dcd-a966-6b3f2621636b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:35.307331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-592f02e6-f413-4dcd-a966-6b3f2621636b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1727 microversion: 2.1 time: 0.163672 Aug 24 06:32:35.308293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 801/1596] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:35.321163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2ec24969-daec-414f-ace7-90273b5ee17b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Going to try to terminate instance {{(pid=121150) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:32:35.674200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2ec24969-daec-414f-ace7-90273b5ee17b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 204 len: 0 microversion: 2.1 time: 0.426333 Aug 24 06:32:35.674781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 796/1597] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:32:35 2022] DELETE /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:32:35.683847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9d5d7981-8a78-4ce2-b3fe-a7096d3ea356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:35.684453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9d5d7981-8a78-4ce2-b3fe-a7096d3ea356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:35.691407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d5d7981-8a78-4ce2-b3fe-a7096d3ea356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:35.691900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d5d7981-8a78-4ce2-b3fe-a7096d3ea356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:35.692339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d5d7981-8a78-4ce2-b3fe-a7096d3ea356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:35.693093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d5d7981-8a78-4ce2-b3fe-a7096d3ea356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:35.693578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d5d7981-8a78-4ce2-b3fe-a7096d3ea356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:35.694128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d5d7981-8a78-4ce2-b3fe-a7096d3ea356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:35.729630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3fefb28a-e647-4f07-8878-8c7e4b2a4f86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:35.730313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3fefb28a-e647-4f07-8878-8c7e4b2a4f86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:35.736329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fefb28a-e647-4f07-8878-8c7e4b2a4f86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:35.736829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fefb28a-e647-4f07-8878-8c7e4b2a4f86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:35.745790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fefb28a-e647-4f07-8878-8c7e4b2a4f86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:35.745790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fefb28a-e647-4f07-8878-8c7e4b2a4f86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:35.745790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fefb28a-e647-4f07-8878-8c7e4b2a4f86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:35.745790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fefb28a-e647-4f07-8878-8c7e4b2a4f86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:35.826063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9d5d7981-8a78-4ce2-b3fe-a7096d3ea356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:35.836096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9d5d7981-8a78-4ce2-b3fe-a7096d3ea356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155904 Aug 24 06:32:35.836715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 802/1598] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:35 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:35.880544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3fefb28a-e647-4f07-8878-8c7e4b2a4f86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:35.889066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3fefb28a-e647-4f07-8878-8c7e4b2a4f86 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.164131 Aug 24 06:32:35.889726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 797/1599] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:35 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:36.329818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d570cb56-5fae-4c44-a286-12a2a649d26e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:36.330422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d570cb56-5fae-4c44-a286-12a2a649d26e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:36.337288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d570cb56-5fae-4c44-a286-12a2a649d26e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:36.337902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d570cb56-5fae-4c44-a286-12a2a649d26e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:36.338342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d570cb56-5fae-4c44-a286-12a2a649d26e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:36.339042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d570cb56-5fae-4c44-a286-12a2a649d26e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:36.339485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d570cb56-5fae-4c44-a286-12a2a649d26e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:36.339904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d570cb56-5fae-4c44-a286-12a2a649d26e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:36.575917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d570cb56-5fae-4c44-a286-12a2a649d26e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:36.584598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d570cb56-5fae-4c44-a286-12a2a649d26e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1727 microversion: 2.1 time: 0.258737 Aug 24 06:32:36.585378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 803/1600] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:36 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1727 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:36.857385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3b748911-970b-4357-b676-6d0c27703d07 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:36.867241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3b748911-970b-4357-b676-6d0c27703d07 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:36.867241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b748911-970b-4357-b676-6d0c27703d07 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:36.867241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b748911-970b-4357-b676-6d0c27703d07 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:36.867241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b748911-970b-4357-b676-6d0c27703d07 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:36.867664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b748911-970b-4357-b676-6d0c27703d07 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:36.867664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b748911-970b-4357-b676-6d0c27703d07 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:36.867664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b748911-970b-4357-b676-6d0c27703d07 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:36.882511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:32:36.913840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b889c96e-f790-4288-b90e-a370c6155830 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:36.915392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b889c96e-f790-4288-b90e-a370c6155830 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:36.924617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b889c96e-f790-4288-b90e-a370c6155830 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:36.925125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b889c96e-f790-4288-b90e-a370c6155830 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:36.925564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b889c96e-f790-4288-b90e-a370c6155830 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:36.926494 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b889c96e-f790-4288-b90e-a370c6155830 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:36.926951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b889c96e-f790-4288-b90e-a370c6155830 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:36.927373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b889c96e-f790-4288-b90e-a370c6155830 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:37.009290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3b748911-970b-4357-b676-6d0c27703d07 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:37.018510 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3b748911-970b-4357-b676-6d0c27703d07 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164857 Aug 24 06:32:37.019093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 798/1601] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:36 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:37.139375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b889c96e-f790-4288-b90e-a370c6155830 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:37.148875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b889c96e-f790-4288-b90e-a370c6155830 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.241393 Aug 24 06:32:37.162745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 804/1602] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:36 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:37.191369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-af7ed958-f8c8-457e-926c-adb25a289026 req-cc962659-529e-412e-952a-f5cf55d6f83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90ff1952-1000-4510-ac80-d18576f044cb", "name": "network-vif-deleted", "tag": "c4db42a9-a4c7-44d5-9663-2a6ea0296573"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:32:37.202923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-af7ed958-f8c8-457e-926c-adb25a289026 req-cc962659-529e-412e-952a-f5cf55d6f83c service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:37.203684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-af7ed958-f8c8-457e-926c-adb25a289026 req-cc962659-529e-412e-952a-f5cf55d6f83c service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:37.203998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-af7ed958-f8c8-457e-926c-adb25a289026 req-cc962659-529e-412e-952a-f5cf55d6f83c service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:37.218498 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-af7ed958-f8c8-457e-926c-adb25a289026 req-cc962659-529e-412e-952a-f5cf55d6f83c service nova] Creating event network-vif-deleted:c4db42a9-a4c7-44d5-9663-2a6ea0296573 for instance 90ff1952-1000-4510-ac80-d18576f044cb on hv-cinder-85426 Aug 24 06:32:37.230642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-af7ed958-f8c8-457e-926c-adb25a289026 req-cc962659-529e-412e-952a-f5cf55d6f83c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119750 Aug 24 06:32:37.235200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 799/1603] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:32:37.605904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5f25aa3f-6ba8-4078-ba3f-c579764307c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:37.606420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5f25aa3f-6ba8-4078-ba3f-c579764307c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:37.612352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f25aa3f-6ba8-4078-ba3f-c579764307c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:37.612866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f25aa3f-6ba8-4078-ba3f-c579764307c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:37.613294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f25aa3f-6ba8-4078-ba3f-c579764307c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:37.613981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f25aa3f-6ba8-4078-ba3f-c579764307c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:37.614425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f25aa3f-6ba8-4078-ba3f-c579764307c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:37.614840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5f25aa3f-6ba8-4078-ba3f-c579764307c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:37.676428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5f25aa3f-6ba8-4078-ba3f-c579764307c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:37.685801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5f25aa3f-6ba8-4078-ba3f-c579764307c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083871 Aug 24 06:32:37.686381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 805/1604] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:38.041221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-37b11f4e-1d47-4d37-baf0-b8e4990a54d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:38.042109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-37b11f4e-1d47-4d37-baf0-b8e4990a54d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:38.049419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37b11f4e-1d47-4d37-baf0-b8e4990a54d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:38.049906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37b11f4e-1d47-4d37-baf0-b8e4990a54d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:38.050359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37b11f4e-1d47-4d37-baf0-b8e4990a54d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:38.051044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37b11f4e-1d47-4d37-baf0-b8e4990a54d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:38.051688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37b11f4e-1d47-4d37-baf0-b8e4990a54d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:38.052112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37b11f4e-1d47-4d37-baf0-b8e4990a54d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:38.170121 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a840f0b5-403b-49c3-b1b7-80fcf05fdc15 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:38.170737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a840f0b5-403b-49c3-b1b7-80fcf05fdc15 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:38.177312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a840f0b5-403b-49c3-b1b7-80fcf05fdc15 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:38.178530 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a840f0b5-403b-49c3-b1b7-80fcf05fdc15 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:38.178971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a840f0b5-403b-49c3-b1b7-80fcf05fdc15 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:38.179679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a840f0b5-403b-49c3-b1b7-80fcf05fdc15 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:38.180131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a840f0b5-403b-49c3-b1b7-80fcf05fdc15 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:38.180576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a840f0b5-403b-49c3-b1b7-80fcf05fdc15 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:38.193327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-37b11f4e-1d47-4d37-baf0-b8e4990a54d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:38.202312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-37b11f4e-1d47-4d37-baf0-b8e4990a54d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.165482 Aug 24 06:32:38.202877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 800/1605] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:38 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:38.316570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a840f0b5-403b-49c3-b1b7-80fcf05fdc15 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:38.325546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a840f0b5-403b-49c3-b1b7-80fcf05fdc15 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.159348 Aug 24 06:32:38.328759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 806/1606] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:38 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:38.707489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-47322d6d-b7eb-415c-9793-611589151a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:38.708110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-47322d6d-b7eb-415c-9793-611589151a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:38.714294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47322d6d-b7eb-415c-9793-611589151a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:38.714776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47322d6d-b7eb-415c-9793-611589151a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:38.715204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47322d6d-b7eb-415c-9793-611589151a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:38.715892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47322d6d-b7eb-415c-9793-611589151a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:38.716342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47322d6d-b7eb-415c-9793-611589151a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:38.716786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47322d6d-b7eb-415c-9793-611589151a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:38.783233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-47322d6d-b7eb-415c-9793-611589151a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:38.792378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-47322d6d-b7eb-415c-9793-611589151a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089904 Aug 24 06:32:38.792973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 801/1607] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:38 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:39.223343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bf5d515d-c068-4ba9-9053-8080e53627a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:39.223982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bf5d515d-c068-4ba9-9053-8080e53627a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:39.230518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf5d515d-c068-4ba9-9053-8080e53627a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:39.231013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf5d515d-c068-4ba9-9053-8080e53627a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:39.231456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf5d515d-c068-4ba9-9053-8080e53627a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:39.232162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf5d515d-c068-4ba9-9053-8080e53627a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:39.232643 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf5d515d-c068-4ba9-9053-8080e53627a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:39.233071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf5d515d-c068-4ba9-9053-8080e53627a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:39.346166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-68dc2256-47b2-4b13-8faa-e7562e405ad4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:39.346801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-68dc2256-47b2-4b13-8faa-e7562e405ad4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:39.353284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68dc2256-47b2-4b13-8faa-e7562e405ad4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:39.353770 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68dc2256-47b2-4b13-8faa-e7562e405ad4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:39.354209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68dc2256-47b2-4b13-8faa-e7562e405ad4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:39.354951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68dc2256-47b2-4b13-8faa-e7562e405ad4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:39.355351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68dc2256-47b2-4b13-8faa-e7562e405ad4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:39.355768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68dc2256-47b2-4b13-8faa-e7562e405ad4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:39.388377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bf5d515d-c068-4ba9-9053-8080e53627a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:39.395846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bf5d515d-c068-4ba9-9053-8080e53627a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.176412 Aug 24 06:32:39.396436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 807/1608] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:39 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:39.486130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-68dc2256-47b2-4b13-8faa-e7562e405ad4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:39.494276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-68dc2256-47b2-4b13-8faa-e7562e405ad4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151978 Aug 24 06:32:39.494836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 802/1609] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:39 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:39.813965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e7e4252a-30b8-48c6-84aa-391d8b847793 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:39.814495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e7e4252a-30b8-48c6-84aa-391d8b847793 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:39.820531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7e4252a-30b8-48c6-84aa-391d8b847793 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:39.821008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7e4252a-30b8-48c6-84aa-391d8b847793 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:39.821441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7e4252a-30b8-48c6-84aa-391d8b847793 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:39.822134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7e4252a-30b8-48c6-84aa-391d8b847793 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:39.822583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7e4252a-30b8-48c6-84aa-391d8b847793 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:39.823004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e7e4252a-30b8-48c6-84aa-391d8b847793 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:39.885297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e7e4252a-30b8-48c6-84aa-391d8b847793 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:39.893620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e7e4252a-30b8-48c6-84aa-391d8b847793 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083634 Aug 24 06:32:39.894188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 808/1610] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:39 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:40.417373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-744c0714-cb24-44a1-8bc9-883cdb406b7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:40.417962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-744c0714-cb24-44a1-8bc9-883cdb406b7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:40.424376 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-744c0714-cb24-44a1-8bc9-883cdb406b7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:40.424887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-744c0714-cb24-44a1-8bc9-883cdb406b7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:40.425309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-744c0714-cb24-44a1-8bc9-883cdb406b7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:40.425986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-744c0714-cb24-44a1-8bc9-883cdb406b7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:40.426452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-744c0714-cb24-44a1-8bc9-883cdb406b7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:40.426861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-744c0714-cb24-44a1-8bc9-883cdb406b7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:40.515079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1dadea8c-30cf-45d4-b041-22b8ebee8850 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:40.515693 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1dadea8c-30cf-45d4-b041-22b8ebee8850 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:40.522301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1dadea8c-30cf-45d4-b041-22b8ebee8850 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:40.522784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1dadea8c-30cf-45d4-b041-22b8ebee8850 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:40.523219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1dadea8c-30cf-45d4-b041-22b8ebee8850 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:40.523948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1dadea8c-30cf-45d4-b041-22b8ebee8850 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:40.524400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1dadea8c-30cf-45d4-b041-22b8ebee8850 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:40.524849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1dadea8c-30cf-45d4-b041-22b8ebee8850 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:40.556938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-744c0714-cb24-44a1-8bc9-883cdb406b7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:40.565769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-744c0714-cb24-44a1-8bc9-883cdb406b7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.152414 Aug 24 06:32:40.566344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 803/1611] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:40 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:40.654421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1dadea8c-30cf-45d4-b041-22b8ebee8850 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:40.663278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1dadea8c-30cf-45d4-b041-22b8ebee8850 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151996 Aug 24 06:32:40.663851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 809/1612] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:40 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:40.914946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-59ee167e-0abd-4a17-ae4b-ea84025cfec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:40.916232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-59ee167e-0abd-4a17-ae4b-ea84025cfec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:40.923063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59ee167e-0abd-4a17-ae4b-ea84025cfec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:40.923536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59ee167e-0abd-4a17-ae4b-ea84025cfec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:40.923958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59ee167e-0abd-4a17-ae4b-ea84025cfec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:40.924676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59ee167e-0abd-4a17-ae4b-ea84025cfec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:40.925119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59ee167e-0abd-4a17-ae4b-ea84025cfec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:40.925859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-59ee167e-0abd-4a17-ae4b-ea84025cfec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:40.989739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-59ee167e-0abd-4a17-ae4b-ea84025cfec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:40.998333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-59ee167e-0abd-4a17-ae4b-ea84025cfec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087395 Aug 24 06:32:40.998917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 804/1613] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:40 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:41.587581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e5681297-9f45-48f3-b732-811fd75c5d9a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:41.588207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e5681297-9f45-48f3-b732-811fd75c5d9a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:41.594660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5681297-9f45-48f3-b732-811fd75c5d9a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:41.595133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5681297-9f45-48f3-b732-811fd75c5d9a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:41.595556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5681297-9f45-48f3-b732-811fd75c5d9a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:41.596235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5681297-9f45-48f3-b732-811fd75c5d9a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:41.596710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5681297-9f45-48f3-b732-811fd75c5d9a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:41.597122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e5681297-9f45-48f3-b732-811fd75c5d9a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:41.684568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-67b89c3e-ef68-4c55-8cb3-c4bbc1a7cccc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:41.685350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-67b89c3e-ef68-4c55-8cb3-c4bbc1a7cccc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:41.691882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67b89c3e-ef68-4c55-8cb3-c4bbc1a7cccc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:41.692368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67b89c3e-ef68-4c55-8cb3-c4bbc1a7cccc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:41.692842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67b89c3e-ef68-4c55-8cb3-c4bbc1a7cccc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:41.694037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67b89c3e-ef68-4c55-8cb3-c4bbc1a7cccc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:41.694492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67b89c3e-ef68-4c55-8cb3-c4bbc1a7cccc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:41.695004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67b89c3e-ef68-4c55-8cb3-c4bbc1a7cccc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:41.732868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e5681297-9f45-48f3-b732-811fd75c5d9a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:41.741410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e5681297-9f45-48f3-b732-811fd75c5d9a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.158147 Aug 24 06:32:41.741979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 810/1614] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:41 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:41.826062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-67b89c3e-ef68-4c55-8cb3-c4bbc1a7cccc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:41.834184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-67b89c3e-ef68-4c55-8cb3-c4bbc1a7cccc tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153808 Aug 24 06:32:41.834746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 805/1615] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:41 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:42.018460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-74159b4a-d5da-41af-a50b-cd35de410101 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:42.019070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-74159b4a-d5da-41af-a50b-cd35de410101 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:42.025153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74159b4a-d5da-41af-a50b-cd35de410101 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:42.025633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74159b4a-d5da-41af-a50b-cd35de410101 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:42.026066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74159b4a-d5da-41af-a50b-cd35de410101 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:42.026759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74159b4a-d5da-41af-a50b-cd35de410101 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:42.027210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74159b4a-d5da-41af-a50b-cd35de410101 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:42.027632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-74159b4a-d5da-41af-a50b-cd35de410101 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:42.088514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-74159b4a-d5da-41af-a50b-cd35de410101 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:42.090685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:32:42.097462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-74159b4a-d5da-41af-a50b-cd35de410101 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082837 Aug 24 06:32:42.098031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 811/1616] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:42 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:42.762984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b6e61168-b3d9-4f39-9096-016bf8c972e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:42.763576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b6e61168-b3d9-4f39-9096-016bf8c972e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:42.765996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:32:42.770652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6e61168-b3d9-4f39-9096-016bf8c972e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:42.771124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6e61168-b3d9-4f39-9096-016bf8c972e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:42.772036 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6e61168-b3d9-4f39-9096-016bf8c972e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:42.772750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6e61168-b3d9-4f39-9096-016bf8c972e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:42.773194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6e61168-b3d9-4f39-9096-016bf8c972e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:42.773610 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6e61168-b3d9-4f39-9096-016bf8c972e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:42.856118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e99c49c2-1c8b-497f-8a93-2ff27147074e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:42.856985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e99c49c2-1c8b-497f-8a93-2ff27147074e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:42.863764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e99c49c2-1c8b-497f-8a93-2ff27147074e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:42.864239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e99c49c2-1c8b-497f-8a93-2ff27147074e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:42.864724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e99c49c2-1c8b-497f-8a93-2ff27147074e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:42.865430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e99c49c2-1c8b-497f-8a93-2ff27147074e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:42.865877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e99c49c2-1c8b-497f-8a93-2ff27147074e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:42.866301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e99c49c2-1c8b-497f-8a93-2ff27147074e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:42.902600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b6e61168-b3d9-4f39-9096-016bf8c972e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:42.911020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b6e61168-b3d9-4f39-9096-016bf8c972e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151877 Aug 24 06:32:42.911718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 806/1617] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:42 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:42.996123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e99c49c2-1c8b-497f-8a93-2ff27147074e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:43.004550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e99c49c2-1c8b-497f-8a93-2ff27147074e tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152657 Aug 24 06:32:43.005149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 812/1618] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:42 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:43.125400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-23a4c0c3-5f9a-44d4-9745-aec493bded1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:43.126004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-23a4c0c3-5f9a-44d4-9745-aec493bded1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:43.132413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23a4c0c3-5f9a-44d4-9745-aec493bded1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:43.132912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23a4c0c3-5f9a-44d4-9745-aec493bded1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:43.133337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23a4c0c3-5f9a-44d4-9745-aec493bded1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:43.134014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23a4c0c3-5f9a-44d4-9745-aec493bded1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:43.134454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23a4c0c3-5f9a-44d4-9745-aec493bded1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:43.134864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23a4c0c3-5f9a-44d4-9745-aec493bded1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:43.197521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-23a4c0c3-5f9a-44d4-9745-aec493bded1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:43.205575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-23a4c0c3-5f9a-44d4-9745-aec493bded1b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084004 Aug 24 06:32:43.206193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 807/1619] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:43 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:43.932642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2dc51f0b-84db-47ec-8a12-fd36a460d561 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:43.933246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2dc51f0b-84db-47ec-8a12-fd36a460d561 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:43.939951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2dc51f0b-84db-47ec-8a12-fd36a460d561 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:43.940424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2dc51f0b-84db-47ec-8a12-fd36a460d561 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:43.940886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2dc51f0b-84db-47ec-8a12-fd36a460d561 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:43.941577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2dc51f0b-84db-47ec-8a12-fd36a460d561 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:43.942028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2dc51f0b-84db-47ec-8a12-fd36a460d561 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:43.942447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2dc51f0b-84db-47ec-8a12-fd36a460d561 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:44.026892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3dec1120-3f63-4501-8e4c-00c83cf11259 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:44.027492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3dec1120-3f63-4501-8e4c-00c83cf11259 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:44.034191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3dec1120-3f63-4501-8e4c-00c83cf11259 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:44.034668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3dec1120-3f63-4501-8e4c-00c83cf11259 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:44.035095 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3dec1120-3f63-4501-8e4c-00c83cf11259 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:44.035783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3dec1120-3f63-4501-8e4c-00c83cf11259 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:44.036224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3dec1120-3f63-4501-8e4c-00c83cf11259 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:44.036674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3dec1120-3f63-4501-8e4c-00c83cf11259 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:44.077684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2dc51f0b-84db-47ec-8a12-fd36a460d561 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:44.086195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2dc51f0b-84db-47ec-8a12-fd36a460d561 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157385 Aug 24 06:32:44.086978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 813/1620] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:43 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:44.169510 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3dec1120-3f63-4501-8e4c-00c83cf11259 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:44.177627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3dec1120-3f63-4501-8e4c-00c83cf11259 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154561 Aug 24 06:32:44.178192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 808/1621] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:44 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:44.227469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b9f36bc3-636c-4a8d-9931-51b8055be3ab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:44.228108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b9f36bc3-636c-4a8d-9931-51b8055be3ab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:44.234054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9f36bc3-636c-4a8d-9931-51b8055be3ab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:44.234534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9f36bc3-636c-4a8d-9931-51b8055be3ab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:44.235087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9f36bc3-636c-4a8d-9931-51b8055be3ab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:44.235780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9f36bc3-636c-4a8d-9931-51b8055be3ab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:44.236228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9f36bc3-636c-4a8d-9931-51b8055be3ab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:44.236685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9f36bc3-636c-4a8d-9931-51b8055be3ab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:44.298745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b9f36bc3-636c-4a8d-9931-51b8055be3ab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:44.306998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b9f36bc3-636c-4a8d-9931-51b8055be3ab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083992 Aug 24 06:32:44.307574 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 814/1622] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:44 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:45.107049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2d852b95-d277-4d7e-8a13-b849babbd9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:45.107652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2d852b95-d277-4d7e-8a13-b849babbd9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:45.114087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d852b95-d277-4d7e-8a13-b849babbd9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:45.114559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d852b95-d277-4d7e-8a13-b849babbd9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:45.114982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d852b95-d277-4d7e-8a13-b849babbd9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:45.116150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d852b95-d277-4d7e-8a13-b849babbd9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:45.116624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d852b95-d277-4d7e-8a13-b849babbd9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:45.117041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d852b95-d277-4d7e-8a13-b849babbd9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:45.198963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4b0f1965-f644-4cde-8520-340d7c357c53 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:45.199577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4b0f1965-f644-4cde-8520-340d7c357c53 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:45.206247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b0f1965-f644-4cde-8520-340d7c357c53 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:45.206731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b0f1965-f644-4cde-8520-340d7c357c53 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:45.207201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b0f1965-f644-4cde-8520-340d7c357c53 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:45.207905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b0f1965-f644-4cde-8520-340d7c357c53 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:45.208356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b0f1965-f644-4cde-8520-340d7c357c53 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:45.208805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b0f1965-f644-4cde-8520-340d7c357c53 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:45.247035 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2d852b95-d277-4d7e-8a13-b849babbd9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:45.256006 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2d852b95-d277-4d7e-8a13-b849babbd9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.152764 Aug 24 06:32:45.256614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 809/1623] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:45 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:45.328880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-77d12452-ab46-4c6a-acc6-461f4e2c5c28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:45.329494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-77d12452-ab46-4c6a-acc6-461f4e2c5c28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:45.335919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77d12452-ab46-4c6a-acc6-461f4e2c5c28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:45.336404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77d12452-ab46-4c6a-acc6-461f4e2c5c28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:45.336875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77d12452-ab46-4c6a-acc6-461f4e2c5c28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:45.337603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77d12452-ab46-4c6a-acc6-461f4e2c5c28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:45.338052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77d12452-ab46-4c6a-acc6-461f4e2c5c28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:45.338474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77d12452-ab46-4c6a-acc6-461f4e2c5c28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:45.344044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4b0f1965-f644-4cde-8520-340d7c357c53 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:45.352889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4b0f1965-f644-4cde-8520-340d7c357c53 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157699 Aug 24 06:32:45.353488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 815/1624] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:45 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:45.399706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-77d12452-ab46-4c6a-acc6-461f4e2c5c28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:45.408102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-77d12452-ab46-4c6a-acc6-461f4e2c5c28 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083199 Aug 24 06:32:45.408693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 810/1625] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:45 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:46.277638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1ae9da38-57c5-4c6a-b4bc-32b27b31941a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:46.278251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1ae9da38-57c5-4c6a-b4bc-32b27b31941a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:46.284781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ae9da38-57c5-4c6a-b4bc-32b27b31941a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:46.285260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ae9da38-57c5-4c6a-b4bc-32b27b31941a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:46.285693 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ae9da38-57c5-4c6a-b4bc-32b27b31941a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:46.286381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ae9da38-57c5-4c6a-b4bc-32b27b31941a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:46.286829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ae9da38-57c5-4c6a-b4bc-32b27b31941a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:46.287893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ae9da38-57c5-4c6a-b4bc-32b27b31941a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:46.374834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6fc0d7e3-5cf5-487b-8cb8-7c5916133dc2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:46.375445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6fc0d7e3-5cf5-487b-8cb8-7c5916133dc2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:46.381968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fc0d7e3-5cf5-487b-8cb8-7c5916133dc2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:46.382441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fc0d7e3-5cf5-487b-8cb8-7c5916133dc2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:46.382863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fc0d7e3-5cf5-487b-8cb8-7c5916133dc2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:46.383545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fc0d7e3-5cf5-487b-8cb8-7c5916133dc2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:46.383989 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fc0d7e3-5cf5-487b-8cb8-7c5916133dc2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:46.384400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6fc0d7e3-5cf5-487b-8cb8-7c5916133dc2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:46.423523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1ae9da38-57c5-4c6a-b4bc-32b27b31941a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:46.432725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1ae9da38-57c5-4c6a-b4bc-32b27b31941a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.159158 Aug 24 06:32:46.433311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 816/1626] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:46 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:46.438214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c00970e6-9d76-47b2-8e2c-ba9bc726ef1d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:46.446132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c00970e6-9d76-47b2-8e2c-ba9bc726ef1d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:46.446132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c00970e6-9d76-47b2-8e2c-ba9bc726ef1d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:46.446132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c00970e6-9d76-47b2-8e2c-ba9bc726ef1d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:46.446498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c00970e6-9d76-47b2-8e2c-ba9bc726ef1d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:46.446870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c00970e6-9d76-47b2-8e2c-ba9bc726ef1d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:46.447308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c00970e6-9d76-47b2-8e2c-ba9bc726ef1d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:46.447729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c00970e6-9d76-47b2-8e2c-ba9bc726ef1d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:46.512292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c00970e6-9d76-47b2-8e2c-ba9bc726ef1d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:46.520029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6fc0d7e3-5cf5-487b-8cb8-7c5916133dc2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:46.520732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c00970e6-9d76-47b2-8e2c-ba9bc726ef1d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086121 Aug 24 06:32:46.521936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 817/1627] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:46.529455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6fc0d7e3-5cf5-487b-8cb8-7c5916133dc2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158410 Aug 24 06:32:46.529912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 811/1628] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:46 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:47.454237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5277293f-9c51-496d-8282-25aa0b4e3f6c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:47.454891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5277293f-9c51-496d-8282-25aa0b4e3f6c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:47.461178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5277293f-9c51-496d-8282-25aa0b4e3f6c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:47.461664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5277293f-9c51-496d-8282-25aa0b4e3f6c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:47.462100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5277293f-9c51-496d-8282-25aa0b4e3f6c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:47.462810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5277293f-9c51-496d-8282-25aa0b4e3f6c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:47.463265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5277293f-9c51-496d-8282-25aa0b4e3f6c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:47.463688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5277293f-9c51-496d-8282-25aa0b4e3f6c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:47.542023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2d014fc7-3815-48dc-b2d5-ec274f9107b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:47.542619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2d014fc7-3815-48dc-b2d5-ec274f9107b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:47.549498 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d014fc7-3815-48dc-b2d5-ec274f9107b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:47.550176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d014fc7-3815-48dc-b2d5-ec274f9107b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:47.550602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d014fc7-3815-48dc-b2d5-ec274f9107b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:47.551298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d014fc7-3815-48dc-b2d5-ec274f9107b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:47.551745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d014fc7-3815-48dc-b2d5-ec274f9107b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:47.552157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d014fc7-3815-48dc-b2d5-ec274f9107b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:47.594938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5277293f-9c51-496d-8282-25aa0b4e3f6c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:47.604122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5277293f-9c51-496d-8282-25aa0b4e3f6c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154001 Aug 24 06:32:47.604721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 818/1629] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:47 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:47.609162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-21c3a113-df08-47be-a1cd-fc48b5344369 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:47.609813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-21c3a113-df08-47be-a1cd-fc48b5344369 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:47.616258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21c3a113-df08-47be-a1cd-fc48b5344369 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:47.616767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21c3a113-df08-47be-a1cd-fc48b5344369 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:47.617197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21c3a113-df08-47be-a1cd-fc48b5344369 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:47.617334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2d014fc7-3815-48dc-b2d5-ec274f9107b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:47.617887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21c3a113-df08-47be-a1cd-fc48b5344369 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:47.618523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21c3a113-df08-47be-a1cd-fc48b5344369 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:47.618942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-21c3a113-df08-47be-a1cd-fc48b5344369 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:47.625832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2d014fc7-3815-48dc-b2d5-ec274f9107b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087673 Aug 24 06:32:47.626414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 812/1630] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:47.752485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-21c3a113-df08-47be-a1cd-fc48b5344369 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:47.760786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-21c3a113-df08-47be-a1cd-fc48b5344369 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155097 Aug 24 06:32:47.761350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 819/1631] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:47 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:48.625383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-90e4fed4-2a60-4aa7-8506-c4617b72124a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:48.626031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-90e4fed4-2a60-4aa7-8506-c4617b72124a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:48.633100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90e4fed4-2a60-4aa7-8506-c4617b72124a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:48.633583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90e4fed4-2a60-4aa7-8506-c4617b72124a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:48.634016 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90e4fed4-2a60-4aa7-8506-c4617b72124a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:48.634707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90e4fed4-2a60-4aa7-8506-c4617b72124a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:48.635156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90e4fed4-2a60-4aa7-8506-c4617b72124a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:48.635577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-90e4fed4-2a60-4aa7-8506-c4617b72124a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:48.646650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-731a55e8-e272-43a5-b349-d899d2f4145e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:48.647257 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-731a55e8-e272-43a5-b349-d899d2f4145e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:48.653679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-731a55e8-e272-43a5-b349-d899d2f4145e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:48.654161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-731a55e8-e272-43a5-b349-d899d2f4145e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:48.654592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-731a55e8-e272-43a5-b349-d899d2f4145e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:48.655284 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-731a55e8-e272-43a5-b349-d899d2f4145e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:48.655732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-731a55e8-e272-43a5-b349-d899d2f4145e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:48.656151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-731a55e8-e272-43a5-b349-d899d2f4145e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:48.726022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-731a55e8-e272-43a5-b349-d899d2f4145e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:48.733407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-731a55e8-e272-43a5-b349-d899d2f4145e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.090473 Aug 24 06:32:48.733999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 820/1632] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:48.768854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-90e4fed4-2a60-4aa7-8506-c4617b72124a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:48.777280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-90e4fed4-2a60-4aa7-8506-c4617b72124a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155615 Aug 24 06:32:48.777888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 813/1633] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:48 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:48.782229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1710a6df-8c5d-4774-932e-9709450a8f3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:48.782830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1710a6df-8c5d-4774-932e-9709450a8f3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:48.788986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1710a6df-8c5d-4774-932e-9709450a8f3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:48.789462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1710a6df-8c5d-4774-932e-9709450a8f3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:48.789891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1710a6df-8c5d-4774-932e-9709450a8f3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:48.790571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1710a6df-8c5d-4774-932e-9709450a8f3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:48.791041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1710a6df-8c5d-4774-932e-9709450a8f3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:48.791477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1710a6df-8c5d-4774-932e-9709450a8f3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:48.923139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1710a6df-8c5d-4774-932e-9709450a8f3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:48.931957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1710a6df-8c5d-4774-932e-9709450a8f3f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153579 Aug 24 06:32:48.932539 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 821/1634] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:48 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:49.755357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8747523e-715b-40aa-9722-f780dc336d21 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:49.755945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8747523e-715b-40aa-9722-f780dc336d21 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:49.762373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8747523e-715b-40aa-9722-f780dc336d21 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:49.762844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8747523e-715b-40aa-9722-f780dc336d21 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:49.763272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8747523e-715b-40aa-9722-f780dc336d21 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:49.763950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8747523e-715b-40aa-9722-f780dc336d21 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:49.764396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8747523e-715b-40aa-9722-f780dc336d21 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:49.764832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8747523e-715b-40aa-9722-f780dc336d21 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:49.798405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4083aa40-f7af-42e9-90c2-2c8aecd9071b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:49.799088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4083aa40-f7af-42e9-90c2-2c8aecd9071b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:49.806375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4083aa40-f7af-42e9-90c2-2c8aecd9071b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:49.806854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4083aa40-f7af-42e9-90c2-2c8aecd9071b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:49.807282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4083aa40-f7af-42e9-90c2-2c8aecd9071b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:49.807973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4083aa40-f7af-42e9-90c2-2c8aecd9071b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:49.808413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4083aa40-f7af-42e9-90c2-2c8aecd9071b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:49.809124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4083aa40-f7af-42e9-90c2-2c8aecd9071b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:49.833366 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8747523e-715b-40aa-9722-f780dc336d21 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:49.841729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8747523e-715b-40aa-9722-f780dc336d21 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.090158 Aug 24 06:32:49.842300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 814/1635] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:49 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:49.942504 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4083aa40-f7af-42e9-90c2-2c8aecd9071b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:49.951092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4083aa40-f7af-42e9-90c2-2c8aecd9071b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.156432 Aug 24 06:32:49.951672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 822/1636] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:49 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:49.953390 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f56dea8c-dc4f-4091-8e20-f8c3e7c88c5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:49.954032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f56dea8c-dc4f-4091-8e20-f8c3e7c88c5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:49.959971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f56dea8c-dc4f-4091-8e20-f8c3e7c88c5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:49.960381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f56dea8c-dc4f-4091-8e20-f8c3e7c88c5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:49.960998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f56dea8c-dc4f-4091-8e20-f8c3e7c88c5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:49.961686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f56dea8c-dc4f-4091-8e20-f8c3e7c88c5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:49.962126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f56dea8c-dc4f-4091-8e20-f8c3e7c88c5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:49.962580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f56dea8c-dc4f-4091-8e20-f8c3e7c88c5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:50.094987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f56dea8c-dc4f-4091-8e20-f8c3e7c88c5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:50.097251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:32:50.104736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f56dea8c-dc4f-4091-8e20-f8c3e7c88c5b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155227 Aug 24 06:32:50.105312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 815/1637] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:49 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:50.863191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a8be4a8c-9580-4836-bc10-d449e940066c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:50.863791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a8be4a8c-9580-4836-bc10-d449e940066c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:50.866856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=58 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:32:50.871682 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8be4a8c-9580-4836-bc10-d449e940066c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:50.872164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8be4a8c-9580-4836-bc10-d449e940066c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:50.872625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8be4a8c-9580-4836-bc10-d449e940066c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:50.887664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8be4a8c-9580-4836-bc10-d449e940066c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:50.887664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8be4a8c-9580-4836-bc10-d449e940066c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:50.887664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8be4a8c-9580-4836-bc10-d449e940066c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:50.938424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a8be4a8c-9580-4836-bc10-d449e940066c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:50.947804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a8be4a8c-9580-4836-bc10-d449e940066c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088432 Aug 24 06:32:50.948387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 823/1638] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:50.973170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-93f0d8cc-5895-4ded-a5ce-4a8f9aaf9318 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:50.973170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-93f0d8cc-5895-4ded-a5ce-4a8f9aaf9318 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:50.980807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93f0d8cc-5895-4ded-a5ce-4a8f9aaf9318 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:50.988288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93f0d8cc-5895-4ded-a5ce-4a8f9aaf9318 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:50.988288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93f0d8cc-5895-4ded-a5ce-4a8f9aaf9318 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:50.988288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93f0d8cc-5895-4ded-a5ce-4a8f9aaf9318 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:50.988288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93f0d8cc-5895-4ded-a5ce-4a8f9aaf9318 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:50.988776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93f0d8cc-5895-4ded-a5ce-4a8f9aaf9318 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:51.114701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-93f0d8cc-5895-4ded-a5ce-4a8f9aaf9318 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:51.123382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-93f0d8cc-5895-4ded-a5ce-4a8f9aaf9318 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154807 Aug 24 06:32:51.123929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 816/1639] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:50 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:51.126085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-54afe84e-0475-4ff6-9bca-2e3f06ee73f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:51.126845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-54afe84e-0475-4ff6-9bca-2e3f06ee73f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:51.133506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54afe84e-0475-4ff6-9bca-2e3f06ee73f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:51.133990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54afe84e-0475-4ff6-9bca-2e3f06ee73f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:51.134428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54afe84e-0475-4ff6-9bca-2e3f06ee73f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:51.135123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54afe84e-0475-4ff6-9bca-2e3f06ee73f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:51.135576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54afe84e-0475-4ff6-9bca-2e3f06ee73f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:51.136000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54afe84e-0475-4ff6-9bca-2e3f06ee73f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:51.264929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-54afe84e-0475-4ff6-9bca-2e3f06ee73f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:51.273103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-54afe84e-0475-4ff6-9bca-2e3f06ee73f4 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.151114 Aug 24 06:32:51.273669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 824/1640] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:51 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:51.968849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d2d0fad2-077a-415e-b388-e517d7a6fa1c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:51.969372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d2d0fad2-077a-415e-b388-e517d7a6fa1c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:51.975840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d2d0fad2-077a-415e-b388-e517d7a6fa1c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:51.976431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d2d0fad2-077a-415e-b388-e517d7a6fa1c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:51.976756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d2d0fad2-077a-415e-b388-e517d7a6fa1c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:51.977436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d2d0fad2-077a-415e-b388-e517d7a6fa1c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:51.977884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d2d0fad2-077a-415e-b388-e517d7a6fa1c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:51.978303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d2d0fad2-077a-415e-b388-e517d7a6fa1c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:52.044533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d2d0fad2-077a-415e-b388-e517d7a6fa1c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:52.053434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d2d0fad2-077a-415e-b388-e517d7a6fa1c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087836 Aug 24 06:32:52.053995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 817/1641] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:52.145241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-458b64c2-7304-4ddf-b6ff-515783c6339d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:52.145847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-458b64c2-7304-4ddf-b6ff-515783c6339d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:52.152560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-458b64c2-7304-4ddf-b6ff-515783c6339d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:52.153047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-458b64c2-7304-4ddf-b6ff-515783c6339d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:52.153481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-458b64c2-7304-4ddf-b6ff-515783c6339d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:52.154187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-458b64c2-7304-4ddf-b6ff-515783c6339d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:52.154638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-458b64c2-7304-4ddf-b6ff-515783c6339d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:52.155053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-458b64c2-7304-4ddf-b6ff-515783c6339d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:52.294164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d5d210a6-300e-4e2a-9bff-06f060d7f482 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:52.294779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d5d210a6-300e-4e2a-9bff-06f060d7f482 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:52.298054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-458b64c2-7304-4ddf-b6ff-515783c6339d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:52.300820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5d210a6-300e-4e2a-9bff-06f060d7f482 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:52.301413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5d210a6-300e-4e2a-9bff-06f060d7f482 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:52.301850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5d210a6-300e-4e2a-9bff-06f060d7f482 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:52.302561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5d210a6-300e-4e2a-9bff-06f060d7f482 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:52.303010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5d210a6-300e-4e2a-9bff-06f060d7f482 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:52.303435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d5d210a6-300e-4e2a-9bff-06f060d7f482 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:52.306562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-458b64c2-7304-4ddf-b6ff-515783c6339d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.165178 Aug 24 06:32:52.307469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 825/1642] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:52 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:52.430764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d5d210a6-300e-4e2a-9bff-06f060d7f482 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:52.439736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d5d210a6-300e-4e2a-9bff-06f060d7f482 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.149391 Aug 24 06:32:52.440329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 818/1643] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:52 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:53.074989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-12e99f98-463b-45a6-ae28-d7ede461245d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:53.075594 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-12e99f98-463b-45a6-ae28-d7ede461245d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:53.081533 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12e99f98-463b-45a6-ae28-d7ede461245d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:53.082005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12e99f98-463b-45a6-ae28-d7ede461245d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:53.082433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12e99f98-463b-45a6-ae28-d7ede461245d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:53.083117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12e99f98-463b-45a6-ae28-d7ede461245d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:53.083576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12e99f98-463b-45a6-ae28-d7ede461245d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:53.083996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12e99f98-463b-45a6-ae28-d7ede461245d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:53.144386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-12e99f98-463b-45a6-ae28-d7ede461245d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:53.153040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-12e99f98-463b-45a6-ae28-d7ede461245d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.081914 Aug 24 06:32:53.153628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 826/1644] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:53.327317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c6323539-4df5-4343-a248-c436033d5e7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:53.327873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c6323539-4df5-4343-a248-c436033d5e7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:53.334325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6323539-4df5-4343-a248-c436033d5e7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:53.334801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6323539-4df5-4343-a248-c436033d5e7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:53.335229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6323539-4df5-4343-a248-c436033d5e7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:53.335911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6323539-4df5-4343-a248-c436033d5e7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:53.336357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6323539-4df5-4343-a248-c436033d5e7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:53.336803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6323539-4df5-4343-a248-c436033d5e7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:53.460761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-12da8442-dc92-4460-9af9-43acdd319f4f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:53.461294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-12da8442-dc92-4460-9af9-43acdd319f4f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:53.463112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c6323539-4df5-4343-a248-c436033d5e7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:53.467342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12da8442-dc92-4460-9af9-43acdd319f4f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:53.467818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12da8442-dc92-4460-9af9-43acdd319f4f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:53.468246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12da8442-dc92-4460-9af9-43acdd319f4f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:53.468958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12da8442-dc92-4460-9af9-43acdd319f4f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:53.469406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12da8442-dc92-4460-9af9-43acdd319f4f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:53.469820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-12da8442-dc92-4460-9af9-43acdd319f4f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:53.471343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c6323539-4df5-4343-a248-c436033d5e7f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.147991 Aug 24 06:32:53.471910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 819/1645] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:53 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:53.606654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-12da8442-dc92-4460-9af9-43acdd319f4f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:53.615586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-12da8442-dc92-4460-9af9-43acdd319f4f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.158196 Aug 24 06:32:53.623100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 827/1646] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:53 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:54.173954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f9f2a62b-f92a-46e4-b480-258cbdfbe5a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:54.174618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f9f2a62b-f92a-46e4-b480-258cbdfbe5a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:54.180772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9f2a62b-f92a-46e4-b480-258cbdfbe5a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:54.181248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9f2a62b-f92a-46e4-b480-258cbdfbe5a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:54.181674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9f2a62b-f92a-46e4-b480-258cbdfbe5a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:54.182358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9f2a62b-f92a-46e4-b480-258cbdfbe5a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:54.182804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9f2a62b-f92a-46e4-b480-258cbdfbe5a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:54.183221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9f2a62b-f92a-46e4-b480-258cbdfbe5a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:54.248801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f9f2a62b-f92a-46e4-b480-258cbdfbe5a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:54.257158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f9f2a62b-f92a-46e4-b480-258cbdfbe5a3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087110 Aug 24 06:32:54.257718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 820/1647] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:54.493228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7f13d64b-497a-45c6-9f31-60b9044b47fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:54.493795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7f13d64b-497a-45c6-9f31-60b9044b47fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:54.500159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f13d64b-497a-45c6-9f31-60b9044b47fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:54.500663 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f13d64b-497a-45c6-9f31-60b9044b47fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:54.501089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f13d64b-497a-45c6-9f31-60b9044b47fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:54.501769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f13d64b-497a-45c6-9f31-60b9044b47fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:54.502218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f13d64b-497a-45c6-9f31-60b9044b47fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:54.502628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f13d64b-497a-45c6-9f31-60b9044b47fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:54.517376 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:32:54.629524 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7f13d64b-497a-45c6-9f31-60b9044b47fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:54.636383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b435b165-e8eb-46ce-9686-bd9159782822 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:54.637056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b435b165-e8eb-46ce-9686-bd9159782822 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:54.637918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7f13d64b-497a-45c6-9f31-60b9044b47fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.149153 Aug 24 06:32:54.638515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 828/1648] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:54 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:54.643728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b435b165-e8eb-46ce-9686-bd9159782822 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:54.644234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b435b165-e8eb-46ce-9686-bd9159782822 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:54.644695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b435b165-e8eb-46ce-9686-bd9159782822 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:54.645400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b435b165-e8eb-46ce-9686-bd9159782822 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:54.645848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b435b165-e8eb-46ce-9686-bd9159782822 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:54.646764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b435b165-e8eb-46ce-9686-bd9159782822 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:54.775065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b435b165-e8eb-46ce-9686-bd9159782822 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:54.783247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b435b165-e8eb-46ce-9686-bd9159782822 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.150713 Aug 24 06:32:54.783821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 821/1649] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:54 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:55.278133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-34b1092e-649e-48a8-a676-74107407f770 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:55.278742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-34b1092e-649e-48a8-a676-74107407f770 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:55.284939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34b1092e-649e-48a8-a676-74107407f770 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:55.285424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34b1092e-649e-48a8-a676-74107407f770 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:55.285889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34b1092e-649e-48a8-a676-74107407f770 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:55.286612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34b1092e-649e-48a8-a676-74107407f770 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:55.287067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34b1092e-649e-48a8-a676-74107407f770 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:55.287490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34b1092e-649e-48a8-a676-74107407f770 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:55.348131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-34b1092e-649e-48a8-a676-74107407f770 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:55.356883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-34b1092e-649e-48a8-a676-74107407f770 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082745 Aug 24 06:32:55.357399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 829/1650] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:55 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:55.659624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a01f5f9a-1768-442e-a4eb-a92acfaaa9ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:55.660165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a01f5f9a-1768-442e-a4eb-a92acfaaa9ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:55.667136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a01f5f9a-1768-442e-a4eb-a92acfaaa9ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:55.667611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a01f5f9a-1768-442e-a4eb-a92acfaaa9ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:55.668038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a01f5f9a-1768-442e-a4eb-a92acfaaa9ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:55.668749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a01f5f9a-1768-442e-a4eb-a92acfaaa9ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:55.669198 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a01f5f9a-1768-442e-a4eb-a92acfaaa9ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:55.669611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a01f5f9a-1768-442e-a4eb-a92acfaaa9ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:55.798050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a01f5f9a-1768-442e-a4eb-a92acfaaa9ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:55.805816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-902e631b-566c-44a0-91a0-a9de55705452 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:55.806580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-902e631b-566c-44a0-91a0-a9de55705452 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:55.807109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a01f5f9a-1768-442e-a4eb-a92acfaaa9ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151394 Aug 24 06:32:55.807686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 822/1651] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:55 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:55.813385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-902e631b-566c-44a0-91a0-a9de55705452 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:55.813864 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-902e631b-566c-44a0-91a0-a9de55705452 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:55.814292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-902e631b-566c-44a0-91a0-a9de55705452 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:55.814978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-902e631b-566c-44a0-91a0-a9de55705452 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:55.815430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-902e631b-566c-44a0-91a0-a9de55705452 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:55.815839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-902e631b-566c-44a0-91a0-a9de55705452 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:55.949034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-902e631b-566c-44a0-91a0-a9de55705452 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:55.957284 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-902e631b-566c-44a0-91a0-a9de55705452 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155817 Aug 24 06:32:55.958254 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 830/1652] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:55 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:32:56.379002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-35a08b3c-1056-4f6e-91f2-ff99633cb996 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:56.379545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-35a08b3c-1056-4f6e-91f2-ff99633cb996 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:56.385907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35a08b3c-1056-4f6e-91f2-ff99633cb996 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:56.386377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35a08b3c-1056-4f6e-91f2-ff99633cb996 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:56.386811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35a08b3c-1056-4f6e-91f2-ff99633cb996 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:56.387469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35a08b3c-1056-4f6e-91f2-ff99633cb996 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:56.387909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35a08b3c-1056-4f6e-91f2-ff99633cb996 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:56.388320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-35a08b3c-1056-4f6e-91f2-ff99633cb996 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:56.451365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-35a08b3c-1056-4f6e-91f2-ff99633cb996 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:56.459459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-35a08b3c-1056-4f6e-91f2-ff99633cb996 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084510 Aug 24 06:32:56.467159 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 823/1653] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:56.828711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4869be8b-e438-4979-8e98-868007b5c854 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:56.829334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4869be8b-e438-4979-8e98-868007b5c854 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:56.835975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4869be8b-e438-4979-8e98-868007b5c854 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:56.836457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4869be8b-e438-4979-8e98-868007b5c854 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:56.836968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4869be8b-e438-4979-8e98-868007b5c854 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:56.837735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4869be8b-e438-4979-8e98-868007b5c854 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:56.838137 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4869be8b-e438-4979-8e98-868007b5c854 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:56.838560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4869be8b-e438-4979-8e98-868007b5c854 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:56.965072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4869be8b-e438-4979-8e98-868007b5c854 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:56.973158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4869be8b-e438-4979-8e98-868007b5c854 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.148350 Aug 24 06:32:56.974487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 831/1654] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:56 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:56.978998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-40e41bd1-00c3-4669-aae6-e1b188ae0453 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:56.979598 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-40e41bd1-00c3-4669-aae6-e1b188ae0453 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:56.987077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40e41bd1-00c3-4669-aae6-e1b188ae0453 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:56.987077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40e41bd1-00c3-4669-aae6-e1b188ae0453 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:56.987359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40e41bd1-00c3-4669-aae6-e1b188ae0453 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:56.987926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40e41bd1-00c3-4669-aae6-e1b188ae0453 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:56.988525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40e41bd1-00c3-4669-aae6-e1b188ae0453 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:56.988957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40e41bd1-00c3-4669-aae6-e1b188ae0453 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:57.122140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-40e41bd1-00c3-4669-aae6-e1b188ae0453 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:57.130563 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-40e41bd1-00c3-4669-aae6-e1b188ae0453 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155332 Aug 24 06:32:57.131141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 824/1655] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:56 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:57.485342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7c642996-dd2c-4024-b8fd-01f4dae3be19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:57.485980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7c642996-dd2c-4024-b8fd-01f4dae3be19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:57.491986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c642996-dd2c-4024-b8fd-01f4dae3be19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:57.492480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c642996-dd2c-4024-b8fd-01f4dae3be19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:57.492948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c642996-dd2c-4024-b8fd-01f4dae3be19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:57.493659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c642996-dd2c-4024-b8fd-01f4dae3be19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:57.494106 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c642996-dd2c-4024-b8fd-01f4dae3be19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:57.494527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c642996-dd2c-4024-b8fd-01f4dae3be19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:57.557361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7c642996-dd2c-4024-b8fd-01f4dae3be19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:57.565949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7c642996-dd2c-4024-b8fd-01f4dae3be19 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084485 Aug 24 06:32:57.566514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 832/1656] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:57 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:57.995146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7c099e18-def3-4586-8556-cbb343faf2ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:57.995756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7c099e18-def3-4586-8556-cbb343faf2ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:58.002470 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c099e18-def3-4586-8556-cbb343faf2ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:58.002947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c099e18-def3-4586-8556-cbb343faf2ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:58.003380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c099e18-def3-4586-8556-cbb343faf2ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:58.004079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c099e18-def3-4586-8556-cbb343faf2ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:58.004553 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c099e18-def3-4586-8556-cbb343faf2ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:58.004976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c099e18-def3-4586-8556-cbb343faf2ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:58.134346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7c099e18-def3-4586-8556-cbb343faf2ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:58.142575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7c099e18-def3-4586-8556-cbb343faf2ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151381 Aug 24 06:32:58.143145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 825/1657] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:57 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:58.151611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-94f1cda8-649b-4a31-8988-e2f030c5f244 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:58.152218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-94f1cda8-649b-4a31-8988-e2f030c5f244 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:58.158743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94f1cda8-649b-4a31-8988-e2f030c5f244 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:58.159217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94f1cda8-649b-4a31-8988-e2f030c5f244 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:58.159645 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94f1cda8-649b-4a31-8988-e2f030c5f244 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:58.160335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94f1cda8-649b-4a31-8988-e2f030c5f244 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:58.160809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94f1cda8-649b-4a31-8988-e2f030c5f244 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:58.161227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94f1cda8-649b-4a31-8988-e2f030c5f244 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:58.294546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-94f1cda8-649b-4a31-8988-e2f030c5f244 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:58.303295 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-94f1cda8-649b-4a31-8988-e2f030c5f244 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155964 Aug 24 06:32:58.303886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 833/1658] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:58 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:58.588147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-00e82682-7430-492f-a6b9-1c404442201d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:58.588826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-00e82682-7430-492f-a6b9-1c404442201d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:58.595798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00e82682-7430-492f-a6b9-1c404442201d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:58.596392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00e82682-7430-492f-a6b9-1c404442201d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:58.596884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00e82682-7430-492f-a6b9-1c404442201d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:58.597607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00e82682-7430-492f-a6b9-1c404442201d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:58.598123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00e82682-7430-492f-a6b9-1c404442201d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:58.598577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00e82682-7430-492f-a6b9-1c404442201d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:58.673644 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-00e82682-7430-492f-a6b9-1c404442201d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:58.682683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-00e82682-7430-492f-a6b9-1c404442201d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.099228 Aug 24 06:32:58.683263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 826/1659] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:59.164047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c1e86f61-e316-419f-a562-908f26f265f3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:59.164723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c1e86f61-e316-419f-a562-908f26f265f3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:59.171359 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1e86f61-e316-419f-a562-908f26f265f3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:59.171831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1e86f61-e316-419f-a562-908f26f265f3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:59.172256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1e86f61-e316-419f-a562-908f26f265f3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:59.172973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1e86f61-e316-419f-a562-908f26f265f3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:59.173420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1e86f61-e316-419f-a562-908f26f265f3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:59.173836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1e86f61-e316-419f-a562-908f26f265f3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:59.299985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c1e86f61-e316-419f-a562-908f26f265f3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:59.312856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c1e86f61-e316-419f-a562-908f26f265f3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.148540 Aug 24 06:32:59.312856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 834/1660] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:59 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:59.325534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bb1a62b5-017d-4519-b353-1e48356e5c1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:59.326142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bb1a62b5-017d-4519-b353-1e48356e5c1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:59.332631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb1a62b5-017d-4519-b353-1e48356e5c1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:59.333114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb1a62b5-017d-4519-b353-1e48356e5c1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:59.333547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb1a62b5-017d-4519-b353-1e48356e5c1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:59.334262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb1a62b5-017d-4519-b353-1e48356e5c1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:59.334714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb1a62b5-017d-4519-b353-1e48356e5c1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:59.335135 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb1a62b5-017d-4519-b353-1e48356e5c1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:59.465306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bb1a62b5-017d-4519-b353-1e48356e5c1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:59.474859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bb1a62b5-017d-4519-b353-1e48356e5c1f tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.153234 Aug 24 06:32:59.477021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 827/1661] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:59 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:32:59.705814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a6aa595e-ed8b-4a72-bc32-ee2bd006eccd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:32:59.706424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a6aa595e-ed8b-4a72-bc32-ee2bd006eccd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:32:59.712978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aa595e-ed8b-4a72-bc32-ee2bd006eccd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:59.713419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aa595e-ed8b-4a72-bc32-ee2bd006eccd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:59.713844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aa595e-ed8b-4a72-bc32-ee2bd006eccd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:59.714531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aa595e-ed8b-4a72-bc32-ee2bd006eccd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:32:59.715001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aa595e-ed8b-4a72-bc32-ee2bd006eccd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:32:59.715412 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6aa595e-ed8b-4a72-bc32-ee2bd006eccd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:32:59.781523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a6aa595e-ed8b-4a72-bc32-ee2bd006eccd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:32:59.790872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a6aa595e-ed8b-4a72-bc32-ee2bd006eccd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088870 Aug 24 06:32:59.791448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 835/1662] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:32:59 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:00.330799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b35efee7-abdb-4269-94c0-c77d54ef10f2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:00.331402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b35efee7-abdb-4269-94c0-c77d54ef10f2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:00.337945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b35efee7-abdb-4269-94c0-c77d54ef10f2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:00.338428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b35efee7-abdb-4269-94c0-c77d54ef10f2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:00.338863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b35efee7-abdb-4269-94c0-c77d54ef10f2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:00.339551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b35efee7-abdb-4269-94c0-c77d54ef10f2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:00.339999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b35efee7-abdb-4269-94c0-c77d54ef10f2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:00.340414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b35efee7-abdb-4269-94c0-c77d54ef10f2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:00.470014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b35efee7-abdb-4269-94c0-c77d54ef10f2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:00.478939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b35efee7-abdb-4269-94c0-c77d54ef10f2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151978 Aug 24 06:33:00.479494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 828/1663] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:00 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:00.495538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ff081811-999e-4091-9c0a-b1a119e30b46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:00.496145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ff081811-999e-4091-9c0a-b1a119e30b46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:00.502707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff081811-999e-4091-9c0a-b1a119e30b46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:00.503188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff081811-999e-4091-9c0a-b1a119e30b46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:00.503621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff081811-999e-4091-9c0a-b1a119e30b46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:00.504336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff081811-999e-4091-9c0a-b1a119e30b46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:00.504813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff081811-999e-4091-9c0a-b1a119e30b46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:00.505239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ff081811-999e-4091-9c0a-b1a119e30b46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:00.637617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ff081811-999e-4091-9c0a-b1a119e30b46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:00.645949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ff081811-999e-4091-9c0a-b1a119e30b46 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154282 Aug 24 06:33:00.646506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 836/1664] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:00 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:00.812053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-61c4a594-be31-4fdf-ad43-b7dd802f65de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:00.812699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-61c4a594-be31-4fdf-ad43-b7dd802f65de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:00.818637 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c4a594-be31-4fdf-ad43-b7dd802f65de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:00.819106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c4a594-be31-4fdf-ad43-b7dd802f65de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:00.819532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c4a594-be31-4fdf-ad43-b7dd802f65de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:00.820840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c4a594-be31-4fdf-ad43-b7dd802f65de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:00.821283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c4a594-be31-4fdf-ad43-b7dd802f65de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:00.821695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61c4a594-be31-4fdf-ad43-b7dd802f65de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:00.889404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-61c4a594-be31-4fdf-ad43-b7dd802f65de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:00.897813 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-61c4a594-be31-4fdf-ad43-b7dd802f65de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089788 Aug 24 06:33:00.898479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 829/1665] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:01.500236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e1a2c363-876f-4eaa-a358-69427f2df05f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:01.500955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e1a2c363-876f-4eaa-a358-69427f2df05f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:01.508585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1a2c363-876f-4eaa-a358-69427f2df05f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:01.509102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1a2c363-876f-4eaa-a358-69427f2df05f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:01.509579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1a2c363-876f-4eaa-a358-69427f2df05f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:01.510340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1a2c363-876f-4eaa-a358-69427f2df05f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:01.510839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1a2c363-876f-4eaa-a358-69427f2df05f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:01.511387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e1a2c363-876f-4eaa-a358-69427f2df05f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:01.641025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e1a2c363-876f-4eaa-a358-69427f2df05f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:01.649790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e1a2c363-876f-4eaa-a358-69427f2df05f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153297 Aug 24 06:33:01.650613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 837/1666] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:01 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:01.667633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ee8ceed2-dbee-42d6-ad20-ef4f96fe33bb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:01.668265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ee8ceed2-dbee-42d6-ad20-ef4f96fe33bb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:01.674767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8ceed2-dbee-42d6-ad20-ef4f96fe33bb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:01.675242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8ceed2-dbee-42d6-ad20-ef4f96fe33bb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:01.675672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8ceed2-dbee-42d6-ad20-ef4f96fe33bb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:01.676352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8ceed2-dbee-42d6-ad20-ef4f96fe33bb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:01.676831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8ceed2-dbee-42d6-ad20-ef4f96fe33bb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:01.677247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee8ceed2-dbee-42d6-ad20-ef4f96fe33bb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:01.809662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ee8ceed2-dbee-42d6-ad20-ef4f96fe33bb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:01.817995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ee8ceed2-dbee-42d6-ad20-ef4f96fe33bb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.154722 Aug 24 06:33:01.818560 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 830/1667] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:01 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:01.919108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e9db1c3d-abf6-4e00-b442-15bec9bee794 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:01.919857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e9db1c3d-abf6-4e00-b442-15bec9bee794 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:01.925857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9db1c3d-abf6-4e00-b442-15bec9bee794 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:01.926330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9db1c3d-abf6-4e00-b442-15bec9bee794 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:01.926757 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9db1c3d-abf6-4e00-b442-15bec9bee794 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:01.927439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9db1c3d-abf6-4e00-b442-15bec9bee794 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:01.927883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9db1c3d-abf6-4e00-b442-15bec9bee794 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:01.928300 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9db1c3d-abf6-4e00-b442-15bec9bee794 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:01.993523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e9db1c3d-abf6-4e00-b442-15bec9bee794 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:02.001928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e9db1c3d-abf6-4e00-b442-15bec9bee794 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086971 Aug 24 06:33:02.002506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 838/1668] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:02.671201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8421eb20-7c0c-4dbd-a53f-52b2f170f82c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:02.671821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8421eb20-7c0c-4dbd-a53f-52b2f170f82c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:02.677869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8421eb20-7c0c-4dbd-a53f-52b2f170f82c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:02.678345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8421eb20-7c0c-4dbd-a53f-52b2f170f82c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:02.678774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8421eb20-7c0c-4dbd-a53f-52b2f170f82c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:02.679486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8421eb20-7c0c-4dbd-a53f-52b2f170f82c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:02.679935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8421eb20-7c0c-4dbd-a53f-52b2f170f82c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:02.680348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8421eb20-7c0c-4dbd-a53f-52b2f170f82c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:02.812637 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8421eb20-7c0c-4dbd-a53f-52b2f170f82c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:02.822141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8421eb20-7c0c-4dbd-a53f-52b2f170f82c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154699 Aug 24 06:33:02.823114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 831/1669] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:02 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:02.840047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6bcd491f-4561-4c8c-babe-c971668216ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:02.840720 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6bcd491f-4561-4c8c-babe-c971668216ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:02.848511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bcd491f-4561-4c8c-babe-c971668216ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:02.849078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bcd491f-4561-4c8c-babe-c971668216ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:02.849520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bcd491f-4561-4c8c-babe-c971668216ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:02.850248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bcd491f-4561-4c8c-babe-c971668216ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:02.850704 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bcd491f-4561-4c8c-babe-c971668216ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:02.851228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bcd491f-4561-4c8c-babe-c971668216ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:02.988121 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6bcd491f-4561-4c8c-babe-c971668216ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:02.996548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6bcd491f-4561-4c8c-babe-c971668216ab tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.160816 Aug 24 06:33:02.997126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 839/1670] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:02 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:03.022660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9497a0ba-1844-4435-ade6-33e69368c4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:03.024038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9497a0ba-1844-4435-ade6-33e69368c4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:03.030900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9497a0ba-1844-4435-ade6-33e69368c4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:03.031387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9497a0ba-1844-4435-ade6-33e69368c4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:03.031817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9497a0ba-1844-4435-ade6-33e69368c4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:03.032528 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9497a0ba-1844-4435-ade6-33e69368c4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:03.032983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9497a0ba-1844-4435-ade6-33e69368c4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:03.033405 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9497a0ba-1844-4435-ade6-33e69368c4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:03.048915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:03.098915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9497a0ba-1844-4435-ade6-33e69368c4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:03.107933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9497a0ba-1844-4435-ade6-33e69368c4db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088987 Aug 24 06:33:03.108559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 832/1671] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:03 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:03.843498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d5d6843d-9eaa-4542-836d-622c0f83d8da tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:03.844107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d5d6843d-9eaa-4542-836d-622c0f83d8da tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:03.850935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5d6843d-9eaa-4542-836d-622c0f83d8da tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:03.852049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5d6843d-9eaa-4542-836d-622c0f83d8da tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:03.852485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5d6843d-9eaa-4542-836d-622c0f83d8da tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:03.853294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5d6843d-9eaa-4542-836d-622c0f83d8da tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:03.853746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5d6843d-9eaa-4542-836d-622c0f83d8da tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:03.854165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5d6843d-9eaa-4542-836d-622c0f83d8da tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:03.985663 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d5d6843d-9eaa-4542-836d-622c0f83d8da tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:03.994231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d5d6843d-9eaa-4542-836d-622c0f83d8da tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154807 Aug 24 06:33:03.994815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 840/1672] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:03 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:04.017285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cf54aac3-1498-4f2b-be19-5eab758cd848 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:04.017873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cf54aac3-1498-4f2b-be19-5eab758cd848 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:04.024924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf54aac3-1498-4f2b-be19-5eab758cd848 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:04.025413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf54aac3-1498-4f2b-be19-5eab758cd848 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:04.025850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf54aac3-1498-4f2b-be19-5eab758cd848 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:04.026549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf54aac3-1498-4f2b-be19-5eab758cd848 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:04.027000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf54aac3-1498-4f2b-be19-5eab758cd848 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:04.027424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf54aac3-1498-4f2b-be19-5eab758cd848 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:04.129497 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b82178b2-e617-4953-94ee-6dc812639c5c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:04.130166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b82178b2-e617-4953-94ee-6dc812639c5c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:04.136789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b82178b2-e617-4953-94ee-6dc812639c5c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:04.137282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b82178b2-e617-4953-94ee-6dc812639c5c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:04.137717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b82178b2-e617-4953-94ee-6dc812639c5c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:04.138422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b82178b2-e617-4953-94ee-6dc812639c5c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:04.138870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b82178b2-e617-4953-94ee-6dc812639c5c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:04.139312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b82178b2-e617-4953-94ee-6dc812639c5c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:04.158198 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cf54aac3-1498-4f2b-be19-5eab758cd848 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:04.166467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cf54aac3-1498-4f2b-be19-5eab758cd848 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.152998 Aug 24 06:33:04.167040 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 833/1673] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:04 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:04.206067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b82178b2-e617-4953-94ee-6dc812639c5c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:04.215030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b82178b2-e617-4953-94ee-6dc812639c5c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089355 Aug 24 06:33:04.215603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 841/1674] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:05.016053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d760b286-565f-418c-96dd-38c8e053c9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:05.016604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d760b286-565f-418c-96dd-38c8e053c9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:05.023337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d760b286-565f-418c-96dd-38c8e053c9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:05.023981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d760b286-565f-418c-96dd-38c8e053c9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:05.024234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d760b286-565f-418c-96dd-38c8e053c9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:05.025031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d760b286-565f-418c-96dd-38c8e053c9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:05.025488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d760b286-565f-418c-96dd-38c8e053c9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:05.025901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d760b286-565f-418c-96dd-38c8e053c9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:05.154889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d760b286-565f-418c-96dd-38c8e053c9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:05.163295 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d760b286-565f-418c-96dd-38c8e053c9e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151217 Aug 24 06:33:05.163867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 834/1675] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:05 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:05.187406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-91c1e937-ad3d-44d6-be1d-0ebc44bfa3e2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:05.188013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-91c1e937-ad3d-44d6-be1d-0ebc44bfa3e2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:05.194647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91c1e937-ad3d-44d6-be1d-0ebc44bfa3e2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:05.195739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91c1e937-ad3d-44d6-be1d-0ebc44bfa3e2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:05.196177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91c1e937-ad3d-44d6-be1d-0ebc44bfa3e2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:05.196903 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91c1e937-ad3d-44d6-be1d-0ebc44bfa3e2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:05.197352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91c1e937-ad3d-44d6-be1d-0ebc44bfa3e2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:05.197772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91c1e937-ad3d-44d6-be1d-0ebc44bfa3e2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:05.235274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-55e8cc54-b4b4-4003-bbbf-0d49530492fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:05.235911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-55e8cc54-b4b4-4003-bbbf-0d49530492fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:05.242576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55e8cc54-b4b4-4003-bbbf-0d49530492fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:05.243061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55e8cc54-b4b4-4003-bbbf-0d49530492fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:05.243492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55e8cc54-b4b4-4003-bbbf-0d49530492fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:05.244194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55e8cc54-b4b4-4003-bbbf-0d49530492fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:05.244677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55e8cc54-b4b4-4003-bbbf-0d49530492fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:05.245102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55e8cc54-b4b4-4003-bbbf-0d49530492fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:05.313178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-55e8cc54-b4b4-4003-bbbf-0d49530492fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:05.321981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-55e8cc54-b4b4-4003-bbbf-0d49530492fd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.090570 Aug 24 06:33:05.322614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 835/1676] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:05.331115 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-91c1e937-ad3d-44d6-be1d-0ebc44bfa3e2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:05.339916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-91c1e937-ad3d-44d6-be1d-0ebc44bfa3e2 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156650 Aug 24 06:33:05.340503 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 842/1677] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:05 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:06.184830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cba1222c-05fb-4d2a-bb3a-8c9a807eda9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:06.185521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cba1222c-05fb-4d2a-bb3a-8c9a807eda9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:06.191917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cba1222c-05fb-4d2a-bb3a-8c9a807eda9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:06.192403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cba1222c-05fb-4d2a-bb3a-8c9a807eda9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:06.192881 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cba1222c-05fb-4d2a-bb3a-8c9a807eda9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:06.193576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cba1222c-05fb-4d2a-bb3a-8c9a807eda9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:06.194029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cba1222c-05fb-4d2a-bb3a-8c9a807eda9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:06.194448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cba1222c-05fb-4d2a-bb3a-8c9a807eda9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:06.324150 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cba1222c-05fb-4d2a-bb3a-8c9a807eda9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:06.334098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cba1222c-05fb-4d2a-bb3a-8c9a807eda9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153486 Aug 24 06:33:06.334670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 836/1678] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:06 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:06.342706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-337e813c-dbe7-4600-82d9-f123f9bba041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:06.343413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-337e813c-dbe7-4600-82d9-f123f9bba041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:06.350248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-337e813c-dbe7-4600-82d9-f123f9bba041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:06.350853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-337e813c-dbe7-4600-82d9-f123f9bba041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:06.351900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-337e813c-dbe7-4600-82d9-f123f9bba041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:06.352655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-337e813c-dbe7-4600-82d9-f123f9bba041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:06.353114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-337e813c-dbe7-4600-82d9-f123f9bba041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:06.353546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-337e813c-dbe7-4600-82d9-f123f9bba041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:06.364264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cfd29f75-bb02-43b7-b306-b5f17bb489da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:06.365053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cfd29f75-bb02-43b7-b306-b5f17bb489da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:06.371805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd29f75-bb02-43b7-b306-b5f17bb489da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:06.372287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd29f75-bb02-43b7-b306-b5f17bb489da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:06.372743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd29f75-bb02-43b7-b306-b5f17bb489da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:06.373434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd29f75-bb02-43b7-b306-b5f17bb489da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:06.373874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd29f75-bb02-43b7-b306-b5f17bb489da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:06.374286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfd29f75-bb02-43b7-b306-b5f17bb489da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:06.421666 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-337e813c-dbe7-4600-82d9-f123f9bba041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:06.430712 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-337e813c-dbe7-4600-82d9-f123f9bba041 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.091926 Aug 24 06:33:06.431299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 843/1679] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:06.506393 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cfd29f75-bb02-43b7-b306-b5f17bb489da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:06.514698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cfd29f75-bb02-43b7-b306-b5f17bb489da tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155911 Aug 24 06:33:06.515263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 837/1680] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:06 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:07.359581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b44768d0-0528-4a09-b07a-77375cb3ebac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:07.360124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b44768d0-0528-4a09-b07a-77375cb3ebac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:07.367062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b44768d0-0528-4a09-b07a-77375cb3ebac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:07.367548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b44768d0-0528-4a09-b07a-77375cb3ebac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:07.367974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b44768d0-0528-4a09-b07a-77375cb3ebac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:07.368698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b44768d0-0528-4a09-b07a-77375cb3ebac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:07.369143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b44768d0-0528-4a09-b07a-77375cb3ebac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:07.369559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b44768d0-0528-4a09-b07a-77375cb3ebac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:07.451963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bbfbfa7a-26fb-4ae6-a2e2-8f217ab8097a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:07.452754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bbfbfa7a-26fb-4ae6-a2e2-8f217ab8097a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:07.459472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bbfbfa7a-26fb-4ae6-a2e2-8f217ab8097a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:07.459981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bbfbfa7a-26fb-4ae6-a2e2-8f217ab8097a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:07.460450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bbfbfa7a-26fb-4ae6-a2e2-8f217ab8097a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:07.461185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bbfbfa7a-26fb-4ae6-a2e2-8f217ab8097a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:07.461639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bbfbfa7a-26fb-4ae6-a2e2-8f217ab8097a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:07.462069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bbfbfa7a-26fb-4ae6-a2e2-8f217ab8097a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:07.511335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b44768d0-0528-4a09-b07a-77375cb3ebac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:07.520207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b44768d0-0528-4a09-b07a-77375cb3ebac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164566 Aug 24 06:33:07.520820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 844/1681] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:07 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:07.530378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bbfbfa7a-26fb-4ae6-a2e2-8f217ab8097a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:07.536275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ab81178e-0a48-46a0-9d14-ea450f6820eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:07.539785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ab81178e-0a48-46a0-9d14-ea450f6820eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:07.539912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bbfbfa7a-26fb-4ae6-a2e2-8f217ab8097a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.090981 Aug 24 06:33:07.539912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 838/1682] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:07.544014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab81178e-0a48-46a0-9d14-ea450f6820eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:07.544630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab81178e-0a48-46a0-9d14-ea450f6820eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:07.545150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab81178e-0a48-46a0-9d14-ea450f6820eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:07.546013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab81178e-0a48-46a0-9d14-ea450f6820eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:07.546619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab81178e-0a48-46a0-9d14-ea450f6820eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:07.547106 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab81178e-0a48-46a0-9d14-ea450f6820eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:07.550021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:07.679702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ab81178e-0a48-46a0-9d14-ea450f6820eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:07.689138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ab81178e-0a48-46a0-9d14-ea450f6820eb tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156630 Aug 24 06:33:07.689721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 845/1683] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:07 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:08.542530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-55cdbbc0-1627-4dd1-a4a2-1848e41265f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:08.543133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-55cdbbc0-1627-4dd1-a4a2-1848e41265f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:08.549637 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55cdbbc0-1627-4dd1-a4a2-1848e41265f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:08.551676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55cdbbc0-1627-4dd1-a4a2-1848e41265f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:08.551676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55cdbbc0-1627-4dd1-a4a2-1848e41265f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:08.551676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55cdbbc0-1627-4dd1-a4a2-1848e41265f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:08.552067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55cdbbc0-1627-4dd1-a4a2-1848e41265f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:08.552174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55cdbbc0-1627-4dd1-a4a2-1848e41265f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:08.559944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-81c081aa-7884-4c8b-bea1-75f80909ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:08.560721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-81c081aa-7884-4c8b-bea1-75f80909ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:08.567176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81c081aa-7884-4c8b-bea1-75f80909ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:08.567648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81c081aa-7884-4c8b-bea1-75f80909ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:08.568070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81c081aa-7884-4c8b-bea1-75f80909ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:08.568789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81c081aa-7884-4c8b-bea1-75f80909ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:08.569233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81c081aa-7884-4c8b-bea1-75f80909ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:08.569693 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81c081aa-7884-4c8b-bea1-75f80909ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:08.634192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-81c081aa-7884-4c8b-bea1-75f80909ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:08.642699 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-81c081aa-7884-4c8b-bea1-75f80909ab04 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086768 Aug 24 06:33:08.643277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 846/1684] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:08.689947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-55cdbbc0-1627-4dd1-a4a2-1848e41265f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:08.698169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-55cdbbc0-1627-4dd1-a4a2-1848e41265f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.160003 Aug 24 06:33:08.698734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 839/1685] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:08 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:08.711687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-429ebb5b-17f8-4324-9241-4ec94d624b57 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:08.712299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-429ebb5b-17f8-4324-9241-4ec94d624b57 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:08.718401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-429ebb5b-17f8-4324-9241-4ec94d624b57 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:08.718885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-429ebb5b-17f8-4324-9241-4ec94d624b57 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:08.719321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-429ebb5b-17f8-4324-9241-4ec94d624b57 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:08.720015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-429ebb5b-17f8-4324-9241-4ec94d624b57 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:08.720470 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-429ebb5b-17f8-4324-9241-4ec94d624b57 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:08.720923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-429ebb5b-17f8-4324-9241-4ec94d624b57 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:08.855171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-429ebb5b-17f8-4324-9241-4ec94d624b57 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:08.863516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-429ebb5b-17f8-4324-9241-4ec94d624b57 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.156269 Aug 24 06:33:08.864091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 847/1686] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:08 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:09.665894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-294ab9ab-f303-4ea5-9024-5b3971f85ff7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:09.666500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-294ab9ab-f303-4ea5-9024-5b3971f85ff7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:09.673130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-294ab9ab-f303-4ea5-9024-5b3971f85ff7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:09.673631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-294ab9ab-f303-4ea5-9024-5b3971f85ff7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:09.674055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-294ab9ab-f303-4ea5-9024-5b3971f85ff7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:09.674762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-294ab9ab-f303-4ea5-9024-5b3971f85ff7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:09.675216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-294ab9ab-f303-4ea5-9024-5b3971f85ff7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:09.675638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-294ab9ab-f303-4ea5-9024-5b3971f85ff7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:09.719240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fd4636a2-d3d8-427d-95cd-6f541dcaaa6a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:09.720240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fd4636a2-d3d8-427d-95cd-6f541dcaaa6a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:09.727778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd4636a2-d3d8-427d-95cd-6f541dcaaa6a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:09.728262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd4636a2-d3d8-427d-95cd-6f541dcaaa6a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:09.728820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd4636a2-d3d8-427d-95cd-6f541dcaaa6a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:09.729493 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd4636a2-d3d8-427d-95cd-6f541dcaaa6a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:09.729943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd4636a2-d3d8-427d-95cd-6f541dcaaa6a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:09.730356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd4636a2-d3d8-427d-95cd-6f541dcaaa6a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:09.754047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-294ab9ab-f303-4ea5-9024-5b3971f85ff7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:09.763434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-294ab9ab-f303-4ea5-9024-5b3971f85ff7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.102023 Aug 24 06:33:09.764020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 840/1687] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:09 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:09.866776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fd4636a2-d3d8-427d-95cd-6f541dcaaa6a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:09.875387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fd4636a2-d3d8-427d-95cd-6f541dcaaa6a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.160461 Aug 24 06:33:09.875956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 848/1688] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:09 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:09.884419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-51c256db-787b-4a31-8896-bed996f41a84 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:09.885121 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-51c256db-787b-4a31-8896-bed996f41a84 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:09.892124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-51c256db-787b-4a31-8896-bed996f41a84 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:09.892648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-51c256db-787b-4a31-8896-bed996f41a84 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:09.893088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-51c256db-787b-4a31-8896-bed996f41a84 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:09.893782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-51c256db-787b-4a31-8896-bed996f41a84 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:09.894233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-51c256db-787b-4a31-8896-bed996f41a84 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:09.894656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-51c256db-787b-4a31-8896-bed996f41a84 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:10.027430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-51c256db-787b-4a31-8896-bed996f41a84 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:10.035710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-51c256db-787b-4a31-8896-bed996f41a84 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.155715 Aug 24 06:33:10.036285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 841/1689] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:09 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:10.785270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9633a985-982b-4f2a-a597-cc0f570ab280 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:10.785883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9633a985-982b-4f2a-a597-cc0f570ab280 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:10.792561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9633a985-982b-4f2a-a597-cc0f570ab280 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:10.793087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9633a985-982b-4f2a-a597-cc0f570ab280 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:10.793525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9633a985-982b-4f2a-a597-cc0f570ab280 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:10.794234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9633a985-982b-4f2a-a597-cc0f570ab280 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:10.794687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9633a985-982b-4f2a-a597-cc0f570ab280 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:10.795114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9633a985-982b-4f2a-a597-cc0f570ab280 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:10.857830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9633a985-982b-4f2a-a597-cc0f570ab280 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:10.866140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9633a985-982b-4f2a-a597-cc0f570ab280 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084758 Aug 24 06:33:10.866714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 849/1690] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:10 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:10.897542 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c887438c-523d-475b-9224-ab4a31a621cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:10.898763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c887438c-523d-475b-9224-ab4a31a621cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:10.905327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c887438c-523d-475b-9224-ab4a31a621cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:10.905805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c887438c-523d-475b-9224-ab4a31a621cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:10.906233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c887438c-523d-475b-9224-ab4a31a621cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:10.906923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c887438c-523d-475b-9224-ab4a31a621cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:10.907372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c887438c-523d-475b-9224-ab4a31a621cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:10.907788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c887438c-523d-475b-9224-ab4a31a621cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:11.038949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c887438c-523d-475b-9224-ab4a31a621cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:11.047434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c887438c-523d-475b-9224-ab4a31a621cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153690 Aug 24 06:33:11.048013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 842/1691] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:10 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:11.057136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f5ac0bf3-b912-4468-9999-8320d2315f16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:11.057746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f5ac0bf3-b912-4468-9999-8320d2315f16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: d8e12ed7-0b6e-4995-a3c0-221ce6c18041] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:11.064029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ac0bf3-b912-4468-9999-8320d2315f16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:11.064552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ac0bf3-b912-4468-9999-8320d2315f16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:11.064987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ac0bf3-b912-4468-9999-8320d2315f16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:11.065685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ac0bf3-b912-4468-9999-8320d2315f16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:11.066135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ac0bf3-b912-4468-9999-8320d2315f16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:11.066556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5ac0bf3-b912-4468-9999-8320d2315f16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:11.201521 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f5ac0bf3-b912-4468-9999-8320d2315f16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:11.209919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f5ac0bf3-b912-4468-9999-8320d2315f16 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041" status: 200 len: 1738 microversion: 2.1 time: 0.157226 Aug 24 06:33:11.210501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 850/1692] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:11 2022] GET /compute/v2.1/servers/d8e12ed7-0b6e-4995-a3c0-221ce6c18041 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:11.230195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-59ef14d8-8ef4-4518-be1c-81e9cf14c7b3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '.version_select at 0x7fcde0b5b3a0>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:11.294470 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-59ef14d8-8ef4-4518-be1c-81e9cf14c7b3 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989175033" status: 202 len: 0 microversion: 2.1 time: 0.067939 Aug 24 06:33:11.294980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 843/1693] 10.222.0.62 () {58 vars in 1221 bytes} [Wed Aug 24 06:33:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989175033 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:33:11.887251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ccb4db3d-9ff0-421d-a381-4357cb611868 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:11.887886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ccb4db3d-9ff0-421d-a381-4357cb611868 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:11.894563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccb4db3d-9ff0-421d-a381-4357cb611868 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:11.895042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccb4db3d-9ff0-421d-a381-4357cb611868 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:11.895480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccb4db3d-9ff0-421d-a381-4357cb611868 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:11.896179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccb4db3d-9ff0-421d-a381-4357cb611868 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:11.896665 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccb4db3d-9ff0-421d-a381-4357cb611868 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:11.897086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ccb4db3d-9ff0-421d-a381-4357cb611868 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:12.012852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ccb4db3d-9ff0-421d-a381-4357cb611868 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:12.021249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ccb4db3d-9ff0-421d-a381-4357cb611868 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.137859 Aug 24 06:33:12.022067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 851/1694] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:12.069538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7db48052-cfe7-481e-807f-62e4856544b6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:12.070352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7db48052-cfe7-481e-807f-62e4856544b6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:12.077105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7db48052-cfe7-481e-807f-62e4856544b6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:12.077510 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7db48052-cfe7-481e-807f-62e4856544b6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:12.077936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7db48052-cfe7-481e-807f-62e4856544b6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:12.078634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7db48052-cfe7-481e-807f-62e4856544b6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:12.079084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7db48052-cfe7-481e-807f-62e4856544b6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:12.079697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7db48052-cfe7-481e-807f-62e4856544b6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:12.212988 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7db48052-cfe7-481e-807f-62e4856544b6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:12.222239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7db48052-cfe7-481e-807f-62e4856544b6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.156747 Aug 24 06:33:12.222824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 844/1695] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:12 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:12.310686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-c2531acc-ec0d-4d55-8eb5-7163d3f3899d req-5744bcfe-6573-4742-b4e2-f3b8dff7d99f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8e12ed7-0b6e-4995-a3c0-221ce6c18041", "tag": "19c5b9e4-2438-4dd5-ba21-d02e604b373c"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:33:12.321925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c2531acc-ec0d-4d55-8eb5-7163d3f3899d req-5744bcfe-6573-4742-b4e2-f3b8dff7d99f service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:12.322499 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c2531acc-ec0d-4d55-8eb5-7163d3f3899d req-5744bcfe-6573-4742-b4e2-f3b8dff7d99f service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:12.323075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-c2531acc-ec0d-4d55-8eb5-7163d3f3899d req-5744bcfe-6573-4742-b4e2-f3b8dff7d99f service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:12.335995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-c2531acc-ec0d-4d55-8eb5-7163d3f3899d req-5744bcfe-6573-4742-b4e2-f3b8dff7d99f service nova] Creating event network-changed:19c5b9e4-2438-4dd5-ba21-d02e604b373c for instance d8e12ed7-0b6e-4995-a3c0-221ce6c18041 on hv-cinder-85426 Aug 24 06:33:12.342676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-c2531acc-ec0d-4d55-8eb5-7163d3f3899d req-5744bcfe-6573-4742-b4e2-f3b8dff7d99f service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035915 Aug 24 06:33:12.343730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 852/1696] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:33:13.043791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5031fde2-dfc8-4465-8832-9c6c9a83e3cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:13.044589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5031fde2-dfc8-4465-8832-9c6c9a83e3cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:13.046537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:13.051488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5031fde2-dfc8-4465-8832-9c6c9a83e3cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:13.052000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5031fde2-dfc8-4465-8832-9c6c9a83e3cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:13.052399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5031fde2-dfc8-4465-8832-9c6c9a83e3cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:13.053124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5031fde2-dfc8-4465-8832-9c6c9a83e3cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:13.053569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5031fde2-dfc8-4465-8832-9c6c9a83e3cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:13.054579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5031fde2-dfc8-4465-8832-9c6c9a83e3cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:13.126432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5031fde2-dfc8-4465-8832-9c6c9a83e3cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:13.136323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5031fde2-dfc8-4465-8832-9c6c9a83e3cb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.096330 Aug 24 06:33:13.137017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 845/1697] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:13.246072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7c501d9e-5eea-4f27-bec2-b1d3f2617528 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:13.246758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7c501d9e-5eea-4f27-bec2-b1d3f2617528 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:13.253672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c501d9e-5eea-4f27-bec2-b1d3f2617528 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:13.254155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c501d9e-5eea-4f27-bec2-b1d3f2617528 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:13.254589 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c501d9e-5eea-4f27-bec2-b1d3f2617528 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:13.255288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c501d9e-5eea-4f27-bec2-b1d3f2617528 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:13.255738 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c501d9e-5eea-4f27-bec2-b1d3f2617528 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:13.256159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c501d9e-5eea-4f27-bec2-b1d3f2617528 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:13.398770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7c501d9e-5eea-4f27-bec2-b1d3f2617528 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:13.406964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7c501d9e-5eea-4f27-bec2-b1d3f2617528 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.165102 Aug 24 06:33:13.407520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 853/1698] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:13 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:14.157833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bc846f7b-3291-4d5f-9042-0a90b0125484 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:14.158425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bc846f7b-3291-4d5f-9042-0a90b0125484 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:14.164947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc846f7b-3291-4d5f-9042-0a90b0125484 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:14.165425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc846f7b-3291-4d5f-9042-0a90b0125484 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:14.165849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc846f7b-3291-4d5f-9042-0a90b0125484 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:14.166539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc846f7b-3291-4d5f-9042-0a90b0125484 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:14.166982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc846f7b-3291-4d5f-9042-0a90b0125484 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:14.167394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc846f7b-3291-4d5f-9042-0a90b0125484 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:14.229867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bc846f7b-3291-4d5f-9042-0a90b0125484 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:14.238263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bc846f7b-3291-4d5f-9042-0a90b0125484 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084333 Aug 24 06:33:14.238830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 846/1699] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:14.428544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6f416dbb-9e9a-4b85-8ca2-6cf7e14a5b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:14.429831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6f416dbb-9e9a-4b85-8ca2-6cf7e14a5b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:14.436850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f416dbb-9e9a-4b85-8ca2-6cf7e14a5b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:14.437393 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f416dbb-9e9a-4b85-8ca2-6cf7e14a5b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:14.437793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f416dbb-9e9a-4b85-8ca2-6cf7e14a5b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:14.438500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f416dbb-9e9a-4b85-8ca2-6cf7e14a5b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:14.438953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f416dbb-9e9a-4b85-8ca2-6cf7e14a5b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:14.439380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f416dbb-9e9a-4b85-8ca2-6cf7e14a5b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:14.568047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6f416dbb-9e9a-4b85-8ca2-6cf7e14a5b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:14.576474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6f416dbb-9e9a-4b85-8ca2-6cf7e14a5b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151789 Aug 24 06:33:14.577081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 854/1700] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:14 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:15.259941 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7030b7d1-524f-4056-bde5-f32b319cf749 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:15.260604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7030b7d1-524f-4056-bde5-f32b319cf749 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:15.267329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7030b7d1-524f-4056-bde5-f32b319cf749 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:15.267801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7030b7d1-524f-4056-bde5-f32b319cf749 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:15.268228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7030b7d1-524f-4056-bde5-f32b319cf749 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:15.268949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7030b7d1-524f-4056-bde5-f32b319cf749 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:15.269401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7030b7d1-524f-4056-bde5-f32b319cf749 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:15.269815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7030b7d1-524f-4056-bde5-f32b319cf749 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:15.333502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7030b7d1-524f-4056-bde5-f32b319cf749 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:15.342991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7030b7d1-524f-4056-bde5-f32b319cf749 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087230 Aug 24 06:33:15.343616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 847/1701] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:15 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:15.597509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ce35e628-8cc1-4de7-913c-9de241588058 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:15.598149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ce35e628-8cc1-4de7-913c-9de241588058 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:15.604802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce35e628-8cc1-4de7-913c-9de241588058 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:15.605287 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce35e628-8cc1-4de7-913c-9de241588058 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:15.605719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce35e628-8cc1-4de7-913c-9de241588058 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:15.606408 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce35e628-8cc1-4de7-913c-9de241588058 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:15.606858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce35e628-8cc1-4de7-913c-9de241588058 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:15.607278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce35e628-8cc1-4de7-913c-9de241588058 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:15.738559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ce35e628-8cc1-4de7-913c-9de241588058 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:15.747289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ce35e628-8cc1-4de7-913c-9de241588058 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153635 Aug 24 06:33:15.747864 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 855/1702] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:15 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:16.364162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-33df32d9-2429-454f-a649-1c353ac9e78a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:16.364732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-33df32d9-2429-454f-a649-1c353ac9e78a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:16.371059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33df32d9-2429-454f-a649-1c353ac9e78a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:16.371529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33df32d9-2429-454f-a649-1c353ac9e78a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:16.371951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33df32d9-2429-454f-a649-1c353ac9e78a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:16.372666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33df32d9-2429-454f-a649-1c353ac9e78a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:16.373111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33df32d9-2429-454f-a649-1c353ac9e78a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:16.373521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33df32d9-2429-454f-a649-1c353ac9e78a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:16.434823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-33df32d9-2429-454f-a649-1c353ac9e78a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:16.442847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-33df32d9-2429-454f-a649-1c353ac9e78a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082618 Aug 24 06:33:16.443416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 848/1703] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:16.770272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9bb64f9b-451d-4092-b5a0-f2fa66e1e7bd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:16.771340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9bb64f9b-451d-4092-b5a0-f2fa66e1e7bd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:16.780331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bb64f9b-451d-4092-b5a0-f2fa66e1e7bd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:16.780848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bb64f9b-451d-4092-b5a0-f2fa66e1e7bd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:16.781280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bb64f9b-451d-4092-b5a0-f2fa66e1e7bd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:16.781984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bb64f9b-451d-4092-b5a0-f2fa66e1e7bd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:16.782436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bb64f9b-451d-4092-b5a0-f2fa66e1e7bd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:16.782855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bb64f9b-451d-4092-b5a0-f2fa66e1e7bd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:17.167950 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9bb64f9b-451d-4092-b5a0-f2fa66e1e7bd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:17.176160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9bb64f9b-451d-4092-b5a0-f2fa66e1e7bd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.411079 Aug 24 06:33:17.176859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 856/1704] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:16 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:17.463176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a55cfdc2-4c55-4189-b4c1-70723511c2cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:17.464520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a55cfdc2-4c55-4189-b4c1-70723511c2cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:17.471407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a55cfdc2-4c55-4189-b4c1-70723511c2cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:17.471883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a55cfdc2-4c55-4189-b4c1-70723511c2cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:17.472428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a55cfdc2-4c55-4189-b4c1-70723511c2cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:17.473200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a55cfdc2-4c55-4189-b4c1-70723511c2cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:17.473645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a55cfdc2-4c55-4189-b4c1-70723511c2cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:17.474061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a55cfdc2-4c55-4189-b4c1-70723511c2cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:17.537343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a55cfdc2-4c55-4189-b4c1-70723511c2cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:17.545982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a55cfdc2-4c55-4189-b4c1-70723511c2cc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086665 Aug 24 06:33:17.546557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 849/1705] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:17 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:18.198085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a3877d8e-49c8-4b25-8a0e-0626debc2698 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:18.198715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a3877d8e-49c8-4b25-8a0e-0626debc2698 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:18.205165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3877d8e-49c8-4b25-8a0e-0626debc2698 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:18.205635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3877d8e-49c8-4b25-8a0e-0626debc2698 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:18.206061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3877d8e-49c8-4b25-8a0e-0626debc2698 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:18.206742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3877d8e-49c8-4b25-8a0e-0626debc2698 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:18.207186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3877d8e-49c8-4b25-8a0e-0626debc2698 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:18.207599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a3877d8e-49c8-4b25-8a0e-0626debc2698 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:18.336156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a3877d8e-49c8-4b25-8a0e-0626debc2698 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:18.344377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a3877d8e-49c8-4b25-8a0e-0626debc2698 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150187 Aug 24 06:33:18.344965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 857/1706] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:18 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:18.567875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6d7a2cc5-747a-40ca-8d98-a8c108dcbab7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:18.568459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6d7a2cc5-747a-40ca-8d98-a8c108dcbab7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:18.575653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d7a2cc5-747a-40ca-8d98-a8c108dcbab7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:18.576133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d7a2cc5-747a-40ca-8d98-a8c108dcbab7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:18.576617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d7a2cc5-747a-40ca-8d98-a8c108dcbab7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:18.577311 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d7a2cc5-747a-40ca-8d98-a8c108dcbab7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:18.577765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d7a2cc5-747a-40ca-8d98-a8c108dcbab7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:18.578186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d7a2cc5-747a-40ca-8d98-a8c108dcbab7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:18.580783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:18.644402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6d7a2cc5-747a-40ca-8d98-a8c108dcbab7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:18.653284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6d7a2cc5-747a-40ca-8d98-a8c108dcbab7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089438 Aug 24 06:33:18.653858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 850/1707] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:19.366602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-853e29c9-9840-4a80-b068-e5a6ef544c0e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:19.367170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-853e29c9-9840-4a80-b068-e5a6ef544c0e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:19.373597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-853e29c9-9840-4a80-b068-e5a6ef544c0e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:19.374082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-853e29c9-9840-4a80-b068-e5a6ef544c0e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:19.374520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-853e29c9-9840-4a80-b068-e5a6ef544c0e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:19.375213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-853e29c9-9840-4a80-b068-e5a6ef544c0e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:19.375666 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-853e29c9-9840-4a80-b068-e5a6ef544c0e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:19.376099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-853e29c9-9840-4a80-b068-e5a6ef544c0e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:19.504297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-853e29c9-9840-4a80-b068-e5a6ef544c0e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:19.512735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-853e29c9-9840-4a80-b068-e5a6ef544c0e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150594 Aug 24 06:33:19.513308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 858/1708] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:19 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:19.673948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f39d561f-2152-4d9a-8f1e-51464fb7e5d3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:19.674581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f39d561f-2152-4d9a-8f1e-51464fb7e5d3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:19.681030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f39d561f-2152-4d9a-8f1e-51464fb7e5d3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:19.681508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f39d561f-2152-4d9a-8f1e-51464fb7e5d3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:19.681943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f39d561f-2152-4d9a-8f1e-51464fb7e5d3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:19.682633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f39d561f-2152-4d9a-8f1e-51464fb7e5d3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:19.683077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f39d561f-2152-4d9a-8f1e-51464fb7e5d3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:19.683494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f39d561f-2152-4d9a-8f1e-51464fb7e5d3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:19.745915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f39d561f-2152-4d9a-8f1e-51464fb7e5d3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:19.753984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f39d561f-2152-4d9a-8f1e-51464fb7e5d3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083957 Aug 24 06:33:19.754548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 851/1709] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:19.908844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:33:19.909044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:33:20.534362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3e3c088d-ce65-4284-80e3-1dce5bb04168 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:20.535032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3e3c088d-ce65-4284-80e3-1dce5bb04168 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:20.541649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e3c088d-ce65-4284-80e3-1dce5bb04168 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:20.542131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e3c088d-ce65-4284-80e3-1dce5bb04168 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:20.542561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e3c088d-ce65-4284-80e3-1dce5bb04168 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:20.543251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e3c088d-ce65-4284-80e3-1dce5bb04168 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:20.543700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e3c088d-ce65-4284-80e3-1dce5bb04168 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:20.544153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e3c088d-ce65-4284-80e3-1dce5bb04168 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:20.669901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3e3c088d-ce65-4284-80e3-1dce5bb04168 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:20.678095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3e3c088d-ce65-4284-80e3-1dce5bb04168 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.147634 Aug 24 06:33:20.678662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 859/1710] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:20 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:20.774912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4a989bf4-f364-45de-bc6f-bf000d527e5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:20.775513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4a989bf4-f364-45de-bc6f-bf000d527e5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:20.782060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a989bf4-f364-45de-bc6f-bf000d527e5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:20.782550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a989bf4-f364-45de-bc6f-bf000d527e5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:20.782952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a989bf4-f364-45de-bc6f-bf000d527e5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:20.783629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a989bf4-f364-45de-bc6f-bf000d527e5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:20.784073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a989bf4-f364-45de-bc6f-bf000d527e5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:20.784565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a989bf4-f364-45de-bc6f-bf000d527e5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:20.846643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4a989bf4-f364-45de-bc6f-bf000d527e5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:20.855442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4a989bf4-f364-45de-bc6f-bf000d527e5a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084372 Aug 24 06:33:20.856002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 852/1711] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:21.699902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0e3713e9-5144-463a-a36b-6adab8b770ab tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:21.700524 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0e3713e9-5144-463a-a36b-6adab8b770ab tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:21.702839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=74 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:21.707503 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e3713e9-5144-463a-a36b-6adab8b770ab tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:21.707975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e3713e9-5144-463a-a36b-6adab8b770ab tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:21.708401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e3713e9-5144-463a-a36b-6adab8b770ab tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:21.709114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e3713e9-5144-463a-a36b-6adab8b770ab tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:21.709557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e3713e9-5144-463a-a36b-6adab8b770ab tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:21.709973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e3713e9-5144-463a-a36b-6adab8b770ab tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:21.857019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0e3713e9-5144-463a-a36b-6adab8b770ab tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:21.865440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0e3713e9-5144-463a-a36b-6adab8b770ab tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.169485 Aug 24 06:33:21.866067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 860/1712] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:21 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:21.875317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-68b716c5-062c-43ea-9a9d-50f9c512cc95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:21.877130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-68b716c5-062c-43ea-9a9d-50f9c512cc95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:21.882750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68b716c5-062c-43ea-9a9d-50f9c512cc95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:21.883228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68b716c5-062c-43ea-9a9d-50f9c512cc95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:21.883659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68b716c5-062c-43ea-9a9d-50f9c512cc95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:21.884390 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68b716c5-062c-43ea-9a9d-50f9c512cc95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:21.884871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68b716c5-062c-43ea-9a9d-50f9c512cc95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:21.885289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-68b716c5-062c-43ea-9a9d-50f9c512cc95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:21.949199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-68b716c5-062c-43ea-9a9d-50f9c512cc95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:21.957445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-68b716c5-062c-43ea-9a9d-50f9c512cc95 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086044 Aug 24 06:33:21.957947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 853/1713] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:21 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:22.887198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-68e493e2-4d6d-48e0-8c4e-86a6399973c6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:22.887826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-68e493e2-4d6d-48e0-8c4e-86a6399973c6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:22.894324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68e493e2-4d6d-48e0-8c4e-86a6399973c6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:22.894825 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68e493e2-4d6d-48e0-8c4e-86a6399973c6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:22.895245 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68e493e2-4d6d-48e0-8c4e-86a6399973c6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:22.895935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68e493e2-4d6d-48e0-8c4e-86a6399973c6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:22.896384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68e493e2-4d6d-48e0-8c4e-86a6399973c6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:22.896830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68e493e2-4d6d-48e0-8c4e-86a6399973c6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:22.978469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-af62d2f5-9d4c-46a7-94b7-703208c834d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:22.979101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-af62d2f5-9d4c-46a7-94b7-703208c834d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:22.985552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af62d2f5-9d4c-46a7-94b7-703208c834d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:22.986032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af62d2f5-9d4c-46a7-94b7-703208c834d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:22.986464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af62d2f5-9d4c-46a7-94b7-703208c834d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:22.987156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af62d2f5-9d4c-46a7-94b7-703208c834d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:22.987602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af62d2f5-9d4c-46a7-94b7-703208c834d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:22.988020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af62d2f5-9d4c-46a7-94b7-703208c834d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:23.027394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-68e493e2-4d6d-48e0-8c4e-86a6399973c6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:23.035632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-68e493e2-4d6d-48e0-8c4e-86a6399973c6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.152351 Aug 24 06:33:23.036202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 861/1714] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:22 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:23.051205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-af62d2f5-9d4c-46a7-94b7-703208c834d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:23.059649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-af62d2f5-9d4c-46a7-94b7-703208c834d5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085547 Aug 24 06:33:23.060224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 854/1715] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:24.057798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e96bc4cd-39a7-4a1f-8e19-ffe8e5e76a8f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:24.058354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e96bc4cd-39a7-4a1f-8e19-ffe8e5e76a8f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:24.064979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96bc4cd-39a7-4a1f-8e19-ffe8e5e76a8f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:24.065446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96bc4cd-39a7-4a1f-8e19-ffe8e5e76a8f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:24.065872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96bc4cd-39a7-4a1f-8e19-ffe8e5e76a8f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:24.066549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96bc4cd-39a7-4a1f-8e19-ffe8e5e76a8f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:24.066994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96bc4cd-39a7-4a1f-8e19-ffe8e5e76a8f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:24.067407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96bc4cd-39a7-4a1f-8e19-ffe8e5e76a8f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:24.080447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ca8124c8-e59d-4554-9fa8-16c65b6a4076 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:24.081080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ca8124c8-e59d-4554-9fa8-16c65b6a4076 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:24.082509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:24.087420 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca8124c8-e59d-4554-9fa8-16c65b6a4076 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:24.087902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca8124c8-e59d-4554-9fa8-16c65b6a4076 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:24.088337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca8124c8-e59d-4554-9fa8-16c65b6a4076 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:24.089073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca8124c8-e59d-4554-9fa8-16c65b6a4076 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:24.089513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca8124c8-e59d-4554-9fa8-16c65b6a4076 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:24.089935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca8124c8-e59d-4554-9fa8-16c65b6a4076 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:24.152455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ca8124c8-e59d-4554-9fa8-16c65b6a4076 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:24.160788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ca8124c8-e59d-4554-9fa8-16c65b6a4076 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084326 Aug 24 06:33:24.161353 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 855/1716] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:24.196325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e96bc4cd-39a7-4a1f-8e19-ffe8e5e76a8f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:24.205201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e96bc4cd-39a7-4a1f-8e19-ffe8e5e76a8f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151790 Aug 24 06:33:24.205756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 862/1717] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:24 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:25.182878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e4194517-4721-4f78-9a6d-6d53c8a0b0e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:25.183497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e4194517-4721-4f78-9a6d-6d53c8a0b0e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:25.190197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e4194517-4721-4f78-9a6d-6d53c8a0b0e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:25.190676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e4194517-4721-4f78-9a6d-6d53c8a0b0e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:25.191111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e4194517-4721-4f78-9a6d-6d53c8a0b0e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:25.191805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e4194517-4721-4f78-9a6d-6d53c8a0b0e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:25.192255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e4194517-4721-4f78-9a6d-6d53c8a0b0e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:25.192706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e4194517-4721-4f78-9a6d-6d53c8a0b0e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:25.222035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:33:25.223603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:33:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 (ip 10.222.0.62) !!! Aug 24 06:33:25.227075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-422a6d91-993a-48d1-aaa7-e9ad2af64c1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:25.228423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-422a6d91-993a-48d1-aaa7-e9ad2af64c1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:25.238944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-422a6d91-993a-48d1-aaa7-e9ad2af64c1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:25.239709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-422a6d91-993a-48d1-aaa7-e9ad2af64c1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:25.240150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-422a6d91-993a-48d1-aaa7-e9ad2af64c1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:25.241369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-422a6d91-993a-48d1-aaa7-e9ad2af64c1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:25.241823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-422a6d91-993a-48d1-aaa7-e9ad2af64c1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:25.242247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-422a6d91-993a-48d1-aaa7-e9ad2af64c1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:25.254366 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e4194517-4721-4f78-9a6d-6d53c8a0b0e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:25.263166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e4194517-4721-4f78-9a6d-6d53c8a0b0e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084715 Aug 24 06:33:25.263744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 856/1718] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:25 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:25.375387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-422a6d91-993a-48d1-aaa7-e9ad2af64c1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:25.384306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-422a6d91-993a-48d1-aaa7-e9ad2af64c1c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.163010 Aug 24 06:33:25.384908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 863/1719] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:25 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:25.834223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:33:25.834397 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:33:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:33:26.283672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ba88570d-c6c1-495f-ad5d-83fa1de70ae9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:26.284323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ba88570d-c6c1-495f-ad5d-83fa1de70ae9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:26.290886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba88570d-c6c1-495f-ad5d-83fa1de70ae9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:26.291403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba88570d-c6c1-495f-ad5d-83fa1de70ae9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:26.291842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba88570d-c6c1-495f-ad5d-83fa1de70ae9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:26.292554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba88570d-c6c1-495f-ad5d-83fa1de70ae9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:26.293017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba88570d-c6c1-495f-ad5d-83fa1de70ae9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:26.293440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba88570d-c6c1-495f-ad5d-83fa1de70ae9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:26.359377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ba88570d-c6c1-495f-ad5d-83fa1de70ae9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:26.368175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ba88570d-c6c1-495f-ad5d-83fa1de70ae9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088355 Aug 24 06:33:26.368767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 857/1720] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:26.405913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bade1af7-5b3d-4b14-b4ac-9dd710bd12cc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:26.406521 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bade1af7-5b3d-4b14-b4ac-9dd710bd12cc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:26.413553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bade1af7-5b3d-4b14-b4ac-9dd710bd12cc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:26.414028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bade1af7-5b3d-4b14-b4ac-9dd710bd12cc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:26.414457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bade1af7-5b3d-4b14-b4ac-9dd710bd12cc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:26.415140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bade1af7-5b3d-4b14-b4ac-9dd710bd12cc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:26.415588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bade1af7-5b3d-4b14-b4ac-9dd710bd12cc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:26.416008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bade1af7-5b3d-4b14-b4ac-9dd710bd12cc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:26.543346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bade1af7-5b3d-4b14-b4ac-9dd710bd12cc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:26.551616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bade1af7-5b3d-4b14-b4ac-9dd710bd12cc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.149514 Aug 24 06:33:26.552190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 864/1721] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:26 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:27.389117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-76e9f20e-5d8d-44c5-aab3-7c327ea9472a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:27.389765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-76e9f20e-5d8d-44c5-aab3-7c327ea9472a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:27.396517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76e9f20e-5d8d-44c5-aab3-7c327ea9472a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:27.397060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76e9f20e-5d8d-44c5-aab3-7c327ea9472a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:27.398062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76e9f20e-5d8d-44c5-aab3-7c327ea9472a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:27.398804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76e9f20e-5d8d-44c5-aab3-7c327ea9472a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:27.399257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76e9f20e-5d8d-44c5-aab3-7c327ea9472a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:27.399674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76e9f20e-5d8d-44c5-aab3-7c327ea9472a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:27.460566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-76e9f20e-5d8d-44c5-aab3-7c327ea9472a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:27.469438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-76e9f20e-5d8d-44c5-aab3-7c327ea9472a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084143 Aug 24 06:33:27.470004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 858/1722] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:27.574168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-30936e65-431a-418e-9da5-a82ca1039b87 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:27.574777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-30936e65-431a-418e-9da5-a82ca1039b87 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:27.581249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30936e65-431a-418e-9da5-a82ca1039b87 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:27.581723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30936e65-431a-418e-9da5-a82ca1039b87 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:27.582155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30936e65-431a-418e-9da5-a82ca1039b87 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:27.582837 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30936e65-431a-418e-9da5-a82ca1039b87 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:27.583278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30936e65-431a-418e-9da5-a82ca1039b87 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:27.583691 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30936e65-431a-418e-9da5-a82ca1039b87 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:27.714312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-30936e65-431a-418e-9da5-a82ca1039b87 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:27.722896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-30936e65-431a-418e-9da5-a82ca1039b87 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.152612 Aug 24 06:33:27.723456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 865/1723] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:27 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:28.489913 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7fa1e57c-2371-4ede-87d3-16892f2455c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:28.490523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7fa1e57c-2371-4ede-87d3-16892f2455c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:28.497388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fa1e57c-2371-4ede-87d3-16892f2455c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:28.497866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fa1e57c-2371-4ede-87d3-16892f2455c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:28.498297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fa1e57c-2371-4ede-87d3-16892f2455c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:28.498985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fa1e57c-2371-4ede-87d3-16892f2455c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:28.499433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fa1e57c-2371-4ede-87d3-16892f2455c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:28.499849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fa1e57c-2371-4ede-87d3-16892f2455c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:28.561701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7fa1e57c-2371-4ede-87d3-16892f2455c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:28.568713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7fa1e57c-2371-4ede-87d3-16892f2455c9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082667 Aug 24 06:33:28.569856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 859/1724] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:28 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:28.743312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5ab76332-e031-4085-94f6-a81d0850282c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:28.743933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5ab76332-e031-4085-94f6-a81d0850282c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:28.751096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ab76332-e031-4085-94f6-a81d0850282c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:28.751575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ab76332-e031-4085-94f6-a81d0850282c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:28.752012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ab76332-e031-4085-94f6-a81d0850282c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:28.752738 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ab76332-e031-4085-94f6-a81d0850282c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:28.753194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ab76332-e031-4085-94f6-a81d0850282c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:28.753616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ab76332-e031-4085-94f6-a81d0850282c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:28.881889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5ab76332-e031-4085-94f6-a81d0850282c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:28.890144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5ab76332-e031-4085-94f6-a81d0850282c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150711 Aug 24 06:33:28.890710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 866/1725] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:28 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:29.590228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5e3276d5-a4a1-44ab-830f-49d0583d58d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:29.590835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5e3276d5-a4a1-44ab-830f-49d0583d58d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:29.597332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e3276d5-a4a1-44ab-830f-49d0583d58d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:29.597806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e3276d5-a4a1-44ab-830f-49d0583d58d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:29.598232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e3276d5-a4a1-44ab-830f-49d0583d58d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:29.598906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e3276d5-a4a1-44ab-830f-49d0583d58d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:29.599350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e3276d5-a4a1-44ab-830f-49d0583d58d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:29.599766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e3276d5-a4a1-44ab-830f-49d0583d58d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:29.661583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5e3276d5-a4a1-44ab-830f-49d0583d58d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:29.669782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5e3276d5-a4a1-44ab-830f-49d0583d58d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083417 Aug 24 06:33:29.670335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 860/1726] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:29.912247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4cd4a613-f424-4fa0-b37f-59d69deefea3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:29.913534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4cd4a613-f424-4fa0-b37f-59d69deefea3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:29.922054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cd4a613-f424-4fa0-b37f-59d69deefea3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:29.922054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cd4a613-f424-4fa0-b37f-59d69deefea3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:29.922054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cd4a613-f424-4fa0-b37f-59d69deefea3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:29.922540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cd4a613-f424-4fa0-b37f-59d69deefea3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:29.922994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cd4a613-f424-4fa0-b37f-59d69deefea3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:29.923408 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4cd4a613-f424-4fa0-b37f-59d69deefea3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:30.056963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4cd4a613-f424-4fa0-b37f-59d69deefea3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:30.065363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4cd4a613-f424-4fa0-b37f-59d69deefea3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157262 Aug 24 06:33:30.065928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 867/1727] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:29 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:30.690859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0d5e2539-d639-4c58-a287-5a8c0519b0ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:30.691461 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0d5e2539-d639-4c58-a287-5a8c0519b0ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:30.698034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d5e2539-d639-4c58-a287-5a8c0519b0ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:30.698517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d5e2539-d639-4c58-a287-5a8c0519b0ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:30.698951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d5e2539-d639-4c58-a287-5a8c0519b0ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:30.699641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d5e2539-d639-4c58-a287-5a8c0519b0ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:30.700116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d5e2539-d639-4c58-a287-5a8c0519b0ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:30.700569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d5e2539-d639-4c58-a287-5a8c0519b0ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:30.766819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0d5e2539-d639-4c58-a287-5a8c0519b0ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:30.775425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0d5e2539-d639-4c58-a287-5a8c0519b0ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088583 Aug 24 06:33:30.775980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 861/1728] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:31.085810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1bdb7f47-a1c6-4847-aaf4-6c6d493427a3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:31.086374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1bdb7f47-a1c6-4847-aaf4-6c6d493427a3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:31.092762 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1bdb7f47-a1c6-4847-aaf4-6c6d493427a3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:31.093239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1bdb7f47-a1c6-4847-aaf4-6c6d493427a3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:31.093665 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1bdb7f47-a1c6-4847-aaf4-6c6d493427a3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:31.094353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1bdb7f47-a1c6-4847-aaf4-6c6d493427a3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:31.094806 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1bdb7f47-a1c6-4847-aaf4-6c6d493427a3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:31.095224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1bdb7f47-a1c6-4847-aaf4-6c6d493427a3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:31.223013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1bdb7f47-a1c6-4847-aaf4-6c6d493427a3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:31.232178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1bdb7f47-a1c6-4847-aaf4-6c6d493427a3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150513 Aug 24 06:33:31.232803 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 868/1729] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:31 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:31.796670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4554c50b-dbb5-49c3-9aed-5de2499063b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:31.797282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4554c50b-dbb5-49c3-9aed-5de2499063b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:31.803758 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4554c50b-dbb5-49c3-9aed-5de2499063b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:31.804237 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4554c50b-dbb5-49c3-9aed-5de2499063b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:31.804700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4554c50b-dbb5-49c3-9aed-5de2499063b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:31.805391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4554c50b-dbb5-49c3-9aed-5de2499063b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:31.805841 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4554c50b-dbb5-49c3-9aed-5de2499063b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:31.806264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4554c50b-dbb5-49c3-9aed-5de2499063b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:31.867112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4554c50b-dbb5-49c3-9aed-5de2499063b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:31.875278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4554c50b-dbb5-49c3-9aed-5de2499063b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082555 Aug 24 06:33:31.875856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 862/1730] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:31 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:32.253200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-44ab75cc-480e-4166-8107-f665213c74a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:32.253816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-44ab75cc-480e-4166-8107-f665213c74a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:32.260939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44ab75cc-480e-4166-8107-f665213c74a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:32.261410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44ab75cc-480e-4166-8107-f665213c74a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:32.261833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44ab75cc-480e-4166-8107-f665213c74a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:32.262511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44ab75cc-480e-4166-8107-f665213c74a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:32.262953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44ab75cc-480e-4166-8107-f665213c74a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:32.263365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44ab75cc-480e-4166-8107-f665213c74a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:32.393980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-44ab75cc-480e-4166-8107-f665213c74a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:32.402456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-44ab75cc-480e-4166-8107-f665213c74a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153075 Aug 24 06:33:32.403140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 869/1731] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:32 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:32.896532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-014a1d1c-5b30-4941-8517-2a5a61d3837c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:32.897728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-014a1d1c-5b30-4941-8517-2a5a61d3837c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:32.903892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-014a1d1c-5b30-4941-8517-2a5a61d3837c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:32.904356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-014a1d1c-5b30-4941-8517-2a5a61d3837c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:32.904816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-014a1d1c-5b30-4941-8517-2a5a61d3837c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:32.905511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-014a1d1c-5b30-4941-8517-2a5a61d3837c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:32.905960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-014a1d1c-5b30-4941-8517-2a5a61d3837c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:32.906379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-014a1d1c-5b30-4941-8517-2a5a61d3837c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:32.966882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-014a1d1c-5b30-4941-8517-2a5a61d3837c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:32.975786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-014a1d1c-5b30-4941-8517-2a5a61d3837c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082464 Aug 24 06:33:32.976348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 863/1732] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:33.424041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b37d5981-f9c6-4e51-a035-596d838ba0ad tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:33.424687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b37d5981-f9c6-4e51-a035-596d838ba0ad tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:33.431803 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b37d5981-f9c6-4e51-a035-596d838ba0ad tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:33.432281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b37d5981-f9c6-4e51-a035-596d838ba0ad tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:33.432748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b37d5981-f9c6-4e51-a035-596d838ba0ad tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:33.433447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b37d5981-f9c6-4e51-a035-596d838ba0ad tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:33.434153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b37d5981-f9c6-4e51-a035-596d838ba0ad tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:33.434576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b37d5981-f9c6-4e51-a035-596d838ba0ad tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:33.568125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b37d5981-f9c6-4e51-a035-596d838ba0ad tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:33.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b37d5981-f9c6-4e51-a035-596d838ba0ad tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157256 Aug 24 06:33:33.578108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 870/1733] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:33 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:33.996383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-047dc939-ce4a-43c7-8447-6f5c6287c304 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:33.996962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-047dc939-ce4a-43c7-8447-6f5c6287c304 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:34.003421 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-047dc939-ce4a-43c7-8447-6f5c6287c304 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:34.003902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-047dc939-ce4a-43c7-8447-6f5c6287c304 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:34.004335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-047dc939-ce4a-43c7-8447-6f5c6287c304 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:34.005054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-047dc939-ce4a-43c7-8447-6f5c6287c304 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:34.005507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-047dc939-ce4a-43c7-8447-6f5c6287c304 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:34.005926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-047dc939-ce4a-43c7-8447-6f5c6287c304 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:34.070403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-047dc939-ce4a-43c7-8447-6f5c6287c304 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:34.078723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-047dc939-ce4a-43c7-8447-6f5c6287c304 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086228 Aug 24 06:33:34.079512 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 864/1734] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:34.233001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0d9bff72-4b24-42e1-9ebc-45426c08bfc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:34.233533 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0d9bff72-4b24-42e1-9ebc-45426c08bfc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:34.239969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d9bff72-4b24-42e1-9ebc-45426c08bfc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:34.241028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d9bff72-4b24-42e1-9ebc-45426c08bfc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:34.241461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d9bff72-4b24-42e1-9ebc-45426c08bfc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:34.242169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d9bff72-4b24-42e1-9ebc-45426c08bfc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:34.242640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d9bff72-4b24-42e1-9ebc-45426c08bfc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:34.243059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d9bff72-4b24-42e1-9ebc-45426c08bfc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:34.268534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0d9bff72-4b24-42e1-9ebc-45426c08bfc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:33:34.539083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0d9bff72-4b24-42e1-9ebc-45426c08bfc8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "DELETE /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 204 len: 0 microversion: 2.20 time: 0.309650 Aug 24 06:33:34.539768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 871/1735] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Aug 24 06:33:34 2022] DELETE /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 06:33:34.547813 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:34.552894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:34.554790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:34.555268 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:34.555696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:34.556379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:34.556861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:34.557314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:34.598624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-59873dfa-251d-4314-a014-22554eb9017b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:34.599362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-59873dfa-251d-4314-a014-22554eb9017b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:34.606582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59873dfa-251d-4314-a014-22554eb9017b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:34.610190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59873dfa-251d-4314-a014-22554eb9017b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:34.610190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59873dfa-251d-4314-a014-22554eb9017b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:34.610190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59873dfa-251d-4314-a014-22554eb9017b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:34.610190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59873dfa-251d-4314-a014-22554eb9017b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:34.610630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59873dfa-251d-4314-a014-22554eb9017b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:34.689886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:34.699317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:34.700830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:34.701991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-67dda110-dd97-43b1-aa2f-d9b918c63e0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158147 Aug 24 06:33:34.702611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 865/1736] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:34 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:34.744046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-59873dfa-251d-4314-a014-22554eb9017b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:34.752331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-59873dfa-251d-4314-a014-22554eb9017b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.158043 Aug 24 06:33:34.752928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 872/1737] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:34 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:35.099107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6bd01b8b-17d6-4c3b-a14f-994fa975acea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:35.099704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6bd01b8b-17d6-4c3b-a14f-994fa975acea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:35.106038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd01b8b-17d6-4c3b-a14f-994fa975acea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:35.106507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd01b8b-17d6-4c3b-a14f-994fa975acea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:35.106931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd01b8b-17d6-4c3b-a14f-994fa975acea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:35.107602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd01b8b-17d6-4c3b-a14f-994fa975acea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:35.108118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd01b8b-17d6-4c3b-a14f-994fa975acea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:35.108551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd01b8b-17d6-4c3b-a14f-994fa975acea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:35.172520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6bd01b8b-17d6-4c3b-a14f-994fa975acea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:35.175243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:35.182181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6bd01b8b-17d6-4c3b-a14f-994fa975acea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086849 Aug 24 06:33:35.182756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 866/1738] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:35.725077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:35.725674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:35.732402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:35.732915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:35.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:35.734026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:35.734469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:35.734883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:35.773346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-85ee4acb-e08c-4600-ac52-fd657c1e20e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:35.773960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-85ee4acb-e08c-4600-ac52-fd657c1e20e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:35.780435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-85ee4acb-e08c-4600-ac52-fd657c1e20e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:35.780949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-85ee4acb-e08c-4600-ac52-fd657c1e20e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:35.781382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-85ee4acb-e08c-4600-ac52-fd657c1e20e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:35.782128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-85ee4acb-e08c-4600-ac52-fd657c1e20e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:35.782585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-85ee4acb-e08c-4600-ac52-fd657c1e20e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:35.783006 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-85ee4acb-e08c-4600-ac52-fd657c1e20e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:35.866646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:35.875615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:35.877137 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:35.878289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6ac73c0e-f498-4e82-bdd5-0a78b6193b82 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157168 Aug 24 06:33:35.878841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 873/1739] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:35.911219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-85ee4acb-e08c-4600-ac52-fd657c1e20e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:35.919549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-85ee4acb-e08c-4600-ac52-fd657c1e20e0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150065 Aug 24 06:33:35.920137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 867/1740] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:35 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:36.204269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ca37ea3a-ca8d-49a3-a308-7853ddb79229 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:36.204898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ca37ea3a-ca8d-49a3-a308-7853ddb79229 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:36.210963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca37ea3a-ca8d-49a3-a308-7853ddb79229 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:36.211433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca37ea3a-ca8d-49a3-a308-7853ddb79229 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:36.211857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca37ea3a-ca8d-49a3-a308-7853ddb79229 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:36.212558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca37ea3a-ca8d-49a3-a308-7853ddb79229 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:36.213004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca37ea3a-ca8d-49a3-a308-7853ddb79229 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:36.213420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ca37ea3a-ca8d-49a3-a308-7853ddb79229 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:36.278267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ca37ea3a-ca8d-49a3-a308-7853ddb79229 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:36.286444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ca37ea3a-ca8d-49a3-a308-7853ddb79229 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086047 Aug 24 06:33:36.287012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 874/1741] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:36 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:36.902409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:36.903017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:36.909514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:36.909985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:36.910411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:36.911084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:36.911526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:36.911938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:37.013121 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2a909902-7f29-46be-b5b3-be010d2a9509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:37.013730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2a909902-7f29-46be-b5b3-be010d2a9509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:37.019628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a909902-7f29-46be-b5b3-be010d2a9509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:37.020112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a909902-7f29-46be-b5b3-be010d2a9509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:37.020579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a909902-7f29-46be-b5b3-be010d2a9509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:37.021276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a909902-7f29-46be-b5b3-be010d2a9509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:37.022428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a909902-7f29-46be-b5b3-be010d2a9509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:37.022858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a909902-7f29-46be-b5b3-be010d2a9509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:37.049281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:37.059016 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:37.060516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:37.061670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ce77692b-a04f-4d81-8e1f-5a70d4207a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163450 Aug 24 06:33:37.062224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 868/1742] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:37.151808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2a909902-7f29-46be-b5b3-be010d2a9509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:37.160113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2a909902-7f29-46be-b5b3-be010d2a9509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.222745 Aug 24 06:33:37.160771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 875/1743] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:36 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:37.307254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8aee6b06-2a10-4ed2-bb8f-e561cc173860 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:37.307778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8aee6b06-2a10-4ed2-bb8f-e561cc173860 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:37.314014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aee6b06-2a10-4ed2-bb8f-e561cc173860 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:37.314494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aee6b06-2a10-4ed2-bb8f-e561cc173860 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:37.314927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aee6b06-2a10-4ed2-bb8f-e561cc173860 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:37.315611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aee6b06-2a10-4ed2-bb8f-e561cc173860 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:37.316063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aee6b06-2a10-4ed2-bb8f-e561cc173860 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:37.316484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aee6b06-2a10-4ed2-bb8f-e561cc173860 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:37.376894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8aee6b06-2a10-4ed2-bb8f-e561cc173860 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:37.385420 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8aee6b06-2a10-4ed2-bb8f-e561cc173860 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082521 Aug 24 06:33:37.386069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 869/1744] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:38.085169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:38.085757 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:38.092118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:38.092628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:38.093064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:38.093751 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:38.094204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:38.094626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:38.181682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3bd60e3a-d54f-4ad7-bc3b-b659e4ed929b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:38.182296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3bd60e3a-d54f-4ad7-bc3b-b659e4ed929b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:38.189108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3bd60e3a-d54f-4ad7-bc3b-b659e4ed929b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:38.189590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3bd60e3a-d54f-4ad7-bc3b-b659e4ed929b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:38.190027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3bd60e3a-d54f-4ad7-bc3b-b659e4ed929b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:38.190725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3bd60e3a-d54f-4ad7-bc3b-b659e4ed929b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:38.191175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3bd60e3a-d54f-4ad7-bc3b-b659e4ed929b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:38.191596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3bd60e3a-d54f-4ad7-bc3b-b659e4ed929b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:38.230617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:38.239425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:38.241498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:38.242666 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-88790799-ebca-484f-a1a9-11dd9fca5fe5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161534 Aug 24 06:33:38.243235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 876/1745] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:38.317449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3bd60e3a-d54f-4ad7-bc3b-b659e4ed929b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:38.326459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3bd60e3a-d54f-4ad7-bc3b-b659e4ed929b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.149057 Aug 24 06:33:38.327031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 870/1746] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:38 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:38.406396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-09c32943-bf40-4642-a1f8-f535921adb09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:38.406935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-09c32943-bf40-4642-a1f8-f535921adb09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:38.413576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09c32943-bf40-4642-a1f8-f535921adb09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:38.414054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09c32943-bf40-4642-a1f8-f535921adb09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:38.414485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09c32943-bf40-4642-a1f8-f535921adb09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:38.415174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09c32943-bf40-4642-a1f8-f535921adb09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:38.415625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09c32943-bf40-4642-a1f8-f535921adb09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:38.416048 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09c32943-bf40-4642-a1f8-f535921adb09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:38.431202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:38.478388 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-09c32943-bf40-4642-a1f8-f535921adb09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:38.486968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-09c32943-bf40-4642-a1f8-f535921adb09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084424 Aug 24 06:33:38.487542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 877/1747] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:38 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:39.266107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:39.266649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:39.273656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:39.274134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:39.274562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:39.275245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:39.275692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:39.276110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:39.347271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7c149eca-5db1-4ed7-aa93-324ff8b2c03e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:39.347880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7c149eca-5db1-4ed7-aa93-324ff8b2c03e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:39.355300 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c149eca-5db1-4ed7-aa93-324ff8b2c03e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:39.355569 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c149eca-5db1-4ed7-aa93-324ff8b2c03e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:39.356004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c149eca-5db1-4ed7-aa93-324ff8b2c03e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:39.356743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c149eca-5db1-4ed7-aa93-324ff8b2c03e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:39.357200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c149eca-5db1-4ed7-aa93-324ff8b2c03e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:39.357620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c149eca-5db1-4ed7-aa93-324ff8b2c03e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:39.407356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:39.416132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:39.417646 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:39.418800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4696abf9-5c35-4cd4-90a5-2ffa5c546863 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156705 Aug 24 06:33:39.419352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 871/1748] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:39.491000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7c149eca-5db1-4ed7-aa93-324ff8b2c03e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:39.499309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7c149eca-5db1-4ed7-aa93-324ff8b2c03e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.156027 Aug 24 06:33:39.499877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 878/1749] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:39 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:39.510440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-84ed1fb4-73db-4963-a078-7d8e25df8add tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:39.511156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-84ed1fb4-73db-4963-a078-7d8e25df8add tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:39.517170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84ed1fb4-73db-4963-a078-7d8e25df8add tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:39.517646 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84ed1fb4-73db-4963-a078-7d8e25df8add tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:39.518080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84ed1fb4-73db-4963-a078-7d8e25df8add tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:39.518744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84ed1fb4-73db-4963-a078-7d8e25df8add tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:39.519181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84ed1fb4-73db-4963-a078-7d8e25df8add tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:39.519591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84ed1fb4-73db-4963-a078-7d8e25df8add tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:39.581009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-84ed1fb4-73db-4963-a078-7d8e25df8add tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:39.589703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-84ed1fb4-73db-4963-a078-7d8e25df8add tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083684 Aug 24 06:33:39.590275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 872/1750] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:39 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:40.442967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:40.443680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:40.450351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:40.450940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:40.451279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:40.451968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:40.452419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:40.452868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:40.521827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2cc680dd-720c-41f1-8191-f46e3ab6edd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:40.522441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2cc680dd-720c-41f1-8191-f46e3ab6edd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:40.528969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cc680dd-720c-41f1-8191-f46e3ab6edd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:40.531414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cc680dd-720c-41f1-8191-f46e3ab6edd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:40.531414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cc680dd-720c-41f1-8191-f46e3ab6edd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:40.531414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cc680dd-720c-41f1-8191-f46e3ab6edd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:40.531414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cc680dd-720c-41f1-8191-f46e3ab6edd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:40.532226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cc680dd-720c-41f1-8191-f46e3ab6edd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:40.582568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:40.591940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:40.593508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:40.594679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-552aa817-5fba-4ea3-9fcc-3a3b7e8f5521 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155702 Aug 24 06:33:40.595254 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 879/1751] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:40.610592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3fa0d96f-3b26-4e6a-ae96-c1ea4d648c68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:40.611211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3fa0d96f-3b26-4e6a-ae96-c1ea4d648c68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:40.617346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fa0d96f-3b26-4e6a-ae96-c1ea4d648c68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:40.617832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fa0d96f-3b26-4e6a-ae96-c1ea4d648c68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:40.618272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fa0d96f-3b26-4e6a-ae96-c1ea4d648c68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:40.618966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fa0d96f-3b26-4e6a-ae96-c1ea4d648c68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:40.619414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fa0d96f-3b26-4e6a-ae96-c1ea4d648c68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:40.619835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3fa0d96f-3b26-4e6a-ae96-c1ea4d648c68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:40.664746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2cc680dd-720c-41f1-8191-f46e3ab6edd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:40.673114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2cc680dd-720c-41f1-8191-f46e3ab6edd5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155638 Aug 24 06:33:40.673699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 873/1752] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:40 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:40.681573 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3fa0d96f-3b26-4e6a-ae96-c1ea4d648c68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:40.690490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3fa0d96f-3b26-4e6a-ae96-c1ea4d648c68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083747 Aug 24 06:33:40.691061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 880/1753] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:40 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:41.618979 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:41.619584 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:41.626084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:41.626562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:41.626992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:41.627675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:41.628123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:41.628566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:41.695034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-33cf2138-5056-493a-be2e-ddb344a19bdc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:41.695797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-33cf2138-5056-493a-be2e-ddb344a19bdc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:41.702302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33cf2138-5056-493a-be2e-ddb344a19bdc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:41.702793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33cf2138-5056-493a-be2e-ddb344a19bdc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:41.703232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33cf2138-5056-493a-be2e-ddb344a19bdc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:41.703932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33cf2138-5056-493a-be2e-ddb344a19bdc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:41.704445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33cf2138-5056-493a-be2e-ddb344a19bdc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:41.715930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33cf2138-5056-493a-be2e-ddb344a19bdc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:41.758215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:41.766785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:41.768261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:41.769431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-15108aec-3fc6-48e8-88c7-e706eb755ada tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155020 Aug 24 06:33:41.770373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 874/1754] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:41 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:41.775570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ff39a31e-9d12-47ce-993c-7e9a79e738df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:41.776362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ff39a31e-9d12-47ce-993c-7e9a79e738df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:41.782407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff39a31e-9d12-47ce-993c-7e9a79e738df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:41.782884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff39a31e-9d12-47ce-993c-7e9a79e738df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:41.783310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff39a31e-9d12-47ce-993c-7e9a79e738df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:41.783987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff39a31e-9d12-47ce-993c-7e9a79e738df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:41.784430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff39a31e-9d12-47ce-993c-7e9a79e738df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:41.785307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff39a31e-9d12-47ce-993c-7e9a79e738df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:41.841439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-33cf2138-5056-493a-be2e-ddb344a19bdc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:41.846601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ff39a31e-9d12-47ce-993c-7e9a79e738df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:41.850624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-33cf2138-5056-493a-be2e-ddb344a19bdc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.159600 Aug 24 06:33:41.851202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 881/1755] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:41 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:41.855624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ff39a31e-9d12-47ce-993c-7e9a79e738df tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083989 Aug 24 06:33:41.856259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 875/1756] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:41 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:42.793021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:42.793610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:42.800150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:42.802210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:42.802210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:42.802210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:42.802210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:42.803168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:42.871917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c76b0b48-4cab-4b05-8e39-1c51b871e208 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:42.872548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c76b0b48-4cab-4b05-8e39-1c51b871e208 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:42.879071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c76b0b48-4cab-4b05-8e39-1c51b871e208 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:42.879551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c76b0b48-4cab-4b05-8e39-1c51b871e208 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:42.879975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c76b0b48-4cab-4b05-8e39-1c51b871e208 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:42.880755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c76b0b48-4cab-4b05-8e39-1c51b871e208 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:42.881201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c76b0b48-4cab-4b05-8e39-1c51b871e208 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:42.881796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c76b0b48-4cab-4b05-8e39-1c51b871e208 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:42.935264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:42.944207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:42.945873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:42.947037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-aa7adda1-a2db-435f-a744-dbf663d18313 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158025 Aug 24 06:33:42.947592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 882/1757] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:42.951964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-342ffc3e-bbaa-42f0-8468-29bc21bd089c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:42.952702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-342ffc3e-bbaa-42f0-8468-29bc21bd089c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:42.959564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-342ffc3e-bbaa-42f0-8468-29bc21bd089c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:42.960040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-342ffc3e-bbaa-42f0-8468-29bc21bd089c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:42.960473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-342ffc3e-bbaa-42f0-8468-29bc21bd089c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:42.961188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-342ffc3e-bbaa-42f0-8468-29bc21bd089c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:42.961896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-342ffc3e-bbaa-42f0-8468-29bc21bd089c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:42.962317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-342ffc3e-bbaa-42f0-8468-29bc21bd089c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:43.016408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c76b0b48-4cab-4b05-8e39-1c51b871e208 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:43.024773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-342ffc3e-bbaa-42f0-8468-29bc21bd089c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:43.025023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c76b0b48-4cab-4b05-8e39-1c51b871e208 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157056 Aug 24 06:33:43.025601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 876/1758] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:42 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:43.033032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-342ffc3e-bbaa-42f0-8468-29bc21bd089c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084477 Aug 24 06:33:43.033588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 883/1759] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:42 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:43.970783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:43.971346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:43.973620 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=64 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:43.978311 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:43.978822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:43.979250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:43.979938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:43.980384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:43.980881 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:44.047063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9e9924a8-2725-499c-888f-de4e414149d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:44.047658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9e9924a8-2725-499c-888f-de4e414149d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:44.054880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e9924a8-2725-499c-888f-de4e414149d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:44.055363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e9924a8-2725-499c-888f-de4e414149d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:44.055827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e9924a8-2725-499c-888f-de4e414149d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:44.056544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e9924a8-2725-499c-888f-de4e414149d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:44.057011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e9924a8-2725-499c-888f-de4e414149d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:44.057434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e9924a8-2725-499c-888f-de4e414149d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:44.111293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:44.120722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:44.122258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:44.123415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ec4e86b8-33a6-40c2-b37f-1b48ef1a6237 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156668 Aug 24 06:33:44.124630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 877/1760] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:44.128425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f45a8f3b-3639-4e87-8000-fc54de077617 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:44.129607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f45a8f3b-3639-4e87-8000-fc54de077617 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:44.136109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f45a8f3b-3639-4e87-8000-fc54de077617 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:44.136620 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f45a8f3b-3639-4e87-8000-fc54de077617 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:44.137039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f45a8f3b-3639-4e87-8000-fc54de077617 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:44.137743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f45a8f3b-3639-4e87-8000-fc54de077617 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:44.138171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f45a8f3b-3639-4e87-8000-fc54de077617 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:44.138789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f45a8f3b-3639-4e87-8000-fc54de077617 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:44.190161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9e9924a8-2725-499c-888f-de4e414149d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:44.198652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9e9924a8-2725-499c-888f-de4e414149d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155583 Aug 24 06:33:44.199217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 884/1761] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:44 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:44.199352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f45a8f3b-3639-4e87-8000-fc54de077617 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:44.207584 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f45a8f3b-3639-4e87-8000-fc54de077617 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082643 Aug 24 06:33:44.208139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 878/1762] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:44 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:45.147204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:45.147806 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:45.154338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:45.154812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:45.155236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:45.155915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:45.156362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:45.156810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:45.220139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e726955d-6838-4df1-a987-a1ced5bde8c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:45.220762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e726955d-6838-4df1-a987-a1ced5bde8c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:45.228035 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e726955d-6838-4df1-a987-a1ced5bde8c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:45.228540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e726955d-6838-4df1-a987-a1ced5bde8c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:45.229002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e726955d-6838-4df1-a987-a1ced5bde8c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:45.229702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e726955d-6838-4df1-a987-a1ced5bde8c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:45.230151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e726955d-6838-4df1-a987-a1ced5bde8c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:45.230567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e726955d-6838-4df1-a987-a1ced5bde8c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:45.285577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:45.295323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:45.296873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:45.298408 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2e6d7c54-3357-4168-9569-707b4e89b871 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155097 Aug 24 06:33:45.298976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 885/1763] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:45.304602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-50a19c12-d19f-4714-a9e1-cc3b2b7206e9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:45.305631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-50a19c12-d19f-4714-a9e1-cc3b2b7206e9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:45.312858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50a19c12-d19f-4714-a9e1-cc3b2b7206e9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:45.313369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50a19c12-d19f-4714-a9e1-cc3b2b7206e9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:45.313804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50a19c12-d19f-4714-a9e1-cc3b2b7206e9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:45.314506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50a19c12-d19f-4714-a9e1-cc3b2b7206e9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:45.314953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50a19c12-d19f-4714-a9e1-cc3b2b7206e9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:45.315371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50a19c12-d19f-4714-a9e1-cc3b2b7206e9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:45.371850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e726955d-6838-4df1-a987-a1ced5bde8c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:45.380264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e726955d-6838-4df1-a987-a1ced5bde8c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.163904 Aug 24 06:33:45.381317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 879/1764] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:45 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:45.385116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-50a19c12-d19f-4714-a9e1-cc3b2b7206e9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:45.393631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-50a19c12-d19f-4714-a9e1-cc3b2b7206e9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093403 Aug 24 06:33:45.394190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 886/1765] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:45 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:46.322763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:46.323412 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:46.329857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:46.330334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:46.330766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:46.331456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:46.331906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:46.332326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:46.402354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fa441bc8-9867-49eb-be87-fa9db6631e9f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:46.402962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fa441bc8-9867-49eb-be87-fa9db6631e9f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:46.409705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa441bc8-9867-49eb-be87-fa9db6631e9f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:46.409963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa441bc8-9867-49eb-be87-fa9db6631e9f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:46.410492 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa441bc8-9867-49eb-be87-fa9db6631e9f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:46.411214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa441bc8-9867-49eb-be87-fa9db6631e9f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:46.411669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa441bc8-9867-49eb-be87-fa9db6631e9f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:46.412773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fa441bc8-9867-49eb-be87-fa9db6631e9f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:46.463792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:46.473156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:46.480805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:46.480805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-32e488eb-9413-44f0-ac82-198aa4668a41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157737 Aug 24 06:33:46.480805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 880/1766] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:46.481857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-80451467-142f-4622-88a0-d8b88aeee02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:46.482497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-80451467-142f-4622-88a0-d8b88aeee02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:46.488850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80451467-142f-4622-88a0-d8b88aeee02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:46.489342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80451467-142f-4622-88a0-d8b88aeee02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:46.489781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80451467-142f-4622-88a0-d8b88aeee02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:46.490517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80451467-142f-4622-88a0-d8b88aeee02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:46.490970 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80451467-142f-4622-88a0-d8b88aeee02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:46.491572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80451467-142f-4622-88a0-d8b88aeee02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:46.551413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fa441bc8-9867-49eb-be87-fa9db6631e9f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:46.554548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-80451467-142f-4622-88a0-d8b88aeee02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:46.560778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fa441bc8-9867-49eb-be87-fa9db6631e9f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.162184 Aug 24 06:33:46.561378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 887/1767] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:46 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:46.563359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-80451467-142f-4622-88a0-d8b88aeee02d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085234 Aug 24 06:33:46.563933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 881/1768] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:47.501785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:47.502397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:47.509323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:47.509808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:47.510244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:47.510941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:47.511421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:47.511847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:47.582574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6eaa8157-5b59-4aa3-8ccb-b351fcb19efb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:47.583194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6eaa8157-5b59-4aa3-8ccb-b351fcb19efb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:47.590104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6eaa8157-5b59-4aa3-8ccb-b351fcb19efb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:47.590762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6eaa8157-5b59-4aa3-8ccb-b351fcb19efb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:47.591085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6eaa8157-5b59-4aa3-8ccb-b351fcb19efb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:47.591792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6eaa8157-5b59-4aa3-8ccb-b351fcb19efb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:47.592305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6eaa8157-5b59-4aa3-8ccb-b351fcb19efb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:47.592751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6eaa8157-5b59-4aa3-8ccb-b351fcb19efb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:47.643727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:47.652684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:47.654192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:47.655348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2787ed0c-0a70-4cb2-8c3b-414d17ae458f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157597 Aug 24 06:33:47.655915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 888/1769] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:47.660770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-85e3dc8f-69b0-4734-a31e-8c9493c277ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:47.661380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-85e3dc8f-69b0-4734-a31e-8c9493c277ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:47.667911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85e3dc8f-69b0-4734-a31e-8c9493c277ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:47.668396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85e3dc8f-69b0-4734-a31e-8c9493c277ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:47.668860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85e3dc8f-69b0-4734-a31e-8c9493c277ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:47.669791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85e3dc8f-69b0-4734-a31e-8c9493c277ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:47.670339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85e3dc8f-69b0-4734-a31e-8c9493c277ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:47.670755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-85e3dc8f-69b0-4734-a31e-8c9493c277ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:47.730729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6eaa8157-5b59-4aa3-8ccb-b351fcb19efb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:47.736270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-85e3dc8f-69b0-4734-a31e-8c9493c277ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:47.739163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6eaa8157-5b59-4aa3-8ccb-b351fcb19efb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.160998 Aug 24 06:33:47.740000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 882/1770] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:47 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:47.745179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-85e3dc8f-69b0-4734-a31e-8c9493c277ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087980 Aug 24 06:33:47.745745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 889/1771] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:48.679761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:48.680359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:48.687476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:48.687953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:48.688379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:48.689106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:48.689548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:48.689957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:48.705938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:48.761383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cb5a1579-8017-4902-8e38-f80ffa6609d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:48.762007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cb5a1579-8017-4902-8e38-f80ffa6609d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:48.768588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb5a1579-8017-4902-8e38-f80ffa6609d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:48.769072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb5a1579-8017-4902-8e38-f80ffa6609d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:48.769502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb5a1579-8017-4902-8e38-f80ffa6609d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:48.770200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb5a1579-8017-4902-8e38-f80ffa6609d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:48.770648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb5a1579-8017-4902-8e38-f80ffa6609d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:48.771067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cb5a1579-8017-4902-8e38-f80ffa6609d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:48.825412 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:48.834052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:48.835544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:48.836764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c1a8255e-432f-4f87-96aa-43d2e2553e6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161459 Aug 24 06:33:48.837725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 883/1772] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:48.841686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-539e4e3c-0384-4779-821e-0b361b3ffa58 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:48.842285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-539e4e3c-0384-4779-821e-0b361b3ffa58 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:48.848127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-539e4e3c-0384-4779-821e-0b361b3ffa58 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:48.848637 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-539e4e3c-0384-4779-821e-0b361b3ffa58 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:48.849548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-539e4e3c-0384-4779-821e-0b361b3ffa58 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:48.850243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-539e4e3c-0384-4779-821e-0b361b3ffa58 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:48.850685 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-539e4e3c-0384-4779-821e-0b361b3ffa58 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:48.851095 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-539e4e3c-0384-4779-821e-0b361b3ffa58 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:48.911965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cb5a1579-8017-4902-8e38-f80ffa6609d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:48.912111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-539e4e3c-0384-4779-821e-0b361b3ffa58 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:48.917585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cb5a1579-8017-4902-8e38-f80ffa6609d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.160009 Aug 24 06:33:48.918148 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 890/1773] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:48 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:48.919921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-539e4e3c-0384-4779-821e-0b361b3ffa58 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.081639 Aug 24 06:33:48.920488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 884/1774] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:49.859459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:49.860044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:49.867219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:49.871914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:49.871914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:49.871914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:49.871914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:49.872301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:49.939806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0bfc404a-c1c3-4c21-a919-bc44164ab96b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:49.940439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0bfc404a-c1c3-4c21-a919-bc44164ab96b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:49.947421 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bfc404a-c1c3-4c21-a919-bc44164ab96b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:49.947887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bfc404a-c1c3-4c21-a919-bc44164ab96b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:49.948343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bfc404a-c1c3-4c21-a919-bc44164ab96b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:49.949061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bfc404a-c1c3-4c21-a919-bc44164ab96b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:49.949789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bfc404a-c1c3-4c21-a919-bc44164ab96b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:49.949928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bfc404a-c1c3-4c21-a919-bc44164ab96b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:50.003264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:50.012291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:50.013840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:50.015059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6e9e27e7-fb0b-4e6f-8607-91f9cbe6ab37 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159579 Aug 24 06:33:50.015637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 891/1775] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:50.020212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c0a2292e-0e4c-4712-ad2a-ba538348d4a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:50.020851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c0a2292e-0e4c-4712-ad2a-ba538348d4a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:50.027224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0a2292e-0e4c-4712-ad2a-ba538348d4a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:50.027708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0a2292e-0e4c-4712-ad2a-ba538348d4a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:50.028141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0a2292e-0e4c-4712-ad2a-ba538348d4a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:50.028929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0a2292e-0e4c-4712-ad2a-ba538348d4a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:50.029446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0a2292e-0e4c-4712-ad2a-ba538348d4a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:50.029871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0a2292e-0e4c-4712-ad2a-ba538348d4a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:50.084624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0bfc404a-c1c3-4c21-a919-bc44164ab96b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:50.093085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0bfc404a-c1c3-4c21-a919-bc44164ab96b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157161 Aug 24 06:33:50.093671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 885/1776] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:49 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:50.095146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c0a2292e-0e4c-4712-ad2a-ba538348d4a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:50.104152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c0a2292e-0e4c-4712-ad2a-ba538348d4a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087549 Aug 24 06:33:50.104734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 892/1777] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:51.038834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:51.039408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:51.045937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:51.046419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:51.046853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:51.047547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:51.047999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:51.048428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:51.115515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ed3142e5-de45-4b5a-99f9-52d051d03670 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:51.116285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ed3142e5-de45-4b5a-99f9-52d051d03670 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:51.122924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ed3142e5-de45-4b5a-99f9-52d051d03670 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:51.123412 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ed3142e5-de45-4b5a-99f9-52d051d03670 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:51.123843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ed3142e5-de45-4b5a-99f9-52d051d03670 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:51.124575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ed3142e5-de45-4b5a-99f9-52d051d03670 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:51.125031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ed3142e5-de45-4b5a-99f9-52d051d03670 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:51.125483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ed3142e5-de45-4b5a-99f9-52d051d03670 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:51.179507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:51.188959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:51.190472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:51.191649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-169cbf5f-7c9e-4f7d-8f31-7d5f52b771aa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156825 Aug 24 06:33:51.192205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 886/1778] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:51 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:51.196641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-69d9f07a-8bf2-4022-90d8-56378b0b7116 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:51.197350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-69d9f07a-8bf2-4022-90d8-56378b0b7116 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:51.203280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d9f07a-8bf2-4022-90d8-56378b0b7116 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:51.203759 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d9f07a-8bf2-4022-90d8-56378b0b7116 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:51.204518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d9f07a-8bf2-4022-90d8-56378b0b7116 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:51.204893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d9f07a-8bf2-4022-90d8-56378b0b7116 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:51.205343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d9f07a-8bf2-4022-90d8-56378b0b7116 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:51.205761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-69d9f07a-8bf2-4022-90d8-56378b0b7116 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:51.258140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ed3142e5-de45-4b5a-99f9-52d051d03670 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:51.266929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ed3142e5-de45-4b5a-99f9-52d051d03670 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155868 Aug 24 06:33:51.267525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 893/1779] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:51 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:51.269762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-69d9f07a-8bf2-4022-90d8-56378b0b7116 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:51.278062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-69d9f07a-8bf2-4022-90d8-56378b0b7116 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084887 Aug 24 06:33:51.278624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 887/1780] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:52.215472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:52.216078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:52.218433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:52.223164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:52.223646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:52.224688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:52.225398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:52.225822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:52.226241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:52.228911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:33:52.289697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5c94e258-dcb9-494a-9af5-6e4c2ab55333 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:52.290419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5c94e258-dcb9-494a-9af5-6e4c2ab55333 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:52.298402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c94e258-dcb9-494a-9af5-6e4c2ab55333 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:52.298889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c94e258-dcb9-494a-9af5-6e4c2ab55333 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:52.300020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c94e258-dcb9-494a-9af5-6e4c2ab55333 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:52.300158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c94e258-dcb9-494a-9af5-6e4c2ab55333 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:52.300640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c94e258-dcb9-494a-9af5-6e4c2ab55333 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:52.304910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5c94e258-dcb9-494a-9af5-6e4c2ab55333 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:52.363996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:52.375605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:52.377142 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:52.378304 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7376b832-c180-4f06-ad04-1cbcc4eff894 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.166815 Aug 24 06:33:52.378890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 894/1781] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:52.383388 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b92f6f49-cf49-4bbe-96e2-5b164be0de82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:52.383993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b92f6f49-cf49-4bbe-96e2-5b164be0de82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:52.390235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b92f6f49-cf49-4bbe-96e2-5b164be0de82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:52.390712 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b92f6f49-cf49-4bbe-96e2-5b164be0de82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:52.391137 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b92f6f49-cf49-4bbe-96e2-5b164be0de82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:52.391828 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b92f6f49-cf49-4bbe-96e2-5b164be0de82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:52.392275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b92f6f49-cf49-4bbe-96e2-5b164be0de82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:52.392725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b92f6f49-cf49-4bbe-96e2-5b164be0de82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:52.440943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5c94e258-dcb9-494a-9af5-6e4c2ab55333 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:52.449599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5c94e258-dcb9-494a-9af5-6e4c2ab55333 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164592 Aug 24 06:33:52.450184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 888/1782] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:52 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:52.460144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b92f6f49-cf49-4bbe-96e2-5b164be0de82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:52.468515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b92f6f49-cf49-4bbe-96e2-5b164be0de82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088654 Aug 24 06:33:52.469096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 895/1783] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:52 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:53.401539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:53.402087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:53.408622 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:53.409101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:53.409525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:53.410207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:53.410647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:53.411057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:53.471424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6a80067e-2a06-4934-bf14-0ca6f1cefcc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:53.472196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6a80067e-2a06-4934-bf14-0ca6f1cefcc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:53.479369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a80067e-2a06-4934-bf14-0ca6f1cefcc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:53.479846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a80067e-2a06-4934-bf14-0ca6f1cefcc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:53.480276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a80067e-2a06-4934-bf14-0ca6f1cefcc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:53.481009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a80067e-2a06-4934-bf14-0ca6f1cefcc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:53.481456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a80067e-2a06-4934-bf14-0ca6f1cefcc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:53.481875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6a80067e-2a06-4934-bf14-0ca6f1cefcc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:53.547897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:53.558096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:53.559883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:53.561105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bc16e32c-bc87-4e1b-8ee6-33621451d829 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163636 Aug 24 06:33:53.561767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 889/1784] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:53.567194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-490d7cb3-e909-49b3-9e97-99ecd78accde tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:53.567194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-490d7cb3-e909-49b3-9e97-99ecd78accde tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:53.573281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-490d7cb3-e909-49b3-9e97-99ecd78accde tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:53.573872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-490d7cb3-e909-49b3-9e97-99ecd78accde tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:53.574217 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-490d7cb3-e909-49b3-9e97-99ecd78accde tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:53.575215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-490d7cb3-e909-49b3-9e97-99ecd78accde tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:53.575673 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-490d7cb3-e909-49b3-9e97-99ecd78accde tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:53.576104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-490d7cb3-e909-49b3-9e97-99ecd78accde tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:53.621230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6a80067e-2a06-4934-bf14-0ca6f1cefcc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:53.630464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6a80067e-2a06-4934-bf14-0ca6f1cefcc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.162917 Aug 24 06:33:53.631523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 896/1785] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:53 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:53.645167 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-490d7cb3-e909-49b3-9e97-99ecd78accde tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:53.654286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-490d7cb3-e909-49b3-9e97-99ecd78accde tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.091450 Aug 24 06:33:53.654929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 890/1786] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:54.586496 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:54.587109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:54.593718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:54.594199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:54.594636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:54.595336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:54.595787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:54.596218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:54.651401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f523bcf4-6b86-4d80-b888-e0cddb177019 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:54.651996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f523bcf4-6b86-4d80-b888-e0cddb177019 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:54.658579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f523bcf4-6b86-4d80-b888-e0cddb177019 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:54.659055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f523bcf4-6b86-4d80-b888-e0cddb177019 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:54.659482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f523bcf4-6b86-4d80-b888-e0cddb177019 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:54.660167 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f523bcf4-6b86-4d80-b888-e0cddb177019 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:54.660639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f523bcf4-6b86-4d80-b888-e0cddb177019 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:54.661055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f523bcf4-6b86-4d80-b888-e0cddb177019 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:54.736611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:54.746148 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:54.747936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:54.749277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0283d007-1ebd-421e-9f1d-c28ea7938abc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.167809 Aug 24 06:33:54.749815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 897/1787] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:54 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:54.754281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6acbcda3-5606-4758-81fa-df96db086609 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:54.754885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6acbcda3-5606-4758-81fa-df96db086609 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:54.761782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6acbcda3-5606-4758-81fa-df96db086609 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:54.762413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6acbcda3-5606-4758-81fa-df96db086609 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:54.762892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6acbcda3-5606-4758-81fa-df96db086609 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:54.763872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6acbcda3-5606-4758-81fa-df96db086609 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:54.764461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6acbcda3-5606-4758-81fa-df96db086609 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:54.765049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6acbcda3-5606-4758-81fa-df96db086609 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:54.798396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f523bcf4-6b86-4d80-b888-e0cddb177019 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:54.807505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f523bcf4-6b86-4d80-b888-e0cddb177019 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.159861 Aug 24 06:33:54.808084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 891/1788] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:54 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:54.835317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6acbcda3-5606-4758-81fa-df96db086609 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:54.843994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6acbcda3-5606-4758-81fa-df96db086609 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093137 Aug 24 06:33:54.844489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 898/1789] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:55.772821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:55.773422 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:55.779892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:55.780364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:55.780820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:55.781500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:55.781973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:55.782383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:55.829586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c4e77054-1b70-467c-9e0c-5f5c5ef3d71f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:55.830300 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c4e77054-1b70-467c-9e0c-5f5c5ef3d71f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:55.838008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4e77054-1b70-467c-9e0c-5f5c5ef3d71f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:55.838492 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4e77054-1b70-467c-9e0c-5f5c5ef3d71f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:55.838921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4e77054-1b70-467c-9e0c-5f5c5ef3d71f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:55.839641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4e77054-1b70-467c-9e0c-5f5c5ef3d71f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:55.840087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4e77054-1b70-467c-9e0c-5f5c5ef3d71f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:55.840537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4e77054-1b70-467c-9e0c-5f5c5ef3d71f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:55.917979 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:55.927083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:55.929218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:55.930410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-41790cc0-8849-42f1-985f-bb4657ba8b72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161615 Aug 24 06:33:55.930970 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 892/1790] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:55.936290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c4e73c87-d9cb-4b2b-8279-4c99cbf77c45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:55.936915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c4e73c87-d9cb-4b2b-8279-4c99cbf77c45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:55.947396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c4e73c87-d9cb-4b2b-8279-4c99cbf77c45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:55.947879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c4e73c87-d9cb-4b2b-8279-4c99cbf77c45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:55.948308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c4e73c87-d9cb-4b2b-8279-4c99cbf77c45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:55.949037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c4e73c87-d9cb-4b2b-8279-4c99cbf77c45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:55.949487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c4e73c87-d9cb-4b2b-8279-4c99cbf77c45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:55.949904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c4e73c87-d9cb-4b2b-8279-4c99cbf77c45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:55.981248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c4e77054-1b70-467c-9e0c-5f5c5ef3d71f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:55.989694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c4e77054-1b70-467c-9e0c-5f5c5ef3d71f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164015 Aug 24 06:33:55.990275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 899/1791] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:55 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:56.240970 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c4e73c87-d9cb-4b2b-8279-4c99cbf77c45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:56.249324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c4e73c87-d9cb-4b2b-8279-4c99cbf77c45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.317382 Aug 24 06:33:56.249902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 893/1792] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:55 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:56.952749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:56.953361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:56.959876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:56.960303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:56.960766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:56.961462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:56.961909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:56.962326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:57.011767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5cd8dc8d-6d99-4e57-ad90-d79cdc1385f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:57.012364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5cd8dc8d-6d99-4e57-ad90-d79cdc1385f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:57.018939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc8d-6d99-4e57-ad90-d79cdc1385f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:57.019420 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc8d-6d99-4e57-ad90-d79cdc1385f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:57.019850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc8d-6d99-4e57-ad90-d79cdc1385f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:57.020583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc8d-6d99-4e57-ad90-d79cdc1385f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:57.021037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc8d-6d99-4e57-ad90-d79cdc1385f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:57.021458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5cd8dc8d-6d99-4e57-ad90-d79cdc1385f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:57.095766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:57.105747 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:57.107294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:57.108528 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6ed1c425-265d-49bf-a470-ec2ada12eb0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159729 Aug 24 06:33:57.109087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 900/1793] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:57.153951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5cd8dc8d-6d99-4e57-ad90-d79cdc1385f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:57.161271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5cd8dc8d-6d99-4e57-ad90-d79cdc1385f0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153371 Aug 24 06:33:57.161840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 894/1794] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:57 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:57.269925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-73152b5b-a920-413d-8137-0ff6929adaf4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:57.270445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-73152b5b-a920-413d-8137-0ff6929adaf4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:57.276448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73152b5b-a920-413d-8137-0ff6929adaf4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:57.276966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73152b5b-a920-413d-8137-0ff6929adaf4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:57.277400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73152b5b-a920-413d-8137-0ff6929adaf4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:57.278092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73152b5b-a920-413d-8137-0ff6929adaf4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:57.278541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73152b5b-a920-413d-8137-0ff6929adaf4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:57.278962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-73152b5b-a920-413d-8137-0ff6929adaf4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:57.343663 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-73152b5b-a920-413d-8137-0ff6929adaf4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:57.352649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-73152b5b-a920-413d-8137-0ff6929adaf4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086682 Aug 24 06:33:57.353225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 901/1795] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:57 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:58.133172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:58.133736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:58.140624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:58.141098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:58.141523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:58.142205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:58.142657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:58.143071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:58.184100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d2349b9c-5924-497a-99fd-adff93e5079e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:58.184832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d2349b9c-5924-497a-99fd-adff93e5079e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:58.191442 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2349b9c-5924-497a-99fd-adff93e5079e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:58.191928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2349b9c-5924-497a-99fd-adff93e5079e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:58.192363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2349b9c-5924-497a-99fd-adff93e5079e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:58.193089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2349b9c-5924-497a-99fd-adff93e5079e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:58.193617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2349b9c-5924-497a-99fd-adff93e5079e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:58.194044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2349b9c-5924-497a-99fd-adff93e5079e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:58.278170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:58.288105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:58.289632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:58.290797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-80202667-28fa-45be-a911-5c12c1051a53 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161755 Aug 24 06:33:58.291356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 895/1796] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:58 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:58.329608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d2349b9c-5924-497a-99fd-adff93e5079e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:58.338459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d2349b9c-5924-497a-99fd-adff93e5079e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.158503 Aug 24 06:33:58.339024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 902/1797] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:58 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:58.372759 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b6b87b0d-45f8-4194-b31a-bd77193576d6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:58.373361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b6b87b0d-45f8-4194-b31a-bd77193576d6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:58.379298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6b87b0d-45f8-4194-b31a-bd77193576d6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:58.379774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6b87b0d-45f8-4194-b31a-bd77193576d6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:58.380206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6b87b0d-45f8-4194-b31a-bd77193576d6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:58.380912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6b87b0d-45f8-4194-b31a-bd77193576d6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:58.381997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6b87b0d-45f8-4194-b31a-bd77193576d6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:58.382416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6b87b0d-45f8-4194-b31a-bd77193576d6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:58.442671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b6b87b0d-45f8-4194-b31a-bd77193576d6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:58.451481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b6b87b0d-45f8-4194-b31a-bd77193576d6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082595 Aug 24 06:33:58.452075 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 896/1798] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:33:59.314282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:59.315147 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:59.322329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:59.322804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:59.323234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:59.323926 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:59.324366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:59.324843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:59.362630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-39a6b0b7-24ff-4461-adb0-68aeb82ae61e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:59.363750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-39a6b0b7-24ff-4461-adb0-68aeb82ae61e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:59.374624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a6b0b7-24ff-4461-adb0-68aeb82ae61e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:59.375111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a6b0b7-24ff-4461-adb0-68aeb82ae61e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:59.375546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a6b0b7-24ff-4461-adb0-68aeb82ae61e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:59.376247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a6b0b7-24ff-4461-adb0-68aeb82ae61e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:59.376722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a6b0b7-24ff-4461-adb0-68aeb82ae61e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:59.377139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-39a6b0b7-24ff-4461-adb0-68aeb82ae61e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:59.470130 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:59.480232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:59.481770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:59.482935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9392e0dc-ad27-423a-ae79-ae8c6f2bcc3b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.172652 Aug 24 06:33:59.483490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 903/1799] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:33:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:33:59.488537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8e3beed3-8395-410f-9dac-260c9d223472 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:33:59.488537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8e3beed3-8395-410f-9dac-260c9d223472 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:33:59.495291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e3beed3-8395-410f-9dac-260c9d223472 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:59.496400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e3beed3-8395-410f-9dac-260c9d223472 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:59.496400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e3beed3-8395-410f-9dac-260c9d223472 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:59.496934 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e3beed3-8395-410f-9dac-260c9d223472 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:33:59.497380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e3beed3-8395-410f-9dac-260c9d223472 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:33:59.497797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e3beed3-8395-410f-9dac-260c9d223472 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:33:59.514149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-39a6b0b7-24ff-4461-adb0-68aeb82ae61e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:59.523352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-39a6b0b7-24ff-4461-adb0-68aeb82ae61e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.167864 Aug 24 06:33:59.524231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 897/1800] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:59 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:33:59.569168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8e3beed3-8395-410f-9dac-260c9d223472 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:33:59.577468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8e3beed3-8395-410f-9dac-260c9d223472 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093010 Aug 24 06:33:59.578037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 904/1801] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:33:59 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:00.508066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:00.508733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:00.515522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:00.516002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:00.516431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:00.517154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:00.517600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:00.518018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:00.544896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-09252c1a-26df-4b4b-ad05-d8efc245b89b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:00.545500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-09252c1a-26df-4b4b-ad05-d8efc245b89b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:00.552177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09252c1a-26df-4b4b-ad05-d8efc245b89b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:00.552687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09252c1a-26df-4b4b-ad05-d8efc245b89b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:00.553667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09252c1a-26df-4b4b-ad05-d8efc245b89b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:00.554357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09252c1a-26df-4b4b-ad05-d8efc245b89b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:00.554799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09252c1a-26df-4b4b-ad05-d8efc245b89b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:00.555210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09252c1a-26df-4b4b-ad05-d8efc245b89b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:00.654966 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:00.663948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:00.665463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:00.666612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c1b1135a-50ef-4f26-a64c-3132c17eaf46 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163176 Aug 24 06:34:00.667166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 898/1802] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:00 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:00.681915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-32b2343a-3837-4970-806c-f90faf6dd578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:00.683072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-32b2343a-3837-4970-806c-f90faf6dd578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:00.693392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32b2343a-3837-4970-806c-f90faf6dd578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:00.694259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-09252c1a-26df-4b4b-ad05-d8efc245b89b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:00.694776 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32b2343a-3837-4970-806c-f90faf6dd578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:00.695344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32b2343a-3837-4970-806c-f90faf6dd578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:00.696421 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32b2343a-3837-4970-806c-f90faf6dd578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:00.697072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32b2343a-3837-4970-806c-f90faf6dd578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:00.697557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32b2343a-3837-4970-806c-f90faf6dd578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:00.710122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-09252c1a-26df-4b4b-ad05-d8efc245b89b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.168752 Aug 24 06:34:00.710939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 905/1803] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:00 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:00.760531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-32b2343a-3837-4970-806c-f90faf6dd578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:00.768670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-32b2343a-3837-4970-806c-f90faf6dd578 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.094663 Aug 24 06:34:00.769238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 899/1804] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:01.690306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:01.690938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:01.697448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:01.697921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:01.701005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:01.701005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:01.701005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:01.701005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:01.731581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0cc0725c-9a1d-4f9f-a57c-f3504779fd2f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:01.732184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0cc0725c-9a1d-4f9f-a57c-f3504779fd2f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:01.738779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0cc0725c-9a1d-4f9f-a57c-f3504779fd2f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:01.739256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0cc0725c-9a1d-4f9f-a57c-f3504779fd2f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:01.739681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0cc0725c-9a1d-4f9f-a57c-f3504779fd2f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:01.741030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0cc0725c-9a1d-4f9f-a57c-f3504779fd2f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:01.741469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0cc0725c-9a1d-4f9f-a57c-f3504779fd2f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:01.741884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0cc0725c-9a1d-4f9f-a57c-f3504779fd2f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:01.745995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:01.831642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:01.841798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:01.844898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:01.846003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ea384c9a-b360-403b-b51f-0fb095045e50 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159590 Aug 24 06:34:01.846817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 906/1805] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:01.851753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1726c10a-2444-422d-a2cd-1f13ebe2cf13 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:01.852372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1726c10a-2444-422d-a2cd-1f13ebe2cf13 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:01.858261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1726c10a-2444-422d-a2cd-1f13ebe2cf13 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:01.858700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1726c10a-2444-422d-a2cd-1f13ebe2cf13 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:01.859192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1726c10a-2444-422d-a2cd-1f13ebe2cf13 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:01.859983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1726c10a-2444-422d-a2cd-1f13ebe2cf13 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:01.860798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1726c10a-2444-422d-a2cd-1f13ebe2cf13 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:01.860925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1726c10a-2444-422d-a2cd-1f13ebe2cf13 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:01.871267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0cc0725c-9a1d-4f9f-a57c-f3504779fd2f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:01.879390 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0cc0725c-9a1d-4f9f-a57c-f3504779fd2f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151646 Aug 24 06:34:01.879956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 900/1806] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:01 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:01.926010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1726c10a-2444-422d-a2cd-1f13ebe2cf13 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:01.934634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1726c10a-2444-422d-a2cd-1f13ebe2cf13 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086853 Aug 24 06:34:01.935198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 907/1807] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:02.870768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:02.871371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:02.877447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:02.877919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:02.878417 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:02.879092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:02.879535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:02.879948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:02.901561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-30a7f5ff-a5f9-4490-853e-864970c90ded tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:02.902170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-30a7f5ff-a5f9-4490-853e-864970c90ded tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:02.908730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30a7f5ff-a5f9-4490-853e-864970c90ded tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:02.909213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30a7f5ff-a5f9-4490-853e-864970c90ded tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:02.909670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30a7f5ff-a5f9-4490-853e-864970c90ded tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:02.910350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30a7f5ff-a5f9-4490-853e-864970c90ded tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:02.910795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30a7f5ff-a5f9-4490-853e-864970c90ded tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:02.911220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30a7f5ff-a5f9-4490-853e-864970c90ded tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:03.013501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:03.022801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:03.024576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:03.025787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9a9c1346-42e3-45b1-a5cc-75342d2b7043 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159168 Aug 24 06:34:03.026348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 901/1808] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:03.030770 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b215bec2-2ee9-4a1b-9168-0be551961a68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:03.031372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b215bec2-2ee9-4a1b-9168-0be551961a68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:03.038194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b215bec2-2ee9-4a1b-9168-0be551961a68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:03.038678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b215bec2-2ee9-4a1b-9168-0be551961a68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:03.039115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b215bec2-2ee9-4a1b-9168-0be551961a68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:03.039812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b215bec2-2ee9-4a1b-9168-0be551961a68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:03.040261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b215bec2-2ee9-4a1b-9168-0be551961a68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:03.040747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b215bec2-2ee9-4a1b-9168-0be551961a68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:03.045495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-30a7f5ff-a5f9-4490-853e-864970c90ded tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:03.053820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-30a7f5ff-a5f9-4490-853e-864970c90ded tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.156114 Aug 24 06:34:03.054998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 908/1809] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:02 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:03.102908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b215bec2-2ee9-4a1b-9168-0be551961a68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:03.111136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b215bec2-2ee9-4a1b-9168-0be551961a68 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083852 Aug 24 06:34:03.111734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 902/1810] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:03 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:04.050296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:04.050901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:04.057431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:04.057903 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:04.058328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:04.059267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:04.059714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:04.060132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:04.075929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0d7dda6b-abf4-4270-b4c6-b520081b75f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:04.076556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0d7dda6b-abf4-4270-b4c6-b520081b75f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:04.083005 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d7dda6b-abf4-4270-b4c6-b520081b75f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:04.083489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d7dda6b-abf4-4270-b4c6-b520081b75f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:04.083951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d7dda6b-abf4-4270-b4c6-b520081b75f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:04.085220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d7dda6b-abf4-4270-b4c6-b520081b75f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:04.085674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d7dda6b-abf4-4270-b4c6-b520081b75f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:04.086096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d7dda6b-abf4-4270-b4c6-b520081b75f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:04.198361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:04.207845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:04.209997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:04.211677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-553c653b-53d1-4f5f-a3b5-e8e3187eadc2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.164840 Aug 24 06:34:04.218368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 909/1811] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:04 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:04.223888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0da20a9b-66d5-404a-a8a3-413da5bfead5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:04.224397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0da20a9b-66d5-404a-a8a3-413da5bfead5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:04.229624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0d7dda6b-abf4-4270-b4c6-b520081b75f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:04.230757 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0da20a9b-66d5-404a-a8a3-413da5bfead5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:04.231238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0da20a9b-66d5-404a-a8a3-413da5bfead5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:04.231712 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0da20a9b-66d5-404a-a8a3-413da5bfead5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:04.232444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0da20a9b-66d5-404a-a8a3-413da5bfead5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:04.232920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0da20a9b-66d5-404a-a8a3-413da5bfead5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:04.233339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0da20a9b-66d5-404a-a8a3-413da5bfead5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:04.238449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0d7dda6b-abf4-4270-b4c6-b520081b75f7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.166397 Aug 24 06:34:04.239033 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 903/1812] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:04 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:04.300189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0da20a9b-66d5-404a-a8a3-413da5bfead5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:04.302386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:04.309705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0da20a9b-66d5-404a-a8a3-413da5bfead5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.090166 Aug 24 06:34:04.310265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 910/1813] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:05.234521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:05.235115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:05.241647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:05.242124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:05.242554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:05.243248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:05.243704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:05.244123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:05.260394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6ed17391-355c-4413-9a98-dd0a1f690509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:05.261073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6ed17391-355c-4413-9a98-dd0a1f690509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:05.267958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed17391-355c-4413-9a98-dd0a1f690509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:05.268440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed17391-355c-4413-9a98-dd0a1f690509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:05.268897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed17391-355c-4413-9a98-dd0a1f690509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:05.269588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed17391-355c-4413-9a98-dd0a1f690509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:05.270031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed17391-355c-4413-9a98-dd0a1f690509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:05.270453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ed17391-355c-4413-9a98-dd0a1f690509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:05.380617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:05.390354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:05.391819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:05.393032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6be2c3a2-9577-4704-b7c0-c3fad16685d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.162475 Aug 24 06:34:05.393710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 904/1814] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:05.399042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-272fd027-3988-4a72-bc93-e31d4c983f9d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:05.399640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-272fd027-3988-4a72-bc93-e31d4c983f9d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:05.412993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6ed17391-355c-4413-9a98-dd0a1f690509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:05.413576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-272fd027-3988-4a72-bc93-e31d4c983f9d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:05.414074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-272fd027-3988-4a72-bc93-e31d4c983f9d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:05.414508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-272fd027-3988-4a72-bc93-e31d4c983f9d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:05.415222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-272fd027-3988-4a72-bc93-e31d4c983f9d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:05.415718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-272fd027-3988-4a72-bc93-e31d4c983f9d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:05.416128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-272fd027-3988-4a72-bc93-e31d4c983f9d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:05.421551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6ed17391-355c-4413-9a98-dd0a1f690509 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164957 Aug 24 06:34:05.422164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 911/1815] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:05 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:05.479390 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-272fd027-3988-4a72-bc93-e31d4c983f9d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:05.487687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-272fd027-3988-4a72-bc93-e31d4c983f9d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.092995 Aug 24 06:34:05.488296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 905/1816] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:06.418170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:06.418824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:06.425392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:06.425866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:06.426296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:06.426980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:06.427422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:06.428415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:06.443431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-45592f4f-33d2-4851-b6af-b6f6ea76cec1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:06.444298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-45592f4f-33d2-4851-b6af-b6f6ea76cec1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:06.450889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-45592f4f-33d2-4851-b6af-b6f6ea76cec1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:06.451494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-45592f4f-33d2-4851-b6af-b6f6ea76cec1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:06.451940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-45592f4f-33d2-4851-b6af-b6f6ea76cec1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:06.452678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-45592f4f-33d2-4851-b6af-b6f6ea76cec1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:06.453136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-45592f4f-33d2-4851-b6af-b6f6ea76cec1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:06.453562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-45592f4f-33d2-4851-b6af-b6f6ea76cec1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:06.563674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:06.572899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:06.574489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:06.575611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f96c72c9-9409-462c-95ed-2377524b565c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161353 Aug 24 06:34:06.576175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 912/1817] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:06.580640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3d41755b-a97e-4e06-b192-9ce249e76e3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:06.581238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3d41755b-a97e-4e06-b192-9ce249e76e3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:06.587711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d41755b-a97e-4e06-b192-9ce249e76e3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:06.588203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d41755b-a97e-4e06-b192-9ce249e76e3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:06.588667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d41755b-a97e-4e06-b192-9ce249e76e3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:06.588823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-45592f4f-33d2-4851-b6af-b6f6ea76cec1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:06.589365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d41755b-a97e-4e06-b192-9ce249e76e3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:06.589811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d41755b-a97e-4e06-b192-9ce249e76e3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:06.590228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d41755b-a97e-4e06-b192-9ce249e76e3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:06.597518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-45592f4f-33d2-4851-b6af-b6f6ea76cec1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.158084 Aug 24 06:34:06.598090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 906/1818] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:06 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:06.655286 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3d41755b-a97e-4e06-b192-9ce249e76e3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:06.666462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3d41755b-a97e-4e06-b192-9ce249e76e3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086788 Aug 24 06:34:06.667067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 913/1819] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:07.599959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:07.600596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:07.607029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:07.607501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:07.607927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:07.608645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:07.609099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:07.609519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:07.619653 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-104f431b-a34e-4282-b77a-7cd4af48c548 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:07.620274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-104f431b-a34e-4282-b77a-7cd4af48c548 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:07.626942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-104f431b-a34e-4282-b77a-7cd4af48c548 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:07.627419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-104f431b-a34e-4282-b77a-7cd4af48c548 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:07.627855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-104f431b-a34e-4282-b77a-7cd4af48c548 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:07.628580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-104f431b-a34e-4282-b77a-7cd4af48c548 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:07.629036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-104f431b-a34e-4282-b77a-7cd4af48c548 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:07.629451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-104f431b-a34e-4282-b77a-7cd4af48c548 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:07.747282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:07.756558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:07.758475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:07.759759 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-475bb5f2-6c4b-4534-8cf7-dac01e4cfca1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.164216 Aug 24 06:34:07.760328 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 907/1820] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:07 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:07.765273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-193ebad7-03fe-402a-b619-f76e41c52dd7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:07.765448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-104f431b-a34e-4282-b77a-7cd4af48c548 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:07.765870 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-193ebad7-03fe-402a-b619-f76e41c52dd7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:07.771976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-193ebad7-03fe-402a-b619-f76e41c52dd7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:07.772616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-193ebad7-03fe-402a-b619-f76e41c52dd7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:07.773142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-193ebad7-03fe-402a-b619-f76e41c52dd7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:07.773892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-193ebad7-03fe-402a-b619-f76e41c52dd7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:07.774406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-193ebad7-03fe-402a-b619-f76e41c52dd7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:07.774654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-104f431b-a34e-4282-b77a-7cd4af48c548 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.159341 Aug 24 06:34:07.774982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-193ebad7-03fe-402a-b619-f76e41c52dd7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:07.775229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 914/1821] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:07 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:07.838936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-193ebad7-03fe-402a-b619-f76e41c52dd7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:07.847131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-193ebad7-03fe-402a-b619-f76e41c52dd7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085650 Aug 24 06:34:07.847691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 908/1822] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:08.782251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:08.782838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:08.789471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:08.789954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:08.790386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:08.791085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:08.791532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:08.791951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:08.795530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f7cac1e4-6a27-41d4-8612-ca1a228fcc16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:08.796160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f7cac1e4-6a27-41d4-8612-ca1a228fcc16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:08.803445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7cac1e4-6a27-41d4-8612-ca1a228fcc16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:08.803855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7cac1e4-6a27-41d4-8612-ca1a228fcc16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:08.806342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7cac1e4-6a27-41d4-8612-ca1a228fcc16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:08.806342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7cac1e4-6a27-41d4-8612-ca1a228fcc16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:08.806342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7cac1e4-6a27-41d4-8612-ca1a228fcc16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:08.806342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f7cac1e4-6a27-41d4-8612-ca1a228fcc16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:08.924866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:08.934871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:08.936488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:08.937769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c821e13e-791f-4b88-ae8d-e1afd6ef753f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159472 Aug 24 06:34:08.938489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 915/1823] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:08.944962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f7cac1e4-6a27-41d4-8612-ca1a228fcc16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:08.950611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2b6ba13d-bb1b-4d37-9bdb-7db014924354 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:08.951445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2b6ba13d-bb1b-4d37-9bdb-7db014924354 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:08.953607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f7cac1e4-6a27-41d4-8612-ca1a228fcc16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.161916 Aug 24 06:34:08.954614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 909/1824] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:08 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:08.957780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b6ba13d-bb1b-4d37-9bdb-7db014924354 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:08.958257 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b6ba13d-bb1b-4d37-9bdb-7db014924354 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:08.958725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b6ba13d-bb1b-4d37-9bdb-7db014924354 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:08.959428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b6ba13d-bb1b-4d37-9bdb-7db014924354 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:08.959872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b6ba13d-bb1b-4d37-9bdb-7db014924354 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:08.960288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b6ba13d-bb1b-4d37-9bdb-7db014924354 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:09.026868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2b6ba13d-bb1b-4d37-9bdb-7db014924354 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:09.035229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2b6ba13d-bb1b-4d37-9bdb-7db014924354 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.095528 Aug 24 06:34:09.035799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 916/1825] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:09.962061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:09.962645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:09.969160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:09.969630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:09.970062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:09.970753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:09.971202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:09.971616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:09.974834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3f258e8d-26b3-41ac-9229-43922e81aacb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:09.975450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3f258e8d-26b3-41ac-9229-43922e81aacb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:09.981886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f258e8d-26b3-41ac-9229-43922e81aacb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:09.982365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f258e8d-26b3-41ac-9229-43922e81aacb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:09.982803 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f258e8d-26b3-41ac-9229-43922e81aacb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:09.983506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f258e8d-26b3-41ac-9229-43922e81aacb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:09.983954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f258e8d-26b3-41ac-9229-43922e81aacb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:09.984409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3f258e8d-26b3-41ac-9229-43922e81aacb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:10.103010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:10.111858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:10.113397 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:10.114574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-268753c6-7364-41bd-b6e1-f7d968afee57 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157184 Aug 24 06:34:10.115143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 910/1826] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:10.117514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3f258e8d-26b3-41ac-9229-43922e81aacb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:10.119635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e9fd4128-980b-4d46-934b-e01fc872d716 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:10.120453 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e9fd4128-980b-4d46-934b-e01fc872d716 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:10.126225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3f258e8d-26b3-41ac-9229-43922e81aacb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155173 Aug 24 06:34:10.126548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9fd4128-980b-4d46-934b-e01fc872d716 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:10.127031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9fd4128-980b-4d46-934b-e01fc872d716 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:10.127462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9fd4128-980b-4d46-934b-e01fc872d716 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:10.128158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9fd4128-980b-4d46-934b-e01fc872d716 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:10.128647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9fd4128-980b-4d46-934b-e01fc872d716 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:10.129072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e9fd4128-980b-4d46-934b-e01fc872d716 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:10.129941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 917/1827] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:09 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:10.190198 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e9fd4128-980b-4d46-934b-e01fc872d716 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:10.199058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e9fd4128-980b-4d46-934b-e01fc872d716 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082959 Aug 24 06:34:10.199639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 911/1828] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:10 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:11.139438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:11.139438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:11.146046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:11.146046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:11.146046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:11.147923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:11.148378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:11.148824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:11.148963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-164328f8-1bca-4591-8f3e-dc7f7fe5d2a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:11.149544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-164328f8-1bca-4591-8f3e-dc7f7fe5d2a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:11.156311 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-164328f8-1bca-4591-8f3e-dc7f7fe5d2a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:11.156817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-164328f8-1bca-4591-8f3e-dc7f7fe5d2a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:11.157242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-164328f8-1bca-4591-8f3e-dc7f7fe5d2a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:11.157926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-164328f8-1bca-4591-8f3e-dc7f7fe5d2a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:11.158366 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-164328f8-1bca-4591-8f3e-dc7f7fe5d2a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:11.158773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-164328f8-1bca-4591-8f3e-dc7f7fe5d2a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:11.289352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:11.298343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:11.299869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:11.300546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-164328f8-1bca-4591-8f3e-dc7f7fe5d2a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:11.301139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-03982c40-bf5c-4ef0-9986-05f1974f5faa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.167910 Aug 24 06:34:11.301714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 918/1829] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:11.307007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-91b60caf-153f-4fde-a6e0-0c1795cf0913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:11.308011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-91b60caf-153f-4fde-a6e0-0c1795cf0913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:11.310898 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-164328f8-1bca-4591-8f3e-dc7f7fe5d2a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.167021 Aug 24 06:34:11.311694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 912/1830] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:11 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:11.313906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b60caf-153f-4fde-a6e0-0c1795cf0913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:11.314423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b60caf-153f-4fde-a6e0-0c1795cf0913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:11.314859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b60caf-153f-4fde-a6e0-0c1795cf0913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:11.315563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b60caf-153f-4fde-a6e0-0c1795cf0913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:11.316016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b60caf-153f-4fde-a6e0-0c1795cf0913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:11.316437 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91b60caf-153f-4fde-a6e0-0c1795cf0913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:11.381206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-91b60caf-153f-4fde-a6e0-0c1795cf0913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:11.389650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-91b60caf-153f-4fde-a6e0-0c1795cf0913 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086914 Aug 24 06:34:11.390168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 919/1831] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:12.325167 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:12.325783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:12.332100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:12.332511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4990fd78-7aa9-4999-910c-a63814451469 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:12.333005 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:12.333005 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:12.333202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4990fd78-7aa9-4999-910c-a63814451469 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:12.335291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:12.335748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:12.336165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:12.340274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4990fd78-7aa9-4999-910c-a63814451469 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:12.340787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4990fd78-7aa9-4999-910c-a63814451469 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:12.341221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4990fd78-7aa9-4999-910c-a63814451469 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:12.341920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4990fd78-7aa9-4999-910c-a63814451469 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:12.342368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4990fd78-7aa9-4999-910c-a63814451469 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:12.342789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4990fd78-7aa9-4999-910c-a63814451469 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:12.465534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:12.473702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4990fd78-7aa9-4999-910c-a63814451469 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:12.475072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:12.476607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:12.477789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-27a50b6f-41b5-41c7-aac9-7dc6360d7aec tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156523 Aug 24 06:34:12.478370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 913/1832] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:12.483025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2038dc90-acaf-4fe1-b21b-ce697f3c2d96 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:12.483258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4990fd78-7aa9-4999-910c-a63814451469 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154538 Aug 24 06:34:12.483630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2038dc90-acaf-4fe1-b21b-ce697f3c2d96 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:12.492018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 920/1833] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:12 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:12.492258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2038dc90-acaf-4fe1-b21b-ce697f3c2d96 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:12.492258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2038dc90-acaf-4fe1-b21b-ce697f3c2d96 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:12.492258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2038dc90-acaf-4fe1-b21b-ce697f3c2d96 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:12.492258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2038dc90-acaf-4fe1-b21b-ce697f3c2d96 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:12.492658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2038dc90-acaf-4fe1-b21b-ce697f3c2d96 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:12.492889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2038dc90-acaf-4fe1-b21b-ce697f3c2d96 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:12.556130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2038dc90-acaf-4fe1-b21b-ce697f3c2d96 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:12.564923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2038dc90-acaf-4fe1-b21b-ce697f3c2d96 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085470 Aug 24 06:34:12.565499 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 914/1834] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:13.501951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:13.502552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:13.504372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ba5a9240-8703-439e-a1ae-f8102e51997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:13.505047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ba5a9240-8703-439e-a1ae-f8102e51997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:13.509819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:13.510332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:13.510774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:13.511476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:13.511930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:13.512093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba5a9240-8703-439e-a1ae-f8102e51997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:13.512363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:13.512611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba5a9240-8703-439e-a1ae-f8102e51997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:13.513050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba5a9240-8703-439e-a1ae-f8102e51997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:13.513745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba5a9240-8703-439e-a1ae-f8102e51997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:13.514197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba5a9240-8703-439e-a1ae-f8102e51997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:13.514619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba5a9240-8703-439e-a1ae-f8102e51997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:13.645887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:13.647387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ba5a9240-8703-439e-a1ae-f8102e51997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:13.655081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:13.655554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ba5a9240-8703-439e-a1ae-f8102e51997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154928 Aug 24 06:34:13.656131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 915/1835] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:13 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:13.656612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:13.657820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e2e78a78-56ec-40db-b3ff-bec25e95a651 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159904 Aug 24 06:34:13.658698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 921/1836] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:13 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:13.660794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7520d434-63a5-4907-9425-606201d932de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:13.661404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7520d434-63a5-4907-9425-606201d932de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:13.668059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7520d434-63a5-4907-9425-606201d932de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:13.668571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7520d434-63a5-4907-9425-606201d932de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:13.669009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7520d434-63a5-4907-9425-606201d932de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:13.669714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7520d434-63a5-4907-9425-606201d932de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:13.670172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7520d434-63a5-4907-9425-606201d932de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:13.670593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7520d434-63a5-4907-9425-606201d932de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:13.740077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7520d434-63a5-4907-9425-606201d932de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:13.742025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:13.748621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7520d434-63a5-4907-9425-606201d932de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.091492 Aug 24 06:34:13.749185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 916/1837] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:14.677251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fcd00667-221d-48b7-a69c-a4a2ed04d517 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:14.678468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fcd00667-221d-48b7-a69c-a4a2ed04d517 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:14.681422 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:14.682031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:14.685300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=80 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:14.685760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fcd00667-221d-48b7-a69c-a4a2ed04d517 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:14.686256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fcd00667-221d-48b7-a69c-a4a2ed04d517 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:14.686694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fcd00667-221d-48b7-a69c-a4a2ed04d517 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:14.687454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fcd00667-221d-48b7-a69c-a4a2ed04d517 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:14.687878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fcd00667-221d-48b7-a69c-a4a2ed04d517 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:14.688302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fcd00667-221d-48b7-a69c-a4a2ed04d517 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:14.690466 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:14.690953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:14.691674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:14.692385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:14.692902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:14.693317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:14.826000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fcd00667-221d-48b7-a69c-a4a2ed04d517 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:14.827533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:14.835402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fcd00667-221d-48b7-a69c-a4a2ed04d517 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.162019 Aug 24 06:34:14.835985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 922/1838] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:14 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:14.840550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cf6b9234-e3da-4968-8442-e4619aca2ae6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:14.841149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cf6b9234-e3da-4968-8442-e4619aca2ae6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:14.841440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:14.843291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:14.844629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-090143c0-78cd-4f8b-ba85-946346951013 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.167603 Aug 24 06:34:14.845287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 917/1839] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:14.847167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf6b9234-e3da-4968-8442-e4619aca2ae6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:14.847651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf6b9234-e3da-4968-8442-e4619aca2ae6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:14.848086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf6b9234-e3da-4968-8442-e4619aca2ae6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:14.848812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf6b9234-e3da-4968-8442-e4619aca2ae6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:14.849861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf6b9234-e3da-4968-8442-e4619aca2ae6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:14.850290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cf6b9234-e3da-4968-8442-e4619aca2ae6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:14.913352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cf6b9234-e3da-4968-8442-e4619aca2ae6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:14.921841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cf6b9234-e3da-4968-8442-e4619aca2ae6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084851 Aug 24 06:34:14.922415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 923/1840] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:15.856968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2416301a-2145-492c-817a-731d266426c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:15.857578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2416301a-2145-492c-817a-731d266426c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:15.864118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2416301a-2145-492c-817a-731d266426c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:15.865215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2416301a-2145-492c-817a-731d266426c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:15.865669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2416301a-2145-492c-817a-731d266426c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:15.866598 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2416301a-2145-492c-817a-731d266426c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:15.867057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2416301a-2145-492c-817a-731d266426c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:15.867482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2416301a-2145-492c-817a-731d266426c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:15.868456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:15.869090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:15.875598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:15.876069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:15.876513 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:15.877207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:15.877651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:15.878065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:16.000687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2416301a-2145-492c-817a-731d266426c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:16.007997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:16.010153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2416301a-2145-492c-817a-731d266426c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157077 Aug 24 06:34:16.010741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 918/1841] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:15 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:16.015242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e384b490-4461-4432-8eb5-811b88dfdbe2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:16.015845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e384b490-4461-4432-8eb5-811b88dfdbe2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:16.016985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:16.018551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:16.019717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-475922d8-1ae8-403f-bc1a-d7bb3119eedd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155933 Aug 24 06:34:16.020448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 924/1842] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:16.023415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e384b490-4461-4432-8eb5-811b88dfdbe2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:16.023987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e384b490-4461-4432-8eb5-811b88dfdbe2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:16.024480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e384b490-4461-4432-8eb5-811b88dfdbe2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:16.025275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e384b490-4461-4432-8eb5-811b88dfdbe2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:16.025732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e384b490-4461-4432-8eb5-811b88dfdbe2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:16.026154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e384b490-4461-4432-8eb5-811b88dfdbe2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:16.086609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e384b490-4461-4432-8eb5-811b88dfdbe2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:16.095210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e384b490-4461-4432-8eb5-811b88dfdbe2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083489 Aug 24 06:34:16.095755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 919/1843] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:17.032203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-510fd37f-cd74-4090-8448-5c17ac6d8710 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:17.032818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-510fd37f-cd74-4090-8448-5c17ac6d8710 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:17.039414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510fd37f-cd74-4090-8448-5c17ac6d8710 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:17.039897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510fd37f-cd74-4090-8448-5c17ac6d8710 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:17.040358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510fd37f-cd74-4090-8448-5c17ac6d8710 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:17.041075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510fd37f-cd74-4090-8448-5c17ac6d8710 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:17.041532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510fd37f-cd74-4090-8448-5c17ac6d8710 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:17.041955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-510fd37f-cd74-4090-8448-5c17ac6d8710 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:17.043062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:17.043678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:17.050146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:17.050626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:17.051063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:17.051762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:17.052222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:17.052683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:17.179911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-510fd37f-cd74-4090-8448-5c17ac6d8710 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:17.184893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:17.191062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-510fd37f-cd74-4090-8448-5c17ac6d8710 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.162873 Aug 24 06:34:17.191642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 925/1844] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:17 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:17.193536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:17.195043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:17.196110 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-64b487c1-0594-44ce-ac76-c5c9d164408f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:17.196248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-87ffe295-4da6-4f52-a819-53644d57020c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156992 Aug 24 06:34:17.196741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-64b487c1-0594-44ce-ac76-c5c9d164408f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:17.207980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 920/1845] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:17.208214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b487c1-0594-44ce-ac76-c5c9d164408f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:17.208214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b487c1-0594-44ce-ac76-c5c9d164408f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:17.208214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b487c1-0594-44ce-ac76-c5c9d164408f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:17.208214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b487c1-0594-44ce-ac76-c5c9d164408f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:17.209108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b487c1-0594-44ce-ac76-c5c9d164408f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:17.209108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-64b487c1-0594-44ce-ac76-c5c9d164408f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:17.266647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-64b487c1-0594-44ce-ac76-c5c9d164408f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:17.275291 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-64b487c1-0594-44ce-ac76-c5c9d164408f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082711 Aug 24 06:34:17.275873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 926/1846] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:17 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:18.215178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0d40cf4f-5ca7-4e8d-a2aa-136963c90a46 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:18.215875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0d40cf4f-5ca7-4e8d-a2aa-136963c90a46 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:18.220003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:18.220686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:18.222608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d40cf4f-5ca7-4e8d-a2aa-136963c90a46 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:18.223085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d40cf4f-5ca7-4e8d-a2aa-136963c90a46 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:18.223524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d40cf4f-5ca7-4e8d-a2aa-136963c90a46 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:18.224332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d40cf4f-5ca7-4e8d-a2aa-136963c90a46 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:18.224805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d40cf4f-5ca7-4e8d-a2aa-136963c90a46 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:18.225216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d40cf4f-5ca7-4e8d-a2aa-136963c90a46 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:18.227243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:18.227721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:18.228163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:18.228887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:18.229346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:18.229769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:18.245159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:18.363157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0d40cf4f-5ca7-4e8d-a2aa-136963c90a46 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:18.367177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:18.371676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0d40cf4f-5ca7-4e8d-a2aa-136963c90a46 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.161525 Aug 24 06:34:18.372248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 921/1847] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:18 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:18.375984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:18.384099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-171966bb-2545-436e-af69-6686683a2c43 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:18.384099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-171966bb-2545-436e-af69-6686683a2c43 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:18.384355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:18.384355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c08dd535-47df-4247-9ddb-3e4c55953026 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.162704 Aug 24 06:34:18.384355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 927/1848] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:18.384720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-171966bb-2545-436e-af69-6686683a2c43 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:18.384720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-171966bb-2545-436e-af69-6686683a2c43 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:18.384720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-171966bb-2545-436e-af69-6686683a2c43 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:18.385243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-171966bb-2545-436e-af69-6686683a2c43 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:18.385688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-171966bb-2545-436e-af69-6686683a2c43 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:18.386106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-171966bb-2545-436e-af69-6686683a2c43 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:18.447990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-171966bb-2545-436e-af69-6686683a2c43 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:18.456110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-171966bb-2545-436e-af69-6686683a2c43 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082827 Aug 24 06:34:18.456696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 922/1849] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:19.395076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-01e2b950-94e0-4273-8867-641c7904d28e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:19.395703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-01e2b950-94e0-4273-8867-641c7904d28e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:19.402170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:19.402749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:19.403629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01e2b950-94e0-4273-8867-641c7904d28e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:19.404104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01e2b950-94e0-4273-8867-641c7904d28e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:19.404566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01e2b950-94e0-4273-8867-641c7904d28e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:19.405253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01e2b950-94e0-4273-8867-641c7904d28e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:19.405715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01e2b950-94e0-4273-8867-641c7904d28e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:19.406147 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-01e2b950-94e0-4273-8867-641c7904d28e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:19.409216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:19.409687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:19.410112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:19.410789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:19.411234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:19.411651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:19.536233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-01e2b950-94e0-4273-8867-641c7904d28e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:19.543532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:19.544521 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-01e2b950-94e0-4273-8867-641c7904d28e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153323 Aug 24 06:34:19.545112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 928/1850] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:19 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:19.549746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-08c226d4-a596-4deb-820e-e061942fc67d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:19.550349 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-08c226d4-a596-4deb-820e-e061942fc67d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:19.553037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:19.554547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:19.555734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f81eca47-2520-4545-8d32-f0d54dea6b9d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157410 Aug 24 06:34:19.556438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 923/1851] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:19.556831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08c226d4-a596-4deb-820e-e061942fc67d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:19.557311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08c226d4-a596-4deb-820e-e061942fc67d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:19.557744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08c226d4-a596-4deb-820e-e061942fc67d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:19.558432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08c226d4-a596-4deb-820e-e061942fc67d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:19.559148 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08c226d4-a596-4deb-820e-e061942fc67d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:19.559554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08c226d4-a596-4deb-820e-e061942fc67d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:19.619577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-08c226d4-a596-4deb-820e-e061942fc67d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:19.627732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-08c226d4-a596-4deb-820e-e061942fc67d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.081497 Aug 24 06:34:19.628296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 929/1852] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:20.565914 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a11f8998-3909-4e2b-8420-6b31b2614cd8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:20.566522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a11f8998-3909-4e2b-8420-6b31b2614cd8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:20.573492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a11f8998-3909-4e2b-8420-6b31b2614cd8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:20.573969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a11f8998-3909-4e2b-8420-6b31b2614cd8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:20.574396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a11f8998-3909-4e2b-8420-6b31b2614cd8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:20.575079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a11f8998-3909-4e2b-8420-6b31b2614cd8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:20.575525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a11f8998-3909-4e2b-8420-6b31b2614cd8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:20.575938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a11f8998-3909-4e2b-8420-6b31b2614cd8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:20.578427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:20.579159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:20.586127 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:20.586597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:20.587024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:20.587711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:20.588154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:20.588602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:20.704821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a11f8998-3909-4e2b-8420-6b31b2614cd8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:20.713148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a11f8998-3909-4e2b-8420-6b31b2614cd8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151016 Aug 24 06:34:20.713725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 924/1853] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:20 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:20.718299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:20.719194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d36ce4fe-ee48-407f-a7fc-0d2b8444dfd9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:20.719802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d36ce4fe-ee48-407f-a7fc-0d2b8444dfd9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:20.726443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36ce4fe-ee48-407f-a7fc-0d2b8444dfd9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:20.726937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36ce4fe-ee48-407f-a7fc-0d2b8444dfd9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:20.727364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36ce4fe-ee48-407f-a7fc-0d2b8444dfd9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:20.727490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:20.728088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36ce4fe-ee48-407f-a7fc-0d2b8444dfd9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:20.728571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36ce4fe-ee48-407f-a7fc-0d2b8444dfd9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:20.729034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d36ce4fe-ee48-407f-a7fc-0d2b8444dfd9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:20.729163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:20.730164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f073fe62-122b-4746-973b-779545c7cafe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155516 Aug 24 06:34:20.730727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 930/1854] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:20 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:20.790173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d36ce4fe-ee48-407f-a7fc-0d2b8444dfd9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:20.798440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d36ce4fe-ee48-407f-a7fc-0d2b8444dfd9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083735 Aug 24 06:34:20.799028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 925/1855] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:21.733766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2a302677-e11f-4270-b1a8-56449dfc9967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:21.734535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2a302677-e11f-4270-b1a8-56449dfc9967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:21.742016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a302677-e11f-4270-b1a8-56449dfc9967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:21.742497 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a302677-e11f-4270-b1a8-56449dfc9967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:21.742932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a302677-e11f-4270-b1a8-56449dfc9967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:21.743622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a302677-e11f-4270-b1a8-56449dfc9967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:21.744075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a302677-e11f-4270-b1a8-56449dfc9967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:21.744516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2a302677-e11f-4270-b1a8-56449dfc9967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:21.752906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:21.753528 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:21.760407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:21.760915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:21.761626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:21.762308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:21.762750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:21.763169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:21.877888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2a302677-e11f-4270-b1a8-56449dfc9967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:21.886292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2a302677-e11f-4270-b1a8-56449dfc9967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.156361 Aug 24 06:34:21.888628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 931/1856] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:21 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:21.891760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-90412a80-318a-4077-9f75-68c384d8f93e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:21.892360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-90412a80-318a-4077-9f75-68c384d8f93e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:21.897731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:21.898259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-90412a80-318a-4077-9f75-68c384d8f93e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:21.898737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-90412a80-318a-4077-9f75-68c384d8f93e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:21.899167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-90412a80-318a-4077-9f75-68c384d8f93e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:21.899855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-90412a80-318a-4077-9f75-68c384d8f93e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:21.900302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-90412a80-318a-4077-9f75-68c384d8f93e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:21.900741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-90412a80-318a-4077-9f75-68c384d8f93e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:21.906494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:21.908014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:21.909195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b9c0bb2c-cfcd-4ce0-9316-75ad7780d72d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.160162 Aug 24 06:34:21.909745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 926/1857] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:21.961824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-90412a80-318a-4077-9f75-68c384d8f93e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:21.970337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-90412a80-318a-4077-9f75-68c384d8f93e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082550 Aug 24 06:34:21.970917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 932/1858] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:21 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:22.907666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-343d5155-cac7-4fff-bc43-7f94cdc57e3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:22.908258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-343d5155-cac7-4fff-bc43-7f94cdc57e3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:22.915232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-343d5155-cac7-4fff-bc43-7f94cdc57e3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:22.915701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-343d5155-cac7-4fff-bc43-7f94cdc57e3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:22.916126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-343d5155-cac7-4fff-bc43-7f94cdc57e3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:22.916837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-343d5155-cac7-4fff-bc43-7f94cdc57e3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:22.917277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-343d5155-cac7-4fff-bc43-7f94cdc57e3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:22.917693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-343d5155-cac7-4fff-bc43-7f94cdc57e3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:22.933602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:22.934461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:22.936840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=78 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:22.941443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:22.941931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:22.942367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:22.943059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:22.943508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:22.943926 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:23.048457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-343d5155-cac7-4fff-bc43-7f94cdc57e3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:23.056927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-343d5155-cac7-4fff-bc43-7f94cdc57e3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153040 Aug 24 06:34:23.057631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 927/1859] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:22 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:23.062363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c85afaad-6c06-4752-b93a-7e0d0e266d57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:23.063043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c85afaad-6c06-4752-b93a-7e0d0e266d57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:23.069007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85afaad-6c06-4752-b93a-7e0d0e266d57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:23.069639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85afaad-6c06-4752-b93a-7e0d0e266d57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:23.070115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85afaad-6c06-4752-b93a-7e0d0e266d57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:23.070899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85afaad-6c06-4752-b93a-7e0d0e266d57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:23.071350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85afaad-6c06-4752-b93a-7e0d0e266d57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:23.071764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c85afaad-6c06-4752-b93a-7e0d0e266d57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:23.077495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:23.087239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:23.089014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:23.090269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8c30643d-cb32-4686-9008-869f33154202 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.160528 Aug 24 06:34:23.091083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 933/1860] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:22 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:23.133600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c85afaad-6c06-4752-b93a-7e0d0e266d57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:23.141694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c85afaad-6c06-4752-b93a-7e0d0e266d57 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083053 Aug 24 06:34:23.142256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 928/1861] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:23 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:24.078505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-499d64d0-b0a5-424c-9663-313e7c33262a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:24.079067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-499d64d0-b0a5-424c-9663-313e7c33262a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:24.085486 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499d64d0-b0a5-424c-9663-313e7c33262a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:24.085962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499d64d0-b0a5-424c-9663-313e7c33262a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:24.086394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499d64d0-b0a5-424c-9663-313e7c33262a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:24.087079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499d64d0-b0a5-424c-9663-313e7c33262a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:24.087527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499d64d0-b0a5-424c-9663-313e7c33262a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:24.087947 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-499d64d0-b0a5-424c-9663-313e7c33262a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:24.115216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:24.115833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:24.122222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:24.122696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:24.123121 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:24.123803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:24.124247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:24.124694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:24.216039 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-499d64d0-b0a5-424c-9663-313e7c33262a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:24.224856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-499d64d0-b0a5-424c-9663-313e7c33262a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150254 Aug 24 06:34:24.225434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 934/1862] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:24 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:24.230069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-82e67c64-bc24-4db0-9e07-0b91e32535b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:24.230886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-82e67c64-bc24-4db0-9e07-0b91e32535b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:24.236863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82e67c64-bc24-4db0-9e07-0b91e32535b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:24.237357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82e67c64-bc24-4db0-9e07-0b91e32535b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:24.237799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82e67c64-bc24-4db0-9e07-0b91e32535b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:24.238499 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82e67c64-bc24-4db0-9e07-0b91e32535b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:24.238952 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82e67c64-bc24-4db0-9e07-0b91e32535b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:24.239958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-82e67c64-bc24-4db0-9e07-0b91e32535b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:24.261448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:24.271379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:24.273007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:24.274184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6cde6a33-43d5-4dfc-a58a-a51fcb244d62 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163509 Aug 24 06:34:24.274748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 929/1863] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:24.300007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-82e67c64-bc24-4db0-9e07-0b91e32535b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:24.308237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-82e67c64-bc24-4db0-9e07-0b91e32535b0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.081669 Aug 24 06:34:24.309093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 935/1864] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:25.246354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a6775072-3e8d-4c8b-bdd8-4ab33ddb8b16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:25.246962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a6775072-3e8d-4c8b-bdd8-4ab33ddb8b16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:25.253395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6775072-3e8d-4c8b-bdd8-4ab33ddb8b16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:25.253872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6775072-3e8d-4c8b-bdd8-4ab33ddb8b16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:25.254306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6775072-3e8d-4c8b-bdd8-4ab33ddb8b16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:25.255631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6775072-3e8d-4c8b-bdd8-4ab33ddb8b16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:25.256081 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6775072-3e8d-4c8b-bdd8-4ab33ddb8b16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:25.256522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a6775072-3e8d-4c8b-bdd8-4ab33ddb8b16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:25.297039 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:25.297640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:25.304749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:25.305229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:25.305662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:25.306386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:25.306835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:25.307253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:25.386330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a6775072-3e8d-4c8b-bdd8-4ab33ddb8b16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:25.395034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a6775072-3e8d-4c8b-bdd8-4ab33ddb8b16 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.152427 Aug 24 06:34:25.395699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 930/1865] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:25 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:25.401002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b8db492f-118a-417b-afbb-0ff9206b2ab1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:25.401153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b8db492f-118a-417b-afbb-0ff9206b2ab1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:25.407206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8db492f-118a-417b-afbb-0ff9206b2ab1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:25.407774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8db492f-118a-417b-afbb-0ff9206b2ab1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:25.408277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8db492f-118a-417b-afbb-0ff9206b2ab1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:25.409068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8db492f-118a-417b-afbb-0ff9206b2ab1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:25.409521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8db492f-118a-417b-afbb-0ff9206b2ab1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:25.410501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b8db492f-118a-417b-afbb-0ff9206b2ab1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:25.445181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:25.453891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:25.455383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:25.456570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5367a1e9-93ec-47ff-b2b3-ae4f9131a2d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163672 Aug 24 06:34:25.457207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 936/1866] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:25.473004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b8db492f-118a-417b-afbb-0ff9206b2ab1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:25.481141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b8db492f-118a-417b-afbb-0ff9206b2ab1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084406 Aug 24 06:34:25.481702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 931/1867] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:25 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:26.415667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3eaf003a-bb5a-44f4-9a4d-a9fba16f0232 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:26.416262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3eaf003a-bb5a-44f4-9a4d-a9fba16f0232 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:26.422658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3eaf003a-bb5a-44f4-9a4d-a9fba16f0232 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:26.423128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3eaf003a-bb5a-44f4-9a4d-a9fba16f0232 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:26.423553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3eaf003a-bb5a-44f4-9a4d-a9fba16f0232 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:26.424234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3eaf003a-bb5a-44f4-9a4d-a9fba16f0232 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:26.424707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3eaf003a-bb5a-44f4-9a4d-a9fba16f0232 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:26.425124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3eaf003a-bb5a-44f4-9a4d-a9fba16f0232 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:26.481545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:26.482151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:26.488935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:26.489944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:26.490368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:26.491063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:26.491562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:26.492020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:26.556431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3eaf003a-bb5a-44f4-9a4d-a9fba16f0232 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:26.565059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3eaf003a-bb5a-44f4-9a4d-a9fba16f0232 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153733 Aug 24 06:34:26.565633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 937/1868] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:26 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:26.570187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-47e62b4b-2833-4701-b418-fa24c322366e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:26.570954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-47e62b4b-2833-4701-b418-fa24c322366e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:26.576945 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e62b4b-2833-4701-b418-fa24c322366e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:26.577407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e62b4b-2833-4701-b418-fa24c322366e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:26.577835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e62b4b-2833-4701-b418-fa24c322366e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:26.578527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e62b4b-2833-4701-b418-fa24c322366e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:26.578966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e62b4b-2833-4701-b418-fa24c322366e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:26.579385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-47e62b4b-2833-4701-b418-fa24c322366e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:26.630963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:26.640195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:26.641765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:26.645148 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-47e62b4b-2833-4701-b418-fa24c322366e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:26.645285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fc7ddc5a-fb80-4a10-b225-911a5b389c65 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.166122 Aug 24 06:34:26.645285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 932/1869] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:26.650880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-47e62b4b-2833-4701-b418-fa24c322366e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084282 Aug 24 06:34:26.651449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 938/1870] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:27.585942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b883c430-efad-4167-a06c-b3faecedef80 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:27.586537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b883c430-efad-4167-a06c-b3faecedef80 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:27.592955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b883c430-efad-4167-a06c-b3faecedef80 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:27.593432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b883c430-efad-4167-a06c-b3faecedef80 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:27.593859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b883c430-efad-4167-a06c-b3faecedef80 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:27.594538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b883c430-efad-4167-a06c-b3faecedef80 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:27.594981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b883c430-efad-4167-a06c-b3faecedef80 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:27.595395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b883c430-efad-4167-a06c-b3faecedef80 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:27.610325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:27.667140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:27.667749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:27.674196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:27.674671 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:27.675098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:27.675827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:27.676270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:27.676710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:27.726674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b883c430-efad-4167-a06c-b3faecedef80 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:27.735113 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b883c430-efad-4167-a06c-b3faecedef80 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153502 Aug 24 06:34:27.735699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 933/1871] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:27 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:27.740111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8aa5499d-4842-4679-b938-d903ef18291d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:27.740740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8aa5499d-4842-4679-b938-d903ef18291d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:27.746524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa5499d-4842-4679-b938-d903ef18291d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:27.747490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa5499d-4842-4679-b938-d903ef18291d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:27.747490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa5499d-4842-4679-b938-d903ef18291d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:27.748094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa5499d-4842-4679-b938-d903ef18291d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:27.748588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa5499d-4842-4679-b938-d903ef18291d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:27.749011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8aa5499d-4842-4679-b938-d903ef18291d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:27.809330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8aa5499d-4842-4679-b938-d903ef18291d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:27.809622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:27.818256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8aa5499d-4842-4679-b938-d903ef18291d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.081057 Aug 24 06:34:27.818806 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:27.819003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 934/1872] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:27.820443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:27.821744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-68679e21-f085-4b70-88f3-15334a9cd0bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158756 Aug 24 06:34:27.822321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 939/1873] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:28.755614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b59b0b5e-b24f-4488-9a70-63ceb6b1f57e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:28.756765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b59b0b5e-b24f-4488-9a70-63ceb6b1f57e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:28.763131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b59b0b5e-b24f-4488-9a70-63ceb6b1f57e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:28.763623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b59b0b5e-b24f-4488-9a70-63ceb6b1f57e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:28.764045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b59b0b5e-b24f-4488-9a70-63ceb6b1f57e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:28.764754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b59b0b5e-b24f-4488-9a70-63ceb6b1f57e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:28.765199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b59b0b5e-b24f-4488-9a70-63ceb6b1f57e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:28.765609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b59b0b5e-b24f-4488-9a70-63ceb6b1f57e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:28.841895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c30c1951-04d3-4ce8-a34e-acfc4f0f8de9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:28.842836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c30c1951-04d3-4ce8-a34e-acfc4f0f8de9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:28.849627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c30c1951-04d3-4ce8-a34e-acfc4f0f8de9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:28.850183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c30c1951-04d3-4ce8-a34e-acfc4f0f8de9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:28.850724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c30c1951-04d3-4ce8-a34e-acfc4f0f8de9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:28.851496 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c30c1951-04d3-4ce8-a34e-acfc4f0f8de9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:28.852041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c30c1951-04d3-4ce8-a34e-acfc4f0f8de9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:28.852471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c30c1951-04d3-4ce8-a34e-acfc4f0f8de9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:28.903670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b59b0b5e-b24f-4488-9a70-63ceb6b1f57e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:28.918537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b59b0b5e-b24f-4488-9a70-63ceb6b1f57e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.166375 Aug 24 06:34:28.919521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 935/1874] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:28 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:28.926140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:28.926527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c30c1951-04d3-4ce8-a34e-acfc4f0f8de9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:28.927019 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:28.935543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:28.936024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:28.936471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:28.936741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c30c1951-04d3-4ce8-a34e-acfc4f0f8de9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.101407 Aug 24 06:34:28.937260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:28.937434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 940/1875] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:28 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:28.937739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:28.938181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:29.065635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:29.074800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:29.076313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:29.077503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-280c8fb0-63bb-4832-8cee-3b1ccc6e9482 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156705 Aug 24 06:34:29.078066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 936/1876] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:28 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:29.941132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b3e2c6ea-cc7e-4cf7-86eb-af0de23df20d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:29.941732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b3e2c6ea-cc7e-4cf7-86eb-af0de23df20d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:29.948227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3e2c6ea-cc7e-4cf7-86eb-af0de23df20d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:29.948741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3e2c6ea-cc7e-4cf7-86eb-af0de23df20d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:29.949318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3e2c6ea-cc7e-4cf7-86eb-af0de23df20d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:29.950002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3e2c6ea-cc7e-4cf7-86eb-af0de23df20d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:29.950454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3e2c6ea-cc7e-4cf7-86eb-af0de23df20d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:29.950870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3e2c6ea-cc7e-4cf7-86eb-af0de23df20d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:29.957632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-98c3cd7b-063a-493e-8ad2-ee2de3aca82b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:29.958287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-98c3cd7b-063a-493e-8ad2-ee2de3aca82b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:29.965335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98c3cd7b-063a-493e-8ad2-ee2de3aca82b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:29.965814 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98c3cd7b-063a-493e-8ad2-ee2de3aca82b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:29.966244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98c3cd7b-063a-493e-8ad2-ee2de3aca82b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:29.966947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98c3cd7b-063a-493e-8ad2-ee2de3aca82b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:29.967394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98c3cd7b-063a-493e-8ad2-ee2de3aca82b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:29.967810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-98c3cd7b-063a-493e-8ad2-ee2de3aca82b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:30.034425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-98c3cd7b-063a-493e-8ad2-ee2de3aca82b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:30.043526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-98c3cd7b-063a-493e-8ad2-ee2de3aca82b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089665 Aug 24 06:34:30.056680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 937/1877] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:30.085452 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b3e2c6ea-cc7e-4cf7-86eb-af0de23df20d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:30.093801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b3e2c6ea-cc7e-4cf7-86eb-af0de23df20d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.156759 Aug 24 06:34:30.094361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 941/1878] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:29 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:30.100988 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:30.101633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:30.107565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:30.108042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:30.108470 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:30.109175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:30.109625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:30.110044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:30.239611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:30.245710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:30.247222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:30.248370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-556bec90-3940-4fa7-9cd7-3fc30885bbee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.151811 Aug 24 06:34:30.249023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 938/1879] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:31.065108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5902310c-9f64-48c9-8029-bdabc19b86de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:31.065650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5902310c-9f64-48c9-8029-bdabc19b86de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:31.072141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5902310c-9f64-48c9-8029-bdabc19b86de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:31.072655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5902310c-9f64-48c9-8029-bdabc19b86de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:31.073096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5902310c-9f64-48c9-8029-bdabc19b86de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:31.073795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5902310c-9f64-48c9-8029-bdabc19b86de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:31.074246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5902310c-9f64-48c9-8029-bdabc19b86de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:31.074678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5902310c-9f64-48c9-8029-bdabc19b86de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:31.114810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-405da707-b1b3-4f04-b89d-75c4af6083d8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:31.116306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-405da707-b1b3-4f04-b89d-75c4af6083d8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:31.122770 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-405da707-b1b3-4f04-b89d-75c4af6083d8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:31.123337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-405da707-b1b3-4f04-b89d-75c4af6083d8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:31.123838 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-405da707-b1b3-4f04-b89d-75c4af6083d8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:31.124626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-405da707-b1b3-4f04-b89d-75c4af6083d8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:31.125149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-405da707-b1b3-4f04-b89d-75c4af6083d8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:31.125567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-405da707-b1b3-4f04-b89d-75c4af6083d8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:31.136324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5902310c-9f64-48c9-8029-bdabc19b86de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:31.145475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5902310c-9f64-48c9-8029-bdabc19b86de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084200 Aug 24 06:34:31.146077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 942/1880] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:31 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:31.272481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:31.273119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:31.279863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:31.280344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:31.280801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:31.281503 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:31.281953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:31.282379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:31.413095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:31.420636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-405da707-b1b3-4f04-b89d-75c4af6083d8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:31.421814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:31.423313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:31.424469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c8938df5-0791-405c-a23b-6003b8e8b25c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156544 Aug 24 06:34:31.425060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 943/1881] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:31.429201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-405da707-b1b3-4f04-b89d-75c4af6083d8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.318115 Aug 24 06:34:31.429768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 939/1882] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:31 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:32.166867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c74fc6e0-e911-4ff4-922f-2d4af9093129 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:32.167475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c74fc6e0-e911-4ff4-922f-2d4af9093129 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:32.173991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c74fc6e0-e911-4ff4-922f-2d4af9093129 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:32.174467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c74fc6e0-e911-4ff4-922f-2d4af9093129 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:32.174894 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c74fc6e0-e911-4ff4-922f-2d4af9093129 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:32.175581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c74fc6e0-e911-4ff4-922f-2d4af9093129 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:32.176030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c74fc6e0-e911-4ff4-922f-2d4af9093129 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:32.176447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c74fc6e0-e911-4ff4-922f-2d4af9093129 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:32.179085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:32.239510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c74fc6e0-e911-4ff4-922f-2d4af9093129 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:32.248056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c74fc6e0-e911-4ff4-922f-2d4af9093129 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085022 Aug 24 06:34:32.248704 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 944/1883] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:32.447886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:32.448458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:32.450160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f27131bf-1fe0-47d7-a78a-c45abcdb6754 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:32.450772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f27131bf-1fe0-47d7-a78a-c45abcdb6754 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:32.454842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:32.455329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:32.455763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:32.456460 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:32.456829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27131bf-1fe0-47d7-a78a-c45abcdb6754 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:32.456972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:32.457304 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27131bf-1fe0-47d7-a78a-c45abcdb6754 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:32.457423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:32.457733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27131bf-1fe0-47d7-a78a-c45abcdb6754 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:32.458425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27131bf-1fe0-47d7-a78a-c45abcdb6754 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:32.458870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27131bf-1fe0-47d7-a78a-c45abcdb6754 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:32.459282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f27131bf-1fe0-47d7-a78a-c45abcdb6754 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:32.592937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:32.602023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:32.603520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:32.604708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-88ef74e7-583d-4c0a-86cc-c0c97ba4a0de tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.160858 Aug 24 06:34:32.605254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 940/1884] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:32.605624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f27131bf-1fe0-47d7-a78a-c45abcdb6754 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:32.614083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f27131bf-1fe0-47d7-a78a-c45abcdb6754 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.167690 Aug 24 06:34:32.614639 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 945/1885] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:32 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:33.268924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b85289e8-a3bc-4393-9a99-c59e78f476d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:33.269534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b85289e8-a3bc-4393-9a99-c59e78f476d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:33.275472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b85289e8-a3bc-4393-9a99-c59e78f476d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:33.275947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b85289e8-a3bc-4393-9a99-c59e78f476d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:33.276432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b85289e8-a3bc-4393-9a99-c59e78f476d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:33.277137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b85289e8-a3bc-4393-9a99-c59e78f476d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:33.277584 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b85289e8-a3bc-4393-9a99-c59e78f476d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:33.277998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b85289e8-a3bc-4393-9a99-c59e78f476d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:33.338720 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b85289e8-a3bc-4393-9a99-c59e78f476d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:33.346798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b85289e8-a3bc-4393-9a99-c59e78f476d7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.081802 Aug 24 06:34:33.347363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 941/1886] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:33.627570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:33.628176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:33.635442 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:33.635642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dac8ad85-ed95-455f-8220-886e7bd854a0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:33.636067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:33.636185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dac8ad85-ed95-455f-8220-886e7bd854a0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:33.636350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:33.637089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:33.637542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:33.637963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:33.642279 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac8ad85-ed95-455f-8220-886e7bd854a0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:33.642756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac8ad85-ed95-455f-8220-886e7bd854a0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:33.643187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac8ad85-ed95-455f-8220-886e7bd854a0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:33.643873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac8ad85-ed95-455f-8220-886e7bd854a0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:33.644323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac8ad85-ed95-455f-8220-886e7bd854a0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:33.644771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac8ad85-ed95-455f-8220-886e7bd854a0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:33.768351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:33.773988 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dac8ad85-ed95-455f-8220-886e7bd854a0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:33.778024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:33.779569 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:33.780764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-55c56ce8-0473-4596-91c5-c3434ab2a183 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157148 Aug 24 06:34:33.781330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 946/1887] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:33.782289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dac8ad85-ed95-455f-8220-886e7bd854a0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150359 Aug 24 06:34:33.782830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 942/1888] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:33 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:34.367710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8454ade3-230a-4606-8372-00afe327d7bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:34.368238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8454ade3-230a-4606-8372-00afe327d7bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:34.374860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8454ade3-230a-4606-8372-00afe327d7bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:34.375347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8454ade3-230a-4606-8372-00afe327d7bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:34.375779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8454ade3-230a-4606-8372-00afe327d7bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:34.376558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8454ade3-230a-4606-8372-00afe327d7bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:34.377013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8454ade3-230a-4606-8372-00afe327d7bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:34.377436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8454ade3-230a-4606-8372-00afe327d7bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:34.438642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8454ade3-230a-4606-8372-00afe327d7bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:34.447522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8454ade3-230a-4606-8372-00afe327d7bb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084413 Aug 24 06:34:34.448086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 947/1889] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:34 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:34.803050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c597c4ec-bac1-4f8d-a26e-adc3a9444dcf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:34.803694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c597c4ec-bac1-4f8d-a26e-adc3a9444dcf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:34.803971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:34.804605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:34.810465 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c597c4ec-bac1-4f8d-a26e-adc3a9444dcf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:34.810942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c597c4ec-bac1-4f8d-a26e-adc3a9444dcf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:34.811151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:34.811371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c597c4ec-bac1-4f8d-a26e-adc3a9444dcf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:34.811623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:34.812052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:34.812179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c597c4ec-bac1-4f8d-a26e-adc3a9444dcf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:34.812518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c597c4ec-bac1-4f8d-a26e-adc3a9444dcf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:34.812768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:34.812945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c597c4ec-bac1-4f8d-a26e-adc3a9444dcf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:34.813213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:34.813627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:34.945871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c597c4ec-bac1-4f8d-a26e-adc3a9444dcf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:34.947055 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:34.954114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c597c4ec-bac1-4f8d-a26e-adc3a9444dcf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154951 Aug 24 06:34:34.954677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 943/1890] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:34 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:34.955844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:34.957386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:34.958594 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ece8c3b4-9eb1-4d18-a623-a2bb122650ad tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158596 Aug 24 06:34:34.959300 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 948/1891] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:34 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:35.467961 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-27d47498-5d4b-4f84-9610-a05cec7160ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:35.468588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-27d47498-5d4b-4f84-9610-a05cec7160ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:35.474997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d47498-5d4b-4f84-9610-a05cec7160ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:35.475466 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d47498-5d4b-4f84-9610-a05cec7160ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:35.475892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d47498-5d4b-4f84-9610-a05cec7160ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:35.476602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d47498-5d4b-4f84-9610-a05cec7160ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:35.477049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d47498-5d4b-4f84-9610-a05cec7160ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:35.477463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d47498-5d4b-4f84-9610-a05cec7160ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:35.537841 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-27d47498-5d4b-4f84-9610-a05cec7160ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:35.546088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-27d47498-5d4b-4f84-9610-a05cec7160ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.081964 Aug 24 06:34:35.546652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 944/1892] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:35.975366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c17c186b-99ff-4302-b923-08a5bf4ecf67 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:35.976019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c17c186b-99ff-4302-b923-08a5bf4ecf67 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:35.981103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:35.981781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:35.982515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c17c186b-99ff-4302-b923-08a5bf4ecf67 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:35.982995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c17c186b-99ff-4302-b923-08a5bf4ecf67 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:35.983432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c17c186b-99ff-4302-b923-08a5bf4ecf67 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:35.984127 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c17c186b-99ff-4302-b923-08a5bf4ecf67 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:35.984612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c17c186b-99ff-4302-b923-08a5bf4ecf67 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:35.985036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c17c186b-99ff-4302-b923-08a5bf4ecf67 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:35.988137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:35.988652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:35.989094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:35.989792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:35.990773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:35.991194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:36.113146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c17c186b-99ff-4302-b923-08a5bf4ecf67 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:36.122037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c17c186b-99ff-4302-b923-08a5bf4ecf67 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150641 Aug 24 06:34:36.122609 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 949/1893] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:35 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:36.122845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:36.131863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:36.133462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:36.134617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9dd2b8c5-faea-4ab7-99ac-16c75e3537bf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157423 Aug 24 06:34:36.135165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 945/1894] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:36.567633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e31432df-9c8c-4748-8477-2bb946e85bf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:36.568234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e31432df-9c8c-4748-8477-2bb946e85bf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:36.574410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e31432df-9c8c-4748-8477-2bb946e85bf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:36.574887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e31432df-9c8c-4748-8477-2bb946e85bf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:36.575320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e31432df-9c8c-4748-8477-2bb946e85bf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:36.576007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e31432df-9c8c-4748-8477-2bb946e85bf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:36.576513 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e31432df-9c8c-4748-8477-2bb946e85bf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:36.576948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e31432df-9c8c-4748-8477-2bb946e85bf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:36.640816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e31432df-9c8c-4748-8477-2bb946e85bf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:36.649691 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e31432df-9c8c-4748-8477-2bb946e85bf8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085943 Aug 24 06:34:36.650292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 950/1895] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:36 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:37.143383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-18a2be1d-b3ea-43b7-b766-43732ef9cf5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:37.146379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-18a2be1d-b3ea-43b7-b766-43732ef9cf5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:37.150703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18a2be1d-b3ea-43b7-b766-43732ef9cf5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:37.151191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18a2be1d-b3ea-43b7-b766-43732ef9cf5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:37.151624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18a2be1d-b3ea-43b7-b766-43732ef9cf5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:37.152413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18a2be1d-b3ea-43b7-b766-43732ef9cf5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:37.152904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18a2be1d-b3ea-43b7-b766-43732ef9cf5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:37.153330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18a2be1d-b3ea-43b7-b766-43732ef9cf5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:37.158831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:37.159490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:37.166652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:37.167106 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:37.167564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:37.168267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:37.168758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:37.169181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:37.288649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-18a2be1d-b3ea-43b7-b766-43732ef9cf5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:37.297007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-18a2be1d-b3ea-43b7-b766-43732ef9cf5e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157436 Aug 24 06:34:37.297485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 946/1896] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:37 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:37.299432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:37.309416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:37.310970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:37.312120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-de347efe-93d1-4007-92fc-d491c610934c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159048 Aug 24 06:34:37.312725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 951/1897] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:37.616626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:37.617198 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:37.623790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:37.624337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:37.624858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:37.625778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:37.626404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:37.626917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:37.641317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] HTTP exception thrown: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Request method failure captured: Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: DELETE /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 HTTP/1.1 Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcI_I9huvEuUVzRrBxRPdTG5qqUGpAdOvZQwpwndKekqpzx6nxYwOufm6cj1diqelUoat7BmXfCuCCyfQbzUbJH2Ne0wS3vk3thmsR_zFKt8mIthbCrQxYL6szHbAdh8cneu1yTM3W9rwToG1VfOG6HV0xiq0AWyQLRFhlAE9aP36Wc Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:34:37.643090 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ff194aa4a2d744caaa09e0ceee54b1d2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 25908fb02f7f46f5b9e483811302a67e Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:34:37.644981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '22824cc5-84ad-4f4e-8830-018742399d15'} Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:34:37.646017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:34:37.651030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:34:37.652746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Returning 404 to user: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:34:37.652746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7961aa88-c435-440b-9df2-8375571bec87 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "DELETE /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 404 len: 111 microversion: 2.1 time: 0.033705 Aug 24 06:34:37.652746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 947/1898] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:34:37 2022] DELETE /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:34:37.657256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:37.657256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 22824cc5-84ad-4f4e-8830-018742399d15] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:37.662669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:37.663156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:37.663586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:37.664280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:37.664765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:37.665192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:37.670974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-16347345-339e-4e56-9794-bc1a453c1b38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:37.671588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-16347345-339e-4e56-9794-bc1a453c1b38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:37.677843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16347345-339e-4e56-9794-bc1a453c1b38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:37.678315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16347345-339e-4e56-9794-bc1a453c1b38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:37.678973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16347345-339e-4e56-9794-bc1a453c1b38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:37.679591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] HTTP exception thrown: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:34:37.679725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16347345-339e-4e56-9794-bc1a453c1b38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:37.680100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16347345-339e-4e56-9794-bc1a453c1b38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:37.680565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-16347345-339e-4e56-9794-bc1a453c1b38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Request method failure captured: Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 HTTP/1.1 Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcI_I9huvEuUVzRrBxRPdTG5qqUGpAdOvZQwpwndKekqpzx6nxYwOufm6cj1diqelUoat7BmXfCuCCyfQbzUbJH2Ne0wS3vk3thmsR_zFKt8mIthbCrQxYL6szHbAdh8cneu1yTM3W9rwToG1VfOG6HV0xiq0AWyQLRFhlAE9aP36Wc Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:34:37.681306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ff194aa4a2d744caaa09e0ceee54b1d2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 25908fb02f7f46f5b9e483811302a67e Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:34:37.683051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '22824cc5-84ad-4f4e-8830-018742399d15'} Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:34:37.684377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. Aug 24 06:34:37.686036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:34:37.687480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Returning 404 to user: Instance 22824cc5-84ad-4f4e-8830-018742399d15 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:34:37.687480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3dd103f8-2da0-4b2a-8f8d-235c5bdbfadd tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15" status: 404 len: 111 microversion: 2.1 time: 0.031277 Aug 24 06:34:37.689681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 952/1899] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:37 2022] GET /compute/v2.1/servers/22824cc5-84ad-4f4e-8830-018742399d15 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:34:37.749262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-16347345-339e-4e56-9794-bc1a453c1b38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:37.758011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-16347345-339e-4e56-9794-bc1a453c1b38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.090948 Aug 24 06:34:37.758564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 948/1900] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:37.782184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-00fbac34-d4a6-4c0f-9721-853581a1bd69 tempest-TestShelveInstance-1117133601 tempest-TestShelveInstance-1117133601-project] Calling method '.version_select at 0x7fcddc18d430>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:37.898278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-00fbac34-d4a6-4c0f-9721-853581a1bd69 tempest-TestShelveInstance-1117133601 tempest-TestShelveInstance-1117133601-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1073337624" status: 202 len: 0 microversion: 2.1 time: 0.120117 Aug 24 06:34:37.898859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 953/1901] 10.222.0.62 () {58 vars in 1254 bytes} [Wed Aug 24 06:34:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1073337624 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:34:38.318697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4aec7148-424f-45b2-9c96-d1b082b3108b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:38.319301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4aec7148-424f-45b2-9c96-d1b082b3108b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:38.325495 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aec7148-424f-45b2-9c96-d1b082b3108b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:38.325980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aec7148-424f-45b2-9c96-d1b082b3108b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:38.326419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aec7148-424f-45b2-9c96-d1b082b3108b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:38.327121 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aec7148-424f-45b2-9c96-d1b082b3108b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:38.327581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aec7148-424f-45b2-9c96-d1b082b3108b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:38.328039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aec7148-424f-45b2-9c96-d1b082b3108b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:38.337316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:38.338222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:38.345361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:38.345966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:38.346500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:38.347285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:38.347964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:38.348593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:38.464576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4aec7148-424f-45b2-9c96-d1b082b3108b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:38.472862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4aec7148-424f-45b2-9c96-d1b082b3108b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157928 Aug 24 06:34:38.473441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 949/1902] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:38 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:38.594001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:38.603440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:38.605000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:38.606184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b360863c-944f-4193-8de9-185ed9e5e3d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.274688 Aug 24 06:34:38.606742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 954/1903] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:38.778823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-180ec9f4-cd07-4fbb-9d5c-1226465b3503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:38.779418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-180ec9f4-cd07-4fbb-9d5c-1226465b3503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:38.785476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-180ec9f4-cd07-4fbb-9d5c-1226465b3503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:38.785951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-180ec9f4-cd07-4fbb-9d5c-1226465b3503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:38.786380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-180ec9f4-cd07-4fbb-9d5c-1226465b3503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:38.787656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-180ec9f4-cd07-4fbb-9d5c-1226465b3503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:38.788099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-180ec9f4-cd07-4fbb-9d5c-1226465b3503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:38.788526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-180ec9f4-cd07-4fbb-9d5c-1226465b3503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:38.855161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-180ec9f4-cd07-4fbb-9d5c-1226465b3503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:38.857399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:38.864406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-180ec9f4-cd07-4fbb-9d5c-1226465b3503 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089368 Aug 24 06:34:38.865346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 950/1904] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:38 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:39.493804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b57b610a-b965-4ea8-9ea1-2534c771af3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:39.494530 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b57b610a-b965-4ea8-9ea1-2534c771af3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:39.501203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b57b610a-b965-4ea8-9ea1-2534c771af3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:39.501674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b57b610a-b965-4ea8-9ea1-2534c771af3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:39.502098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b57b610a-b965-4ea8-9ea1-2534c771af3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:39.502783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b57b610a-b965-4ea8-9ea1-2534c771af3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:39.503226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b57b610a-b965-4ea8-9ea1-2534c771af3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:39.503641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b57b610a-b965-4ea8-9ea1-2534c771af3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:39.631954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:39.632653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:39.639098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:39.639571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:39.639997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:39.640709 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:39.641209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:39.641567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:39.719010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b57b610a-b965-4ea8-9ea1-2534c771af3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:39.728006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b57b610a-b965-4ea8-9ea1-2534c771af3d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.238089 Aug 24 06:34:39.728861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 955/1905] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:39 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:39.772543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:39.781076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:39.782689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:39.783834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3e1a98da-113b-4bbd-8d37-3f6a7c02dbb3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156106 Aug 24 06:34:39.784385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 951/1906] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:39.887313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e290a2f3-7c3f-4ee3-8301-d5781ec44060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:39.887955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e290a2f3-7c3f-4ee3-8301-d5781ec44060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:39.894496 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e290a2f3-7c3f-4ee3-8301-d5781ec44060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:39.894904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e290a2f3-7c3f-4ee3-8301-d5781ec44060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:39.895336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e290a2f3-7c3f-4ee3-8301-d5781ec44060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:39.896585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e290a2f3-7c3f-4ee3-8301-d5781ec44060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:39.897044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e290a2f3-7c3f-4ee3-8301-d5781ec44060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:39.897463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e290a2f3-7c3f-4ee3-8301-d5781ec44060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:39.965466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e290a2f3-7c3f-4ee3-8301-d5781ec44060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:39.974656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e290a2f3-7c3f-4ee3-8301-d5781ec44060 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.091988 Aug 24 06:34:39.975625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 956/1907] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:39 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:40.750613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c2422a04-32e2-468a-9ca5-9c6028b55c94 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:40.751439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c2422a04-32e2-468a-9ca5-9c6028b55c94 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:40.766895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2422a04-32e2-468a-9ca5-9c6028b55c94 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:40.766895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2422a04-32e2-468a-9ca5-9c6028b55c94 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:40.766895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2422a04-32e2-468a-9ca5-9c6028b55c94 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:40.766895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2422a04-32e2-468a-9ca5-9c6028b55c94 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:40.767338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2422a04-32e2-468a-9ca5-9c6028b55c94 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:40.767338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2422a04-32e2-468a-9ca5-9c6028b55c94 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:40.810061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:40.810909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:40.818071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:40.818706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:40.819249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:40.820435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:40.821022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:40.821553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:40.997675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c2422a04-32e2-468a-9ca5-9c6028b55c94 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:41.012832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c2422a04-32e2-468a-9ca5-9c6028b55c94 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.266630 Aug 24 06:34:41.013826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 952/1908] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:40 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:41.023160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ebf67acb-006d-4341-9303-e98904de72f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:41.024690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ebf67acb-006d-4341-9303-e98904de72f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:41.035695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ebf67acb-006d-4341-9303-e98904de72f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:41.037494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ebf67acb-006d-4341-9303-e98904de72f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:41.039197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ebf67acb-006d-4341-9303-e98904de72f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:41.040844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ebf67acb-006d-4341-9303-e98904de72f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:41.042496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ebf67acb-006d-4341-9303-e98904de72f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:41.043202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ebf67acb-006d-4341-9303-e98904de72f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:41.142880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:41.147752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ebf67acb-006d-4341-9303-e98904de72f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:41.156934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ebf67acb-006d-4341-9303-e98904de72f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.141230 Aug 24 06:34:41.157777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:41.160370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:41.162555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3e917315-a09a-4b60-8ae4-1a83c5326609 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.356038 Aug 24 06:34:41.163652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 957/1909] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:41.169084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 953/1910] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:41 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:42.037578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a7920b5f-d550-4cf2-a0da-f7d8ba86b123 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:42.043143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a7920b5f-d550-4cf2-a0da-f7d8ba86b123 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:42.047361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7920b5f-d550-4cf2-a0da-f7d8ba86b123 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:42.047999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7920b5f-d550-4cf2-a0da-f7d8ba86b123 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:42.048439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7920b5f-d550-4cf2-a0da-f7d8ba86b123 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:42.049217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7920b5f-d550-4cf2-a0da-f7d8ba86b123 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:42.049844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7920b5f-d550-4cf2-a0da-f7d8ba86b123 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:42.050273 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7920b5f-d550-4cf2-a0da-f7d8ba86b123 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:42.185348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-27688b75-7c67-4d4b-adee-0b76d1505940 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:42.186952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-27688b75-7c67-4d4b-adee-0b76d1505940 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:42.197358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27688b75-7c67-4d4b-adee-0b76d1505940 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:42.197856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27688b75-7c67-4d4b-adee-0b76d1505940 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:42.198289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27688b75-7c67-4d4b-adee-0b76d1505940 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:42.199695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27688b75-7c67-4d4b-adee-0b76d1505940 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:42.199695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27688b75-7c67-4d4b-adee-0b76d1505940 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:42.199947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27688b75-7c67-4d4b-adee-0b76d1505940 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:42.235234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a7920b5f-d550-4cf2-a0da-f7d8ba86b123 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:42.247451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a7920b5f-d550-4cf2-a0da-f7d8ba86b123 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.214268 Aug 24 06:34:42.248042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 958/1911] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:42 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:42.257124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:42.257124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:42.260692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:42.261186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:42.261620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:42.262329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:42.262780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:42.263255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:42.302126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-27688b75-7c67-4d4b-adee-0b76d1505940 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:42.314664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-27688b75-7c67-4d4b-adee-0b76d1505940 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.134418 Aug 24 06:34:42.315257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 954/1912] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:42 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:42.400761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:42.409879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:42.411370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:42.412603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5120abe0-b156-47db-bfb4-72c0e6112caa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163400 Aug 24 06:34:42.413162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 959/1913] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:43.276288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4ce4ad99-a509-4c24-b3ee-f7bf01e233ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:43.276998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4ce4ad99-a509-4c24-b3ee-f7bf01e233ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:43.291906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ce4ad99-a509-4c24-b3ee-f7bf01e233ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:43.293071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ce4ad99-a509-4c24-b3ee-f7bf01e233ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:43.294119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ce4ad99-a509-4c24-b3ee-f7bf01e233ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:43.295108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ce4ad99-a509-4c24-b3ee-f7bf01e233ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:43.295770 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ce4ad99-a509-4c24-b3ee-f7bf01e233ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:43.296401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ce4ad99-a509-4c24-b3ee-f7bf01e233ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:43.340642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ad1c6286-89db-4ac8-8711-9eadc9352b83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:43.344481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ad1c6286-89db-4ac8-8711-9eadc9352b83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:43.356851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad1c6286-89db-4ac8-8711-9eadc9352b83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:43.357253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad1c6286-89db-4ac8-8711-9eadc9352b83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:43.357694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad1c6286-89db-4ac8-8711-9eadc9352b83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:43.358443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad1c6286-89db-4ac8-8711-9eadc9352b83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:43.358907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad1c6286-89db-4ac8-8711-9eadc9352b83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:43.359336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad1c6286-89db-4ac8-8711-9eadc9352b83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:43.427748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ad1c6286-89db-4ac8-8711-9eadc9352b83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:43.436982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ad1c6286-89db-4ac8-8711-9eadc9352b83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.104499 Aug 24 06:34:43.437568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 960/1914] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:43 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:43.442347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:43.443224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:43.449488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:43.450265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:43.450880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:43.451785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:43.452228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:43.452689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:43.540748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4ce4ad99-a509-4c24-b3ee-f7bf01e233ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:43.549908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4ce4ad99-a509-4c24-b3ee-f7bf01e233ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.277797 Aug 24 06:34:43.550991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 955/1915] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:43 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:43.598154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:43.607790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:43.609330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:43.610498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-92380468-1aaf-4a7b-8939-df3db5849004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.171813 Aug 24 06:34:43.611062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 961/1916] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:44.458796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3adcc89d-e660-47e2-a1ab-b04297e5d0e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:44.463332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3adcc89d-e660-47e2-a1ab-b04297e5d0e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:44.466744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3adcc89d-e660-47e2-a1ab-b04297e5d0e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:44.467229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3adcc89d-e660-47e2-a1ab-b04297e5d0e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:44.467655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3adcc89d-e660-47e2-a1ab-b04297e5d0e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:44.468351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3adcc89d-e660-47e2-a1ab-b04297e5d0e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:44.468860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3adcc89d-e660-47e2-a1ab-b04297e5d0e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:44.469278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3adcc89d-e660-47e2-a1ab-b04297e5d0e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:44.554821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3adcc89d-e660-47e2-a1ab-b04297e5d0e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:44.563351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3adcc89d-e660-47e2-a1ab-b04297e5d0e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.109402 Aug 24 06:34:44.566719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 956/1917] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:44 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:44.575877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-beaeb97f-5a18-41da-8ae1-fdd8d5753496 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:44.576472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-beaeb97f-5a18-41da-8ae1-fdd8d5753496 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:44.582583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-beaeb97f-5a18-41da-8ae1-fdd8d5753496 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:44.583053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-beaeb97f-5a18-41da-8ae1-fdd8d5753496 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:44.583502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-beaeb97f-5a18-41da-8ae1-fdd8d5753496 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:44.584236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-beaeb97f-5a18-41da-8ae1-fdd8d5753496 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:44.584708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-beaeb97f-5a18-41da-8ae1-fdd8d5753496 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:44.585126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-beaeb97f-5a18-41da-8ae1-fdd8d5753496 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:44.601393 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:44.634237 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:44.634845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:44.657671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:44.657671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:44.657671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:44.657671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:44.658170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:44.658594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:44.734539 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-beaeb97f-5a18-41da-8ae1-fdd8d5753496 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:44.743794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-beaeb97f-5a18-41da-8ae1-fdd8d5753496 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.176204 Aug 24 06:34:44.753279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 962/1918] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:44 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:44.950941 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:44.960729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:44.963180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:44.964542 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-996ed219-88f6-48b9-b73b-fa885ac9c06f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.334371 Aug 24 06:34:44.965385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 957/1919] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:45.601204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-af787a1e-a1c7-46f5-ae20-36bb435ab2f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:45.601204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-af787a1e-a1c7-46f5-ae20-36bb435ab2f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:45.609073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af787a1e-a1c7-46f5-ae20-36bb435ab2f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:45.609560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af787a1e-a1c7-46f5-ae20-36bb435ab2f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:45.609996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af787a1e-a1c7-46f5-ae20-36bb435ab2f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:45.610709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af787a1e-a1c7-46f5-ae20-36bb435ab2f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:45.611163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af787a1e-a1c7-46f5-ae20-36bb435ab2f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:45.611588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af787a1e-a1c7-46f5-ae20-36bb435ab2f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:45.713866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-af787a1e-a1c7-46f5-ae20-36bb435ab2f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:45.722573 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-af787a1e-a1c7-46f5-ae20-36bb435ab2f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.131983 Aug 24 06:34:45.733406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 963/1920] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:45 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:45.765632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-253bbb26-f113-423e-b5ea-463b60854426 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:45.766281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-253bbb26-f113-423e-b5ea-463b60854426 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:45.768806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=82 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:45.773638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253bbb26-f113-423e-b5ea-463b60854426 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:45.774130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253bbb26-f113-423e-b5ea-463b60854426 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:45.774683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253bbb26-f113-423e-b5ea-463b60854426 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:45.775311 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253bbb26-f113-423e-b5ea-463b60854426 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:45.775763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253bbb26-f113-423e-b5ea-463b60854426 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:45.776189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253bbb26-f113-423e-b5ea-463b60854426 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:45.989054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:45.990242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:45.996538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:45.997026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:45.997458 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:45.998151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:45.998789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:45.999206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:46.014476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-253bbb26-f113-423e-b5ea-463b60854426 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:46.022513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-253bbb26-f113-423e-b5ea-463b60854426 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.260795 Aug 24 06:34:46.031645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 958/1921] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:45 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:46.141091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:46.150341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:46.167125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:46.167125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1502cd41-3280-407f-bb3e-4f9dbaab054e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.168087 Aug 24 06:34:46.167125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 964/1922] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:46.743863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b1a95a54-efac-4660-8b9e-e026761159c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:46.744505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b1a95a54-efac-4660-8b9e-e026761159c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:46.750992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1a95a54-efac-4660-8b9e-e026761159c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:46.751134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1a95a54-efac-4660-8b9e-e026761159c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:46.751646 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1a95a54-efac-4660-8b9e-e026761159c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:46.752641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1a95a54-efac-4660-8b9e-e026761159c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:46.753147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1a95a54-efac-4660-8b9e-e026761159c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:46.753573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b1a95a54-efac-4660-8b9e-e026761159c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:46.825723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b1a95a54-efac-4660-8b9e-e026761159c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:46.834206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b1a95a54-efac-4660-8b9e-e026761159c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.094854 Aug 24 06:34:46.835062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 959/1923] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:47.045182 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1b3626d4-904b-4c04-aeb2-707a7ade2392 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:47.045968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1b3626d4-904b-4c04-aeb2-707a7ade2392 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:47.052598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b3626d4-904b-4c04-aeb2-707a7ade2392 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:47.053163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b3626d4-904b-4c04-aeb2-707a7ade2392 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:47.053672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b3626d4-904b-4c04-aeb2-707a7ade2392 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:47.054484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b3626d4-904b-4c04-aeb2-707a7ade2392 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:47.054993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b3626d4-904b-4c04-aeb2-707a7ade2392 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:47.055487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1b3626d4-904b-4c04-aeb2-707a7ade2392 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:47.179980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:47.180619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:47.187099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:47.188361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:47.188832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:47.192672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:47.193423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:47.193862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:47.206744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1b3626d4-904b-4c04-aeb2-707a7ade2392 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:47.218665 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1b3626d4-904b-4c04-aeb2-707a7ade2392 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.176124 Aug 24 06:34:47.218665 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 965/1924] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:47 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:47.347295 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:47.356923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:47.358453 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:47.359632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ec77beff-851f-4883-b279-56c54108783a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.184406 Aug 24 06:34:47.360185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 960/1925] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:47.855303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b065da4d-7779-4db4-8046-236694c4663d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:47.855973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b065da4d-7779-4db4-8046-236694c4663d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:47.862009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b065da4d-7779-4db4-8046-236694c4663d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:47.862425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b065da4d-7779-4db4-8046-236694c4663d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:47.862852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b065da4d-7779-4db4-8046-236694c4663d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:47.863542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b065da4d-7779-4db4-8046-236694c4663d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:47.864022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b065da4d-7779-4db4-8046-236694c4663d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:47.864973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b065da4d-7779-4db4-8046-236694c4663d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:47.934922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b065da4d-7779-4db4-8046-236694c4663d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:47.943918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b065da4d-7779-4db4-8046-236694c4663d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.092519 Aug 24 06:34:47.944526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 966/1926] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:48.239298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0afa57ec-aab2-40c2-9887-3b3e64ae2e18 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:48.239920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0afa57ec-aab2-40c2-9887-3b3e64ae2e18 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:48.246455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0afa57ec-aab2-40c2-9887-3b3e64ae2e18 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:48.246938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0afa57ec-aab2-40c2-9887-3b3e64ae2e18 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:48.251155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0afa57ec-aab2-40c2-9887-3b3e64ae2e18 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:48.251155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0afa57ec-aab2-40c2-9887-3b3e64ae2e18 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:48.251155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0afa57ec-aab2-40c2-9887-3b3e64ae2e18 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:48.251155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0afa57ec-aab2-40c2-9887-3b3e64ae2e18 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:48.382680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0afa57ec-aab2-40c2-9887-3b3e64ae2e18 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:48.383138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:48.383744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:48.390179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:48.390657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:48.391066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0afa57ec-aab2-40c2-9887-3b3e64ae2e18 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155677 Aug 24 06:34:48.391222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:48.391652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 961/1927] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:48 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:48.391811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:48.392193 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:48.392638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:48.522783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:48.531617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:48.533202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:48.534393 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9a08e49d-3db5-4afb-a360-9d4d524a780b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155791 Aug 24 06:34:48.534954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 967/1928] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:48.965804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6593a3ee-edc8-4a45-985f-d187cd622687 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:48.966407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6593a3ee-edc8-4a45-985f-d187cd622687 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:48.972579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6593a3ee-edc8-4a45-985f-d187cd622687 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:48.973072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6593a3ee-edc8-4a45-985f-d187cd622687 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:48.973507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6593a3ee-edc8-4a45-985f-d187cd622687 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:48.974205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6593a3ee-edc8-4a45-985f-d187cd622687 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:48.974659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6593a3ee-edc8-4a45-985f-d187cd622687 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:48.975080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6593a3ee-edc8-4a45-985f-d187cd622687 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:49.036178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6593a3ee-edc8-4a45-985f-d187cd622687 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:49.044459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6593a3ee-edc8-4a45-985f-d187cd622687 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082537 Aug 24 06:34:49.045057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 962/1929] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:49.412884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9f425a0d-eef9-4c2a-868c-d46407f57a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:49.413481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9f425a0d-eef9-4c2a-868c-d46407f57a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:49.419982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f425a0d-eef9-4c2a-868c-d46407f57a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:49.420460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f425a0d-eef9-4c2a-868c-d46407f57a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:49.420922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f425a0d-eef9-4c2a-868c-d46407f57a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:49.421609 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f425a0d-eef9-4c2a-868c-d46407f57a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:49.422061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f425a0d-eef9-4c2a-868c-d46407f57a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:49.422504 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f425a0d-eef9-4c2a-868c-d46407f57a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:49.551405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9f425a0d-eef9-4c2a-868c-d46407f57a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:49.558200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:49.559397 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:49.561305 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9f425a0d-eef9-4c2a-868c-d46407f57a03 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.152226 Aug 24 06:34:49.561893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 968/1930] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:49 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:49.565948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:49.566424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:49.566857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:49.567600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:49.568043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:49.568692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:49.699921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:49.709205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:49.710719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:49.711900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a96a3628-fd22-49c7-a91d-53619a87dadc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157666 Aug 24 06:34:49.712464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 963/1931] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:50.065972 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9cb35091-087f-4840-9400-20b8fc5bd9a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:50.066591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9cb35091-087f-4840-9400-20b8fc5bd9a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:50.073022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9cb35091-087f-4840-9400-20b8fc5bd9a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:50.073506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9cb35091-087f-4840-9400-20b8fc5bd9a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:50.073938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9cb35091-087f-4840-9400-20b8fc5bd9a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:50.074671 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9cb35091-087f-4840-9400-20b8fc5bd9a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:50.075125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9cb35091-087f-4840-9400-20b8fc5bd9a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:50.075542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9cb35091-087f-4840-9400-20b8fc5bd9a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:50.143123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9cb35091-087f-4840-9400-20b8fc5bd9a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:50.152615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9cb35091-087f-4840-9400-20b8fc5bd9a5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.090604 Aug 24 06:34:50.153194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 969/1932] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:50.582271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d4166ff3-df87-4f0e-81f5-93b2b8b306d6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:50.582871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d4166ff3-df87-4f0e-81f5-93b2b8b306d6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:50.590149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4166ff3-df87-4f0e-81f5-93b2b8b306d6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:50.590711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4166ff3-df87-4f0e-81f5-93b2b8b306d6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:50.591141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4166ff3-df87-4f0e-81f5-93b2b8b306d6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:50.592001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4166ff3-df87-4f0e-81f5-93b2b8b306d6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:50.592647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4166ff3-df87-4f0e-81f5-93b2b8b306d6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:50.593262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4166ff3-df87-4f0e-81f5-93b2b8b306d6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:50.727349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d4166ff3-df87-4f0e-81f5-93b2b8b306d6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:50.735508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:50.736135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:50.736272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d4166ff3-df87-4f0e-81f5-93b2b8b306d6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157772 Aug 24 06:34:50.736882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 964/1933] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:50 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:50.743253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:50.743736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:50.744166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:50.744920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:50.745367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:50.745784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:51.050602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:51.062275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:51.063774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:51.064984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-911042ac-72a8-4ec9-88ce-3e0bd8abb48d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.333540 Aug 24 06:34:51.065545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 970/1934] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:51.174271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8c273edd-8b33-4982-af16-55b34fdbc512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:51.174879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8c273edd-8b33-4982-af16-55b34fdbc512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:51.181240 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c273edd-8b33-4982-af16-55b34fdbc512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:51.181736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c273edd-8b33-4982-af16-55b34fdbc512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:51.182163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c273edd-8b33-4982-af16-55b34fdbc512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:51.182862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c273edd-8b33-4982-af16-55b34fdbc512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:51.183312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c273edd-8b33-4982-af16-55b34fdbc512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:51.183732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8c273edd-8b33-4982-af16-55b34fdbc512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:51.247506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8c273edd-8b33-4982-af16-55b34fdbc512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:51.256573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8c273edd-8b33-4982-af16-55b34fdbc512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086094 Aug 24 06:34:51.257163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 965/1935] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:51.762948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-91a13611-b48a-44d8-9bc2-94ca4b6f0bde tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:51.764067 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-91a13611-b48a-44d8-9bc2-94ca4b6f0bde tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:51.776119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91a13611-b48a-44d8-9bc2-94ca4b6f0bde tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:51.777209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91a13611-b48a-44d8-9bc2-94ca4b6f0bde tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:51.777621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91a13611-b48a-44d8-9bc2-94ca4b6f0bde tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:51.778770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91a13611-b48a-44d8-9bc2-94ca4b6f0bde tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:51.779505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91a13611-b48a-44d8-9bc2-94ca4b6f0bde tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:51.780185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-91a13611-b48a-44d8-9bc2-94ca4b6f0bde tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:51.956235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-91a13611-b48a-44d8-9bc2-94ca4b6f0bde tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:51.970989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-91a13611-b48a-44d8-9bc2-94ca4b6f0bde tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.215505 Aug 24 06:34:51.971836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 971/1936] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:51 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:52.090908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:52.091639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:52.098604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:52.099108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:52.099576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:52.100345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:52.100861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:52.101294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:52.250949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:52.261614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:52.263210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:52.264679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b27a26bb-66d0-4e44-8f9c-39fa0824a3a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.177893 Aug 24 06:34:52.265309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 966/1937] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:52.282423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c977a82a-e45a-4266-b97c-61fbdb6ebabc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:52.283775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c977a82a-e45a-4266-b97c-61fbdb6ebabc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:52.293973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c977a82a-e45a-4266-b97c-61fbdb6ebabc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:52.294809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c977a82a-e45a-4266-b97c-61fbdb6ebabc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:52.295301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c977a82a-e45a-4266-b97c-61fbdb6ebabc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:52.302524 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c977a82a-e45a-4266-b97c-61fbdb6ebabc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:52.305112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c977a82a-e45a-4266-b97c-61fbdb6ebabc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:52.305566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c977a82a-e45a-4266-b97c-61fbdb6ebabc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:52.376766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c977a82a-e45a-4266-b97c-61fbdb6ebabc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:52.386135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c977a82a-e45a-4266-b97c-61fbdb6ebabc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.111346 Aug 24 06:34:52.386771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 972/1938] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:52 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:52.994324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-334aec33-3173-4790-865a-3e23a42fc82f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:52.994851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-334aec33-3173-4790-865a-3e23a42fc82f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:53.001384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334aec33-3173-4790-865a-3e23a42fc82f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:53.001875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334aec33-3173-4790-865a-3e23a42fc82f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:53.002310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334aec33-3173-4790-865a-3e23a42fc82f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:53.003030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334aec33-3173-4790-865a-3e23a42fc82f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:53.003477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334aec33-3173-4790-865a-3e23a42fc82f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:53.003899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334aec33-3173-4790-865a-3e23a42fc82f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:53.020294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:53.152283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-334aec33-3173-4790-865a-3e23a42fc82f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:53.161397 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-334aec33-3173-4790-865a-3e23a42fc82f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.171106 Aug 24 06:34:53.161982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 967/1939] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:52 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:53.299816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:53.300403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:53.303392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:53.309199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:53.309687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:53.310125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:53.310847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:53.311293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:53.311707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:53.407534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cfbe6089-4a94-4ba5-8379-8821ec3ff64f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:53.408363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cfbe6089-4a94-4ba5-8379-8821ec3ff64f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:53.416777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfbe6089-4a94-4ba5-8379-8821ec3ff64f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:53.417375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfbe6089-4a94-4ba5-8379-8821ec3ff64f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:53.417887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfbe6089-4a94-4ba5-8379-8821ec3ff64f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:53.418668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfbe6089-4a94-4ba5-8379-8821ec3ff64f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:53.419210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfbe6089-4a94-4ba5-8379-8821ec3ff64f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:53.419697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cfbe6089-4a94-4ba5-8379-8821ec3ff64f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:53.467390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:53.478324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:53.480047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:53.482857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ab61fc4a-5c76-44fa-94e5-ad02e325fef1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.187357 Aug 24 06:34:53.483655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 973/1940] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:53.498050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cfbe6089-4a94-4ba5-8379-8821ec3ff64f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:53.509190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cfbe6089-4a94-4ba5-8379-8821ec3ff64f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.106011 Aug 24 06:34:53.509797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 968/1941] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:54.183170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1736931b-c940-45a2-8424-f621d62523b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:54.183786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1736931b-c940-45a2-8424-f621d62523b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:54.190246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1736931b-c940-45a2-8424-f621d62523b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:54.190730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1736931b-c940-45a2-8424-f621d62523b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:54.191185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1736931b-c940-45a2-8424-f621d62523b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:54.191958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1736931b-c940-45a2-8424-f621d62523b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:54.192957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1736931b-c940-45a2-8424-f621d62523b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:54.193380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1736931b-c940-45a2-8424-f621d62523b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:54.353207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1736931b-c940-45a2-8424-f621d62523b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:54.361516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1736931b-c940-45a2-8424-f621d62523b4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.182437 Aug 24 06:34:54.362082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 974/1942] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:54 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:54.513924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:54.514624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:54.521807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:54.522483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:54.522929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:54.523661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:54.524116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:54.524562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:54.531875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0c5fbd3d-b501-4d3d-8e69-d3e74c1a91c5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:54.532677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0c5fbd3d-b501-4d3d-8e69-d3e74c1a91c5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:54.539758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c5fbd3d-b501-4d3d-8e69-d3e74c1a91c5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:54.540319 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c5fbd3d-b501-4d3d-8e69-d3e74c1a91c5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:54.540859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c5fbd3d-b501-4d3d-8e69-d3e74c1a91c5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:54.541658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c5fbd3d-b501-4d3d-8e69-d3e74c1a91c5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:54.542245 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c5fbd3d-b501-4d3d-8e69-d3e74c1a91c5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:54.542975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c5fbd3d-b501-4d3d-8e69-d3e74c1a91c5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:54.612731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0c5fbd3d-b501-4d3d-8e69-d3e74c1a91c5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:54.621316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0c5fbd3d-b501-4d3d-8e69-d3e74c1a91c5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.094139 Aug 24 06:34:54.621884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 975/1943] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:54.672415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:54.681673 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:54.689053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:54.689053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4b7b827f-cfcc-47c1-b2a0-cbb837f6ab2e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.175084 Aug 24 06:34:54.689053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 969/1944] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:54 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:55.385064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d4be0292-39e2-4598-9b4d-fa77f2f1b664 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:55.386477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d4be0292-39e2-4598-9b4d-fa77f2f1b664 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:55.392618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4be0292-39e2-4598-9b4d-fa77f2f1b664 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:55.393109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4be0292-39e2-4598-9b4d-fa77f2f1b664 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:55.393554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4be0292-39e2-4598-9b4d-fa77f2f1b664 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:55.394276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4be0292-39e2-4598-9b4d-fa77f2f1b664 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:55.394745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4be0292-39e2-4598-9b4d-fa77f2f1b664 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:55.395167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4be0292-39e2-4598-9b4d-fa77f2f1b664 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:55.540707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d4be0292-39e2-4598-9b4d-fa77f2f1b664 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:55.549230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d4be0292-39e2-4598-9b4d-fa77f2f1b664 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.168807 Aug 24 06:34:55.549798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 976/1945] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:55 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:55.642874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a9947e53-52ee-4e64-a884-e3f360452979 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:55.643462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a9947e53-52ee-4e64-a884-e3f360452979 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:55.651764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9947e53-52ee-4e64-a884-e3f360452979 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:55.652245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9947e53-52ee-4e64-a884-e3f360452979 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:55.652705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9947e53-52ee-4e64-a884-e3f360452979 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:55.653406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9947e53-52ee-4e64-a884-e3f360452979 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:55.653936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9947e53-52ee-4e64-a884-e3f360452979 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:55.654353 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9947e53-52ee-4e64-a884-e3f360452979 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:55.723104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a9947e53-52ee-4e64-a884-e3f360452979 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:55.729967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:55.730610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:55.731977 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a9947e53-52ee-4e64-a884-e3f360452979 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.092875 Aug 24 06:34:55.732532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 970/1946] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:55 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:55.737011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:55.737501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:55.737923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:55.738625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:55.739115 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:55.739531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:55.877023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:55.886899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:55.888461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:55.889670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8586bac3-310a-4c3c-b0d8-cf2febf6a60e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.165191 Aug 24 06:34:55.890257 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 977/1947] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:34:56.571510 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-04115681-7be9-4bf4-ad27-abbd2e0149c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:56.572115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-04115681-7be9-4bf4-ad27-abbd2e0149c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:56.578546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04115681-7be9-4bf4-ad27-abbd2e0149c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:56.579365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04115681-7be9-4bf4-ad27-abbd2e0149c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:56.579534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04115681-7be9-4bf4-ad27-abbd2e0149c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:56.580176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04115681-7be9-4bf4-ad27-abbd2e0149c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:56.580658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04115681-7be9-4bf4-ad27-abbd2e0149c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:56.581075 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04115681-7be9-4bf4-ad27-abbd2e0149c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:56.718052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-04115681-7be9-4bf4-ad27-abbd2e0149c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:56.728396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-04115681-7be9-4bf4-ad27-abbd2e0149c2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.160289 Aug 24 06:34:56.728396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 971/1948] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:56 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:56.755800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6070bed3-173c-4dee-afe5-d23031469acf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:56.756407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6070bed3-173c-4dee-afe5-d23031469acf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:56.763065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6070bed3-173c-4dee-afe5-d23031469acf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:56.763546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6070bed3-173c-4dee-afe5-d23031469acf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:56.763976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6070bed3-173c-4dee-afe5-d23031469acf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:56.764727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6070bed3-173c-4dee-afe5-d23031469acf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:56.765173 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6070bed3-173c-4dee-afe5-d23031469acf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:56.765590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6070bed3-173c-4dee-afe5-d23031469acf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:56.833390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6070bed3-173c-4dee-afe5-d23031469acf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:56.841769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6070bed3-173c-4dee-afe5-d23031469acf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.091497 Aug 24 06:34:56.842345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 978/1949] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:56.915190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:56.915788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:56.921900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:56.922377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:56.922797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:56.923481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:56.923929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:56.924343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:57.058383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:57.068121 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:57.069659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:57.070833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ba158f92-1830-47ab-9bb2-83f51864f4e4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.160309 Aug 24 06:34:57.071391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 972/1950] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:57.749410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1369f9ec-c484-4c85-a659-8927d16e4864 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:57.750064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1369f9ec-c484-4c85-a659-8927d16e4864 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:57.757951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1369f9ec-c484-4c85-a659-8927d16e4864 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:57.758616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1369f9ec-c484-4c85-a659-8927d16e4864 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:57.758849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1369f9ec-c484-4c85-a659-8927d16e4864 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:57.759547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1369f9ec-c484-4c85-a659-8927d16e4864 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:57.759994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1369f9ec-c484-4c85-a659-8927d16e4864 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:57.760410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1369f9ec-c484-4c85-a659-8927d16e4864 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:57.763734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:34:57.863668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-41bdff3b-e5ae-4af5-8b46-2845af3dc673 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:57.864960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-41bdff3b-e5ae-4af5-8b46-2845af3dc673 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:57.871909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41bdff3b-e5ae-4af5-8b46-2845af3dc673 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:57.872396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41bdff3b-e5ae-4af5-8b46-2845af3dc673 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:57.878247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41bdff3b-e5ae-4af5-8b46-2845af3dc673 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:57.878247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41bdff3b-e5ae-4af5-8b46-2845af3dc673 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:57.878247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41bdff3b-e5ae-4af5-8b46-2845af3dc673 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:57.878247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-41bdff3b-e5ae-4af5-8b46-2845af3dc673 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:57.959377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-41bdff3b-e5ae-4af5-8b46-2845af3dc673 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:57.968446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-41bdff3b-e5ae-4af5-8b46-2845af3dc673 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.109135 Aug 24 06:34:57.969085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 973/1951] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:57 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:58.094963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:58.095587 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:58.102347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:58.102831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:58.110605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:58.110605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:58.110605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:58.110605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:58.168227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1369f9ec-c484-4c85-a659-8927d16e4864 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:58.178055 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1369f9ec-c484-4c85-a659-8927d16e4864 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.432836 Aug 24 06:34:58.178629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 979/1952] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:57 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:34:58.245030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:58.253585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:58.255129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:58.256284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5dc3378c-b3f2-4f7d-9367-7daf1a2beb68 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.165513 Aug 24 06:34:58.256875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 974/1953] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:58 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:34:58.990241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1462312f-08cc-4f1a-bf95-b8df70acbb51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:58.990788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1462312f-08cc-4f1a-bf95-b8df70acbb51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:58.997380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1462312f-08cc-4f1a-bf95-b8df70acbb51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:58.997855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1462312f-08cc-4f1a-bf95-b8df70acbb51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:58.998282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1462312f-08cc-4f1a-bf95-b8df70acbb51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:58.998979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1462312f-08cc-4f1a-bf95-b8df70acbb51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:58.999422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1462312f-08cc-4f1a-bf95-b8df70acbb51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:58.999856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1462312f-08cc-4f1a-bf95-b8df70acbb51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:59.064204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1462312f-08cc-4f1a-bf95-b8df70acbb51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:59.073254 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1462312f-08cc-4f1a-bf95-b8df70acbb51 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086851 Aug 24 06:34:59.073841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 980/1954] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:59.206900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fa4f119f-9dae-4542-a196-077fade99be6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:59.207503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fa4f119f-9dae-4542-a196-077fade99be6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:59.214630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa4f119f-9dae-4542-a196-077fade99be6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:59.215109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa4f119f-9dae-4542-a196-077fade99be6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:59.215543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa4f119f-9dae-4542-a196-077fade99be6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:59.216241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa4f119f-9dae-4542-a196-077fade99be6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:59.216730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa4f119f-9dae-4542-a196-077fade99be6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:59.217152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa4f119f-9dae-4542-a196-077fade99be6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:59.279812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:34:59.280399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:34:59.288126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:59.288746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:59.289249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:59.290386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:34:59.290997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:34:59.291511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:34:59.358884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fa4f119f-9dae-4542-a196-077fade99be6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:59.369075 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fa4f119f-9dae-4542-a196-077fade99be6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.165931 Aug 24 06:34:59.369714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 975/1955] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:34:59 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:34:59.432688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:59.441861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:59.443367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:34:59.444575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bd43da68-d3c3-4822-8b7a-b7c03214b65e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.169044 Aug 24 06:34:59.445134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 981/1956] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:34:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:00.095697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-856c75a3-e521-4aad-aed5-7f1376afab61 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:00.096224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-856c75a3-e521-4aad-aed5-7f1376afab61 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:00.102641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-856c75a3-e521-4aad-aed5-7f1376afab61 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:00.103136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-856c75a3-e521-4aad-aed5-7f1376afab61 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:00.103577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-856c75a3-e521-4aad-aed5-7f1376afab61 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:00.104288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-856c75a3-e521-4aad-aed5-7f1376afab61 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:00.104779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-856c75a3-e521-4aad-aed5-7f1376afab61 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:00.105227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-856c75a3-e521-4aad-aed5-7f1376afab61 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:00.167056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-856c75a3-e521-4aad-aed5-7f1376afab61 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:00.175528 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-856c75a3-e521-4aad-aed5-7f1376afab61 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083816 Aug 24 06:35:00.176103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 976/1957] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:00.393657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-324caaca-024b-4f5d-8aed-43b7dd621ef1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:00.394233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-324caaca-024b-4f5d-8aed-43b7dd621ef1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:00.401004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324caaca-024b-4f5d-8aed-43b7dd621ef1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:00.401490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324caaca-024b-4f5d-8aed-43b7dd621ef1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:00.402267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324caaca-024b-4f5d-8aed-43b7dd621ef1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:00.402605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324caaca-024b-4f5d-8aed-43b7dd621ef1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:00.403056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324caaca-024b-4f5d-8aed-43b7dd621ef1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:00.403478 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-324caaca-024b-4f5d-8aed-43b7dd621ef1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:00.467260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:00.468417 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:00.477053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:00.477546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:00.477982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:00.478711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:00.479162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:00.479580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:00.539143 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-324caaca-024b-4f5d-8aed-43b7dd621ef1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:00.547678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-324caaca-024b-4f5d-8aed-43b7dd621ef1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157901 Aug 24 06:35:00.548253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 982/1958] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:00 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:00.608960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:00.619415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:00.621009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:00.622169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-47249fb1-fb31-4beb-8c49-f72067794c64 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159706 Aug 24 06:35:00.622730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 977/1959] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:00 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:01.196835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ce929eff-8813-4906-80ea-3e10c303fa44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:01.197440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ce929eff-8813-4906-80ea-3e10c303fa44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:01.203450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce929eff-8813-4906-80ea-3e10c303fa44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:01.203922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce929eff-8813-4906-80ea-3e10c303fa44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:01.204346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce929eff-8813-4906-80ea-3e10c303fa44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:01.205063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce929eff-8813-4906-80ea-3e10c303fa44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:01.205507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce929eff-8813-4906-80ea-3e10c303fa44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:01.205921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce929eff-8813-4906-80ea-3e10c303fa44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:01.267346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ce929eff-8813-4906-80ea-3e10c303fa44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:01.276375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ce929eff-8813-4906-80ea-3e10c303fa44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083338 Aug 24 06:35:01.276980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 983/1960] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:01.569258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8d78cff5-59f9-4acc-8a0b-9b26d8c22f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:01.569835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8d78cff5-59f9-4acc-8a0b-9b26d8c22f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:01.576356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78cff5-59f9-4acc-8a0b-9b26d8c22f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:01.576868 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78cff5-59f9-4acc-8a0b-9b26d8c22f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:01.577296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78cff5-59f9-4acc-8a0b-9b26d8c22f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:01.577986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78cff5-59f9-4acc-8a0b-9b26d8c22f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:01.578433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78cff5-59f9-4acc-8a0b-9b26d8c22f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:01.578848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78cff5-59f9-4acc-8a0b-9b26d8c22f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:01.644849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:01.645494 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:01.652005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:01.652561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:01.653003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:01.653740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:01.654188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:01.654674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:01.728574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8d78cff5-59f9-4acc-8a0b-9b26d8c22f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:01.728574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8d78cff5-59f9-4acc-8a0b-9b26d8c22f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.162632 Aug 24 06:35:01.728574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 978/1961] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:01 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:01.790665 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:01.799383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:01.801099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:01.802327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b5697b20-66a2-4ebd-83a8-cdfe23ffead9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161522 Aug 24 06:35:01.802877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 984/1962] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:02.298047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-762a1bc1-7d06-4a51-8250-bfe2a6edbc35 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:02.298657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-762a1bc1-7d06-4a51-8250-bfe2a6edbc35 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:02.305253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-762a1bc1-7d06-4a51-8250-bfe2a6edbc35 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:02.305735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-762a1bc1-7d06-4a51-8250-bfe2a6edbc35 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:02.306168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-762a1bc1-7d06-4a51-8250-bfe2a6edbc35 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:02.306861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-762a1bc1-7d06-4a51-8250-bfe2a6edbc35 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:02.307310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-762a1bc1-7d06-4a51-8250-bfe2a6edbc35 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:02.307734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-762a1bc1-7d06-4a51-8250-bfe2a6edbc35 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:02.367015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-762a1bc1-7d06-4a51-8250-bfe2a6edbc35 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:02.375200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-762a1bc1-7d06-4a51-8250-bfe2a6edbc35 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.081021 Aug 24 06:35:02.375797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 979/1963] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:02 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:02.749216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b47cc73a-be39-4d62-b8c6-e4500aa20cac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:02.749801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b47cc73a-be39-4d62-b8c6-e4500aa20cac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:02.756218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b47cc73a-be39-4d62-b8c6-e4500aa20cac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:02.756731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b47cc73a-be39-4d62-b8c6-e4500aa20cac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:02.757158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b47cc73a-be39-4d62-b8c6-e4500aa20cac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:02.757838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b47cc73a-be39-4d62-b8c6-e4500aa20cac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:02.758280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b47cc73a-be39-4d62-b8c6-e4500aa20cac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:02.758694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b47cc73a-be39-4d62-b8c6-e4500aa20cac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:02.825732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:02.826363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:02.832282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:02.833320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:02.833751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:02.834435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:02.834880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:02.835294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:02.890024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b47cc73a-be39-4d62-b8c6-e4500aa20cac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:02.908700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b47cc73a-be39-4d62-b8c6-e4500aa20cac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153697 Aug 24 06:35:02.909332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 985/1964] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:02 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:02.963410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:02.972484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:02.974726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:02.975920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b22a0163-1121-4ff2-a832-1304ddac273d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.154424 Aug 24 06:35:02.976475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 980/1965] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:03.395798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a1ccdebc-726b-472d-833f-c0711158c06f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:03.396323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a1ccdebc-726b-472d-833f-c0711158c06f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:03.402285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ccdebc-726b-472d-833f-c0711158c06f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:03.402758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ccdebc-726b-472d-833f-c0711158c06f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:03.403182 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ccdebc-726b-472d-833f-c0711158c06f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:03.403859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ccdebc-726b-472d-833f-c0711158c06f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:03.404300 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ccdebc-726b-472d-833f-c0711158c06f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:03.404735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ccdebc-726b-472d-833f-c0711158c06f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:03.465104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a1ccdebc-726b-472d-833f-c0711158c06f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:03.473949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a1ccdebc-726b-472d-833f-c0711158c06f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.081403 Aug 24 06:35:03.474509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 986/1966] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:03 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:03.930196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-58fc17e5-b1f1-44a3-adbb-9aed472fea2c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:03.930790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-58fc17e5-b1f1-44a3-adbb-9aed472fea2c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:03.937791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58fc17e5-b1f1-44a3-adbb-9aed472fea2c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:03.938264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58fc17e5-b1f1-44a3-adbb-9aed472fea2c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:03.938690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58fc17e5-b1f1-44a3-adbb-9aed472fea2c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:03.939497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58fc17e5-b1f1-44a3-adbb-9aed472fea2c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:03.939944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58fc17e5-b1f1-44a3-adbb-9aed472fea2c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:03.940358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58fc17e5-b1f1-44a3-adbb-9aed472fea2c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:03.998743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:03.999341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:04.006901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:04.007360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:04.007794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:04.008552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:04.009012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:04.009436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:04.080537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-58fc17e5-b1f1-44a3-adbb-9aed472fea2c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:04.089553 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-58fc17e5-b1f1-44a3-adbb-9aed472fea2c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.163336 Aug 24 06:35:04.090144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 981/1967] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:03 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:04.147631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:04.156472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:04.158015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:04.159183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-518a0a01-18bb-438c-afd6-fe21cafd2d06 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.164851 Aug 24 06:35:04.159746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 987/1968] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:04.495664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-99c3ae67-c9c6-4779-8d1b-5e50c46c0017 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:04.496283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-99c3ae67-c9c6-4779-8d1b-5e50c46c0017 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:04.502395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99c3ae67-c9c6-4779-8d1b-5e50c46c0017 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:04.502875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99c3ae67-c9c6-4779-8d1b-5e50c46c0017 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:04.503302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99c3ae67-c9c6-4779-8d1b-5e50c46c0017 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:04.503998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99c3ae67-c9c6-4779-8d1b-5e50c46c0017 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:04.504449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99c3ae67-c9c6-4779-8d1b-5e50c46c0017 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:04.504896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99c3ae67-c9c6-4779-8d1b-5e50c46c0017 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:04.567875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-99c3ae67-c9c6-4779-8d1b-5e50c46c0017 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:04.576108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-99c3ae67-c9c6-4779-8d1b-5e50c46c0017 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084368 Aug 24 06:35:04.576706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 982/1969] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:05.111009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ef9d7328-4f1a-4e22-a8e5-4d1de85e49a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:05.111633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ef9d7328-4f1a-4e22-a8e5-4d1de85e49a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:05.118325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef9d7328-4f1a-4e22-a8e5-4d1de85e49a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:05.118800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef9d7328-4f1a-4e22-a8e5-4d1de85e49a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:05.119235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef9d7328-4f1a-4e22-a8e5-4d1de85e49a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:05.119931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef9d7328-4f1a-4e22-a8e5-4d1de85e49a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:05.120380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef9d7328-4f1a-4e22-a8e5-4d1de85e49a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:05.120835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef9d7328-4f1a-4e22-a8e5-4d1de85e49a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:05.181982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:05.182728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:05.189971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:05.190455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:05.190892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:05.191599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:05.192049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:05.192475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:05.262516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ef9d7328-4f1a-4e22-a8e5-4d1de85e49a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:05.271037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ef9d7328-4f1a-4e22-a8e5-4d1de85e49a6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.163853 Aug 24 06:35:05.272210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 988/1970] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:05 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:05.342202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:05.351629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:05.353386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:05.354708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b65a5d46-1c71-45c1-b7be-cc478799caa7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.176729 Aug 24 06:35:05.355401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 983/1971] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:05.596947 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d700d4f6-178b-4deb-90cb-7cfdbf1dae4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:05.597549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d700d4f6-178b-4deb-90cb-7cfdbf1dae4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:05.603978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d700d4f6-178b-4deb-90cb-7cfdbf1dae4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:05.604450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d700d4f6-178b-4deb-90cb-7cfdbf1dae4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:05.604911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d700d4f6-178b-4deb-90cb-7cfdbf1dae4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:05.605590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d700d4f6-178b-4deb-90cb-7cfdbf1dae4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:05.606035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d700d4f6-178b-4deb-90cb-7cfdbf1dae4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:05.606448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d700d4f6-178b-4deb-90cb-7cfdbf1dae4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:05.671588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d700d4f6-178b-4deb-90cb-7cfdbf1dae4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:05.679871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d700d4f6-178b-4deb-90cb-7cfdbf1dae4d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086839 Aug 24 06:35:05.680440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 989/1972] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:06.305967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-061e777a-8eae-4cc6-9ada-3fe54443b642 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:06.306580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-061e777a-8eae-4cc6-9ada-3fe54443b642 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:06.313742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-061e777a-8eae-4cc6-9ada-3fe54443b642 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:06.314216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-061e777a-8eae-4cc6-9ada-3fe54443b642 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:06.314642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-061e777a-8eae-4cc6-9ada-3fe54443b642 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:06.315323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-061e777a-8eae-4cc6-9ada-3fe54443b642 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:06.315768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-061e777a-8eae-4cc6-9ada-3fe54443b642 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:06.316189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-061e777a-8eae-4cc6-9ada-3fe54443b642 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:06.320620 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:06.377014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:06.377674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:06.384449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:06.384966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:06.385399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:06.386100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:06.386552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:06.386975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:06.448195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-061e777a-8eae-4cc6-9ada-3fe54443b642 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:06.456429 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-061e777a-8eae-4cc6-9ada-3fe54443b642 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154285 Aug 24 06:35:06.457021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 984/1973] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:06 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:06.516169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:06.525605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:06.527149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:06.528319 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cd861005-f738-46e0-9738-7aea07f47511 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155323 Aug 24 06:35:06.528927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 990/1974] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:06.701155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-04c5458c-861a-47d6-80ce-091542b786ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:06.701799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-04c5458c-861a-47d6-80ce-091542b786ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:06.707818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04c5458c-861a-47d6-80ce-091542b786ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:06.708293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04c5458c-861a-47d6-80ce-091542b786ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:06.709259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04c5458c-861a-47d6-80ce-091542b786ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:06.709943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04c5458c-861a-47d6-80ce-091542b786ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:06.710380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04c5458c-861a-47d6-80ce-091542b786ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:06.710791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04c5458c-861a-47d6-80ce-091542b786ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:06.771830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-04c5458c-861a-47d6-80ce-091542b786ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:06.779922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-04c5458c-861a-47d6-80ce-091542b786ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082674 Aug 24 06:35:06.780485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 985/1975] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:07.478718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d9869cbc-34e7-465f-a2d1-59f1de41d90c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:07.479369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d9869cbc-34e7-465f-a2d1-59f1de41d90c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:07.485961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9869cbc-34e7-465f-a2d1-59f1de41d90c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:07.486443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9869cbc-34e7-465f-a2d1-59f1de41d90c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:07.486871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9869cbc-34e7-465f-a2d1-59f1de41d90c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:07.487571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9869cbc-34e7-465f-a2d1-59f1de41d90c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:07.488016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9869cbc-34e7-465f-a2d1-59f1de41d90c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:07.488476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d9869cbc-34e7-465f-a2d1-59f1de41d90c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:07.551949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:07.553943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:07.561191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:07.563455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:07.563455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:07.563455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:07.563455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:07.563853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:07.625782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d9869cbc-34e7-465f-a2d1-59f1de41d90c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:07.634898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d9869cbc-34e7-465f-a2d1-59f1de41d90c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.159961 Aug 24 06:35:07.635508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 991/1976] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:07 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:07.704698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:07.715114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:07.716668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:07.717894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-92b7b810-5788-48b5-b567-5c84afa497d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.170243 Aug 24 06:35:07.718489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 986/1977] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:07 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:07.800856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ee094655-ab22-4e1e-b4ef-d854bb4f9ccf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:07.801503 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ee094655-ab22-4e1e-b4ef-d854bb4f9ccf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:07.808177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee094655-ab22-4e1e-b4ef-d854bb4f9ccf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:07.808700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee094655-ab22-4e1e-b4ef-d854bb4f9ccf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:07.809409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee094655-ab22-4e1e-b4ef-d854bb4f9ccf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:07.810104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee094655-ab22-4e1e-b4ef-d854bb4f9ccf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:07.810547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee094655-ab22-4e1e-b4ef-d854bb4f9ccf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:07.810961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ee094655-ab22-4e1e-b4ef-d854bb4f9ccf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:07.887154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ee094655-ab22-4e1e-b4ef-d854bb4f9ccf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:07.896448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ee094655-ab22-4e1e-b4ef-d854bb4f9ccf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.098982 Aug 24 06:35:07.897076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 992/1978] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:08.657108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a3249e2b-aaf5-4713-b3da-9f234c9ac6ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:08.657715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a3249e2b-aaf5-4713-b3da-9f234c9ac6ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:08.664364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3249e2b-aaf5-4713-b3da-9f234c9ac6ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:08.664881 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3249e2b-aaf5-4713-b3da-9f234c9ac6ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:08.665319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3249e2b-aaf5-4713-b3da-9f234c9ac6ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:08.666013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3249e2b-aaf5-4713-b3da-9f234c9ac6ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:08.666466 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3249e2b-aaf5-4713-b3da-9f234c9ac6ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:08.666891 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3249e2b-aaf5-4713-b3da-9f234c9ac6ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:08.741871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:08.742580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:08.749431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:08.749913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:08.750347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:08.751055 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:08.751507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:08.752319 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:08.808745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a3249e2b-aaf5-4713-b3da-9f234c9ac6ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:08.817510 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a3249e2b-aaf5-4713-b3da-9f234c9ac6ca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164348 Aug 24 06:35:08.819218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 987/1979] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:08 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:08.890159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:08.900329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:08.901921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:08.903137 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-67e87aa5-01e4-4607-aa60-6e6d6e297ca9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.165790 Aug 24 06:35:08.903713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 993/1980] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:08.918473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-12c2af70-894e-4073-ade7-386c5febdac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:08.919092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-12c2af70-894e-4073-ade7-386c5febdac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:08.928354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12c2af70-894e-4073-ade7-386c5febdac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:08.928888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12c2af70-894e-4073-ade7-386c5febdac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:08.929326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12c2af70-894e-4073-ade7-386c5febdac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:08.930089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12c2af70-894e-4073-ade7-386c5febdac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:08.930815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12c2af70-894e-4073-ade7-386c5febdac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:08.931566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-12c2af70-894e-4073-ade7-386c5febdac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:08.997460 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-12c2af70-894e-4073-ade7-386c5febdac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:09.006625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-12c2af70-894e-4073-ade7-386c5febdac9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.092077 Aug 24 06:35:09.007260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 988/1981] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:09.840075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5abc51eb-adeb-4899-8489-361cd4b72b65 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:09.840737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5abc51eb-adeb-4899-8489-361cd4b72b65 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:09.847340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abc51eb-adeb-4899-8489-361cd4b72b65 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:09.847825 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abc51eb-adeb-4899-8489-361cd4b72b65 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:09.848263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abc51eb-adeb-4899-8489-361cd4b72b65 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:09.849570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abc51eb-adeb-4899-8489-361cd4b72b65 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:09.850040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abc51eb-adeb-4899-8489-361cd4b72b65 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:09.850465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5abc51eb-adeb-4899-8489-361cd4b72b65 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:09.926921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:09.929887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:09.935069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:09.935562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:09.936000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:09.936741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:09.937197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:09.937619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:09.981225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5abc51eb-adeb-4899-8489-361cd4b72b65 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:09.992855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5abc51eb-adeb-4899-8489-361cd4b72b65 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.156500 Aug 24 06:35:09.993589 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 994/1982] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:09 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:10.027853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4dc68d26-382c-4343-8eb1-fac11a051a7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:10.028469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4dc68d26-382c-4343-8eb1-fac11a051a7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:10.035079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc68d26-382c-4343-8eb1-fac11a051a7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:10.035565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc68d26-382c-4343-8eb1-fac11a051a7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:10.036008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc68d26-382c-4343-8eb1-fac11a051a7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:10.037253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc68d26-382c-4343-8eb1-fac11a051a7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:10.037705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc68d26-382c-4343-8eb1-fac11a051a7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:10.038128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4dc68d26-382c-4343-8eb1-fac11a051a7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:10.077896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:10.087072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:10.088659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:10.089822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d6de9c62-7e34-43ce-8194-667ed0d891d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.166919 Aug 24 06:35:10.090377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 989/1983] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:10.107366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4dc68d26-382c-4343-8eb1-fac11a051a7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:10.109744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:10.118802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4dc68d26-382c-4343-8eb1-fac11a051a7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093526 Aug 24 06:35:10.118802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 995/1984] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:10 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:11.014954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-70492556-2db2-4ac9-bcd9-8790c0fe36e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:11.015519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-70492556-2db2-4ac9-bcd9-8790c0fe36e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:11.022215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70492556-2db2-4ac9-bcd9-8790c0fe36e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:11.022696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70492556-2db2-4ac9-bcd9-8790c0fe36e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:11.023124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70492556-2db2-4ac9-bcd9-8790c0fe36e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:11.023822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70492556-2db2-4ac9-bcd9-8790c0fe36e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:11.024267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70492556-2db2-4ac9-bcd9-8790c0fe36e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:11.024717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70492556-2db2-4ac9-bcd9-8790c0fe36e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:11.117657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:11.118309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:11.125492 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:11.125979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:11.126413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:11.127123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:11.127573 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:11.127998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:11.180241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-70492556-2db2-4ac9-bcd9-8790c0fe36e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:11.187666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-70492556-2db2-4ac9-bcd9-8790c0fe36e6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.176713 Aug 24 06:35:11.188369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 990/1985] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:11 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:11.197736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-facb003c-9693-42f5-bb2b-c250a3f6347f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:11.198900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-facb003c-9693-42f5-bb2b-c250a3f6347f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:11.210136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-facb003c-9693-42f5-bb2b-c250a3f6347f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:11.211017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-facb003c-9693-42f5-bb2b-c250a3f6347f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:11.211817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-facb003c-9693-42f5-bb2b-c250a3f6347f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:11.213101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-facb003c-9693-42f5-bb2b-c250a3f6347f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:11.213940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-facb003c-9693-42f5-bb2b-c250a3f6347f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:11.214710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-facb003c-9693-42f5-bb2b-c250a3f6347f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:11.270798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:11.280117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-facb003c-9693-42f5-bb2b-c250a3f6347f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:11.280354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:11.281900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:11.283109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-33c4c470-a251-4d64-b115-15ad15f3098b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.172550 Aug 24 06:35:11.283682 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 996/1986] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:11.289538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-facb003c-9693-42f5-bb2b-c250a3f6347f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.099751 Aug 24 06:35:11.290115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 991/1987] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:12.224373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-430fb087-46cb-42b0-a631-8bed1cf13ea9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:12.225038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-430fb087-46cb-42b0-a631-8bed1cf13ea9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:12.231599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-430fb087-46cb-42b0-a631-8bed1cf13ea9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:12.232080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-430fb087-46cb-42b0-a631-8bed1cf13ea9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:12.232527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-430fb087-46cb-42b0-a631-8bed1cf13ea9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:12.233231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-430fb087-46cb-42b0-a631-8bed1cf13ea9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:12.233679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-430fb087-46cb-42b0-a631-8bed1cf13ea9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:12.234097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-430fb087-46cb-42b0-a631-8bed1cf13ea9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:12.306010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:12.306639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:12.313660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:12.314146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:12.314577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:12.315275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:12.315726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:12.316147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:12.366463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-430fb087-46cb-42b0-a631-8bed1cf13ea9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:12.375387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-430fb087-46cb-42b0-a631-8bed1cf13ea9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154805 Aug 24 06:35:12.375976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 997/1988] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:12 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:12.381443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2ce95fe6-2876-495b-a317-f3daefb7f09d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:12.382116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2ce95fe6-2876-495b-a317-f3daefb7f09d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:12.388390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ce95fe6-2876-495b-a317-f3daefb7f09d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:12.388929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ce95fe6-2876-495b-a317-f3daefb7f09d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:12.389363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ce95fe6-2876-495b-a317-f3daefb7f09d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:12.390071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ce95fe6-2876-495b-a317-f3daefb7f09d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:12.390523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ce95fe6-2876-495b-a317-f3daefb7f09d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:12.391107 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2ce95fe6-2876-495b-a317-f3daefb7f09d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:12.463221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2ce95fe6-2876-495b-a317-f3daefb7f09d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:12.463547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:12.472705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:12.473018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2ce95fe6-2876-495b-a317-f3daefb7f09d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.095748 Aug 24 06:35:12.473878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 998/1989] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:12.474299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:12.475696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-245e85cd-70b3-4f0a-bc79-ba72b075347d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.173619 Aug 24 06:35:12.477303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 992/1990] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:13.405760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6ea87dd3-54f4-42bf-9cf0-f327ac8c7284 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:13.406449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6ea87dd3-54f4-42bf-9cf0-f327ac8c7284 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:13.413578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ea87dd3-54f4-42bf-9cf0-f327ac8c7284 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:13.414059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ea87dd3-54f4-42bf-9cf0-f327ac8c7284 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:13.414492 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ea87dd3-54f4-42bf-9cf0-f327ac8c7284 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:13.415189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ea87dd3-54f4-42bf-9cf0-f327ac8c7284 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:13.415636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ea87dd3-54f4-42bf-9cf0-f327ac8c7284 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:13.416057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6ea87dd3-54f4-42bf-9cf0-f327ac8c7284 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:13.494664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f5d0edef-9ffb-4217-addd-64ff296cdbba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:13.495591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f5d0edef-9ffb-4217-addd-64ff296cdbba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:13.502146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5d0edef-9ffb-4217-addd-64ff296cdbba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:13.502629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5d0edef-9ffb-4217-addd-64ff296cdbba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:13.503064 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5d0edef-9ffb-4217-addd-64ff296cdbba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:13.503766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5d0edef-9ffb-4217-addd-64ff296cdbba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:13.504388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5d0edef-9ffb-4217-addd-64ff296cdbba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:13.504666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5d0edef-9ffb-4217-addd-64ff296cdbba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:13.559435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6ea87dd3-54f4-42bf-9cf0-f327ac8c7284 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:13.568173 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6ea87dd3-54f4-42bf-9cf0-f327ac8c7284 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.166386 Aug 24 06:35:13.569493 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 999/1991] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:13 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:13.572748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f5d0edef-9ffb-4217-addd-64ff296cdbba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:13.573737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:13.574343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:13.580548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:13.581040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:13.581477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:13.582188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:13.582636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:13.583056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:13.584294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f5d0edef-9ffb-4217-addd-64ff296cdbba tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093489 Aug 24 06:35:13.585038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 993/1992] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:13.716285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:13.725875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:13.727377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:13.728558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b46fefcc-4265-44d5-8522-6f9c0de142b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158496 Aug 24 06:35:13.729119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1000/1993] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:13 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:14.588854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-de0cf4b5-6177-4670-96c4-38ae434bdda0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:14.589485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-de0cf4b5-6177-4670-96c4-38ae434bdda0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:14.596132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de0cf4b5-6177-4670-96c4-38ae434bdda0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:14.596653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de0cf4b5-6177-4670-96c4-38ae434bdda0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:14.597085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de0cf4b5-6177-4670-96c4-38ae434bdda0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:14.597781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de0cf4b5-6177-4670-96c4-38ae434bdda0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:14.598228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de0cf4b5-6177-4670-96c4-38ae434bdda0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:14.598647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de0cf4b5-6177-4670-96c4-38ae434bdda0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:14.607303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c0dfd8bb-37b8-4d95-b0b3-70ef6c26020f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:14.607975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c0dfd8bb-37b8-4d95-b0b3-70ef6c26020f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:14.617987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0dfd8bb-37b8-4d95-b0b3-70ef6c26020f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:14.618477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0dfd8bb-37b8-4d95-b0b3-70ef6c26020f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:14.618922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0dfd8bb-37b8-4d95-b0b3-70ef6c26020f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:14.619654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0dfd8bb-37b8-4d95-b0b3-70ef6c26020f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:14.620103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0dfd8bb-37b8-4d95-b0b3-70ef6c26020f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:14.620540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0dfd8bb-37b8-4d95-b0b3-70ef6c26020f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:14.690955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c0dfd8bb-37b8-4d95-b0b3-70ef6c26020f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:14.706361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c0dfd8bb-37b8-4d95-b0b3-70ef6c26020f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.102605 Aug 24 06:35:14.707656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1001/1994] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:14.753520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:14.754523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:14.757679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-de0cf4b5-6177-4670-96c4-38ae434bdda0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:14.765120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:14.765912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:14.766605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:14.767768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:14.768518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:14.769254 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:14.771473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-de0cf4b5-6177-4670-96c4-38ae434bdda0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.186103 Aug 24 06:35:14.772432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 994/1995] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:14 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:14.911063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:14.920625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:14.922141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:14.923353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-608701e2-2a2d-48f4-853f-bbc5e1edd463 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.174671 Aug 24 06:35:14.923914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1002/1996] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:15.741657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ab65a19f-6cda-4f44-9bd7-e28f9a22f9c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:15.742276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ab65a19f-6cda-4f44-9bd7-e28f9a22f9c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:15.748885 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab65a19f-6cda-4f44-9bd7-e28f9a22f9c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:15.749413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab65a19f-6cda-4f44-9bd7-e28f9a22f9c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:15.749830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab65a19f-6cda-4f44-9bd7-e28f9a22f9c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:15.750531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab65a19f-6cda-4f44-9bd7-e28f9a22f9c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:15.750984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab65a19f-6cda-4f44-9bd7-e28f9a22f9c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:15.751407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ab65a19f-6cda-4f44-9bd7-e28f9a22f9c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:15.794516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-42b9c345-6952-42bf-b2b4-b07807cd3087 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:15.795166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-42b9c345-6952-42bf-b2b4-b07807cd3087 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:15.803120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b9c345-6952-42bf-b2b4-b07807cd3087 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:15.803603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b9c345-6952-42bf-b2b4-b07807cd3087 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:15.804039 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b9c345-6952-42bf-b2b4-b07807cd3087 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:15.804771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b9c345-6952-42bf-b2b4-b07807cd3087 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:15.805220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b9c345-6952-42bf-b2b4-b07807cd3087 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:15.805794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42b9c345-6952-42bf-b2b4-b07807cd3087 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:15.825095 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ab65a19f-6cda-4f44-9bd7-e28f9a22f9c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:15.833584 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ab65a19f-6cda-4f44-9bd7-e28f9a22f9c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.096349 Aug 24 06:35:15.834259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 995/1997] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:15 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:15.939535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-42b9c345-6952-42bf-b2b4-b07807cd3087 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:15.947208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:15.947818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:15.948485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-42b9c345-6952-42bf-b2b4-b07807cd3087 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157742 Aug 24 06:35:15.949102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1003/1998] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:15 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:15.949758 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=76 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:15.954748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:15.955233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:15.955666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:15.956431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:15.956912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:15.964821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:16.094226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:16.104006 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:16.105539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:16.106710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-082e7053-7ebc-4f3d-8246-071795934b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163605 Aug 24 06:35:16.107272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 996/1999] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:16.855310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5b087b5c-04e5-4b25-9ee3-830255d3c96d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:16.855989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5b087b5c-04e5-4b25-9ee3-830255d3c96d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:16.862789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b087b5c-04e5-4b25-9ee3-830255d3c96d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:16.863274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b087b5c-04e5-4b25-9ee3-830255d3c96d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:16.863705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b087b5c-04e5-4b25-9ee3-830255d3c96d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:16.864425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b087b5c-04e5-4b25-9ee3-830255d3c96d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:16.864900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b087b5c-04e5-4b25-9ee3-830255d3c96d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:16.865309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5b087b5c-04e5-4b25-9ee3-830255d3c96d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:16.933089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5b087b5c-04e5-4b25-9ee3-830255d3c96d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:16.941542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5b087b5c-04e5-4b25-9ee3-830255d3c96d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.090276 Aug 24 06:35:16.942106 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1004/2000] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:16.970073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0e9e20ae-7d98-4d76-8bfb-57cf967d2c7d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:16.970660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0e9e20ae-7d98-4d76-8bfb-57cf967d2c7d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:16.977097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e9e20ae-7d98-4d76-8bfb-57cf967d2c7d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:16.977573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e9e20ae-7d98-4d76-8bfb-57cf967d2c7d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:16.978001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e9e20ae-7d98-4d76-8bfb-57cf967d2c7d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:16.978687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e9e20ae-7d98-4d76-8bfb-57cf967d2c7d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:16.979131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e9e20ae-7d98-4d76-8bfb-57cf967d2c7d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:16.979585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0e9e20ae-7d98-4d76-8bfb-57cf967d2c7d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:17.113290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0e9e20ae-7d98-4d76-8bfb-57cf967d2c7d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:17.122197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0e9e20ae-7d98-4d76-8bfb-57cf967d2c7d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.156025 Aug 24 06:35:17.122845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 997/2001] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:16 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:17.134762 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:17.135892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:17.146765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:17.147777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:17.148688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:17.149503 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:17.150001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:17.150465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:17.284122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:17.293641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:17.295186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:17.296386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f4a43c75-a62c-431a-81df-205b7b31d317 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.169841 Aug 24 06:35:17.296988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1005/2002] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:17.963030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c44c59e3-9746-4a35-81eb-f15a691192e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:17.963547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c44c59e3-9746-4a35-81eb-f15a691192e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:17.969733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c59e3-9746-4a35-81eb-f15a691192e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:17.970211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c59e3-9746-4a35-81eb-f15a691192e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:17.970778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c59e3-9746-4a35-81eb-f15a691192e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:17.971320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c59e3-9746-4a35-81eb-f15a691192e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:17.971778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c59e3-9746-4a35-81eb-f15a691192e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:17.972194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c59e3-9746-4a35-81eb-f15a691192e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:18.039238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c44c59e3-9746-4a35-81eb-f15a691192e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:18.047564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c44c59e3-9746-4a35-81eb-f15a691192e8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088491 Aug 24 06:35:18.048129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 998/2003] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:17 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:18.156902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9a165798-249e-4969-b3a5-8bddb8a398c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:18.157623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9a165798-249e-4969-b3a5-8bddb8a398c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:18.165237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a165798-249e-4969-b3a5-8bddb8a398c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:18.165773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a165798-249e-4969-b3a5-8bddb8a398c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:18.166248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a165798-249e-4969-b3a5-8bddb8a398c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:18.167030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a165798-249e-4969-b3a5-8bddb8a398c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:18.167483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a165798-249e-4969-b3a5-8bddb8a398c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:18.167908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9a165798-249e-4969-b3a5-8bddb8a398c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:18.316686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9a165798-249e-4969-b3a5-8bddb8a398c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:18.325317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:18.325937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:18.331221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9a165798-249e-4969-b3a5-8bddb8a398c1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.178007 Aug 24 06:35:18.332140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:18.332341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1006/2004] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:18 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:18.332751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:18.333918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:18.334640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:18.335285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:18.335841 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:18.478669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:18.487966 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:18.490015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:18.491202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-61f3b182-2d1e-4525-aa39-15d5fb181b83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.170508 Aug 24 06:35:18.491755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 999/2005] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:19.069251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9231d11d-64e7-41d3-98db-6a24ed37b8c8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:19.069804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9231d11d-64e7-41d3-98db-6a24ed37b8c8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:19.075904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9231d11d-64e7-41d3-98db-6a24ed37b8c8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:19.076383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9231d11d-64e7-41d3-98db-6a24ed37b8c8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:19.076847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9231d11d-64e7-41d3-98db-6a24ed37b8c8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:19.077601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9231d11d-64e7-41d3-98db-6a24ed37b8c8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:19.078050 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9231d11d-64e7-41d3-98db-6a24ed37b8c8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:19.078472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9231d11d-64e7-41d3-98db-6a24ed37b8c8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:19.146037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9231d11d-64e7-41d3-98db-6a24ed37b8c8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:19.154462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9231d11d-64e7-41d3-98db-6a24ed37b8c8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089127 Aug 24 06:35:19.155043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1007/2006] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:19.363479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6bd7caae-c99c-4c61-8e0d-a57dd999cdb5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:19.364080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6bd7caae-c99c-4c61-8e0d-a57dd999cdb5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:19.371132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd7caae-c99c-4c61-8e0d-a57dd999cdb5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:19.371615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd7caae-c99c-4c61-8e0d-a57dd999cdb5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:19.372050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd7caae-c99c-4c61-8e0d-a57dd999cdb5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:19.372812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd7caae-c99c-4c61-8e0d-a57dd999cdb5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:19.373267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd7caae-c99c-4c61-8e0d-a57dd999cdb5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:19.373689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6bd7caae-c99c-4c61-8e0d-a57dd999cdb5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:19.480253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:35:19.480591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:35:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 (ip 10.222.0.62) !!! Aug 24 06:35:19.505802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6bd7caae-c99c-4c61-8e0d-a57dd999cdb5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:19.507980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:19.514789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:19.515377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6bd7caae-c99c-4c61-8e0d-a57dd999cdb5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155482 Aug 24 06:35:19.515522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:19.515622 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1000/2007] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:19 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:19.521642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:19.522119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:19.534197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:19.534197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:19.534197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:19.534197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:19.671136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:19.680113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:19.681646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:19.682853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f527a571-4fb3-420d-bcd3-b106d53a1222 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.171921 Aug 24 06:35:19.683440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1008/2008] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:20.176138 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-643f115c-6352-4f1b-ae95-25b6f063c416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:20.176814 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-643f115c-6352-4f1b-ae95-25b6f063c416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:20.183668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-643f115c-6352-4f1b-ae95-25b6f063c416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:20.184416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-643f115c-6352-4f1b-ae95-25b6f063c416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:20.184882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-643f115c-6352-4f1b-ae95-25b6f063c416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:20.185601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-643f115c-6352-4f1b-ae95-25b6f063c416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:20.186058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-643f115c-6352-4f1b-ae95-25b6f063c416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:20.186486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-643f115c-6352-4f1b-ae95-25b6f063c416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:20.253760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-643f115c-6352-4f1b-ae95-25b6f063c416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:20.262783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-643f115c-6352-4f1b-ae95-25b6f063c416 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.090535 Aug 24 06:35:20.263281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1001/2009] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:20.537029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-af68471a-e731-4675-ad46-f6e77d1eeab6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:20.537624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-af68471a-e731-4675-ad46-f6e77d1eeab6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:20.543597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af68471a-e731-4675-ad46-f6e77d1eeab6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:20.544079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af68471a-e731-4675-ad46-f6e77d1eeab6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:20.544536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af68471a-e731-4675-ad46-f6e77d1eeab6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:20.545246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af68471a-e731-4675-ad46-f6e77d1eeab6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:20.545697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af68471a-e731-4675-ad46-f6e77d1eeab6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:20.546120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-af68471a-e731-4675-ad46-f6e77d1eeab6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:20.677697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-af68471a-e731-4675-ad46-f6e77d1eeab6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:20.686470 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-af68471a-e731-4675-ad46-f6e77d1eeab6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154018 Aug 24 06:35:20.687055 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1009/2010] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:20 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:20.709812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:20.710559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:20.717143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:20.717651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:20.718089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:20.718783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:20.719230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:20.719650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:20.853502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:20.862155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:20.863648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:20.865361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-21f3391a-f65f-44d9-85e4-66a5ea7a1532 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159876 Aug 24 06:35:20.865910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1002/2011] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:20 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:21.284424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-09fd37d0-5255-42c0-aadd-736082353727 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:21.285052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-09fd37d0-5255-42c0-aadd-736082353727 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:21.291689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fd37d0-5255-42c0-aadd-736082353727 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:21.292159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fd37d0-5255-42c0-aadd-736082353727 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:21.292616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fd37d0-5255-42c0-aadd-736082353727 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:21.293305 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fd37d0-5255-42c0-aadd-736082353727 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:21.293745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fd37d0-5255-42c0-aadd-736082353727 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:21.294159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-09fd37d0-5255-42c0-aadd-736082353727 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:21.359763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-09fd37d0-5255-42c0-aadd-736082353727 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:21.369187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-09fd37d0-5255-42c0-aadd-736082353727 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088771 Aug 24 06:35:21.369764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1010/2012] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:21 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:21.711522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a5db9794-51e7-47ef-8a8e-2a57935d8eb1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:21.712739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a5db9794-51e7-47ef-8a8e-2a57935d8eb1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:21.720540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5db9794-51e7-47ef-8a8e-2a57935d8eb1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:21.721262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5db9794-51e7-47ef-8a8e-2a57935d8eb1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:21.721812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5db9794-51e7-47ef-8a8e-2a57935d8eb1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:21.722739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5db9794-51e7-47ef-8a8e-2a57935d8eb1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:21.723392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5db9794-51e7-47ef-8a8e-2a57935d8eb1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:21.724551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5db9794-51e7-47ef-8a8e-2a57935d8eb1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:21.856575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a5db9794-51e7-47ef-8a8e-2a57935d8eb1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:21.864972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a5db9794-51e7-47ef-8a8e-2a57935d8eb1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.160177 Aug 24 06:35:21.865550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1003/2013] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:21 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:21.889072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:21.889682 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:21.896847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:21.897327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:21.897752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:21.898444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:21.898885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:21.899303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:22.033922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:22.043551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:22.045066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:22.046234 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cffca6f0-c842-40f2-9fb1-dde55b65ac6e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161218 Aug 24 06:35:22.046797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1011/2014] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:22.390595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-af2d7645-4dc2-433f-a37d-6e5c23ca37ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:22.391126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-af2d7645-4dc2-433f-a37d-6e5c23ca37ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:22.397821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af2d7645-4dc2-433f-a37d-6e5c23ca37ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:22.398339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af2d7645-4dc2-433f-a37d-6e5c23ca37ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:22.398774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af2d7645-4dc2-433f-a37d-6e5c23ca37ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:22.399491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af2d7645-4dc2-433f-a37d-6e5c23ca37ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:22.399927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af2d7645-4dc2-433f-a37d-6e5c23ca37ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:22.400346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af2d7645-4dc2-433f-a37d-6e5c23ca37ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:22.465173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-af2d7645-4dc2-433f-a37d-6e5c23ca37ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:22.474273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-af2d7645-4dc2-433f-a37d-6e5c23ca37ca tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087107 Aug 24 06:35:22.474895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1004/2015] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:22.887004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9b1f4839-e94e-4e10-822f-6622d7755f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:22.887618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9b1f4839-e94e-4e10-822f-6622d7755f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:22.894280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b1f4839-e94e-4e10-822f-6622d7755f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:22.894954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b1f4839-e94e-4e10-822f-6622d7755f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:22.895176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b1f4839-e94e-4e10-822f-6622d7755f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:22.895958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b1f4839-e94e-4e10-822f-6622d7755f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:22.896407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b1f4839-e94e-4e10-822f-6622d7755f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:22.896857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b1f4839-e94e-4e10-822f-6622d7755f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:22.912277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:23.030166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9b1f4839-e94e-4e10-822f-6622d7755f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:23.038618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9b1f4839-e94e-4e10-822f-6622d7755f27 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155625 Aug 24 06:35:23.039203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1012/2016] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:22 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:23.070882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:23.071488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:23.078128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:23.078607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:23.079030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:23.079723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:23.080164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:23.080608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:23.215778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:23.224676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:23.226161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:23.227365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d436c2bd-4eea-4344-9f4a-6aa3d032b6d0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161252 Aug 24 06:35:23.227865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1005/2017] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:23.496064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-60021cd0-53fc-4db5-b8aa-382afb1a7cc3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:23.496700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-60021cd0-53fc-4db5-b8aa-382afb1a7cc3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:23.498814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=80 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:23.503828 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60021cd0-53fc-4db5-b8aa-382afb1a7cc3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:23.504313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60021cd0-53fc-4db5-b8aa-382afb1a7cc3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:23.504770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60021cd0-53fc-4db5-b8aa-382afb1a7cc3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:23.505495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60021cd0-53fc-4db5-b8aa-382afb1a7cc3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:23.505944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60021cd0-53fc-4db5-b8aa-382afb1a7cc3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:23.506367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60021cd0-53fc-4db5-b8aa-382afb1a7cc3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:23.577899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-60021cd0-53fc-4db5-b8aa-382afb1a7cc3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:23.586786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-60021cd0-53fc-4db5-b8aa-382afb1a7cc3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.094774 Aug 24 06:35:23.587410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1013/2018] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:23 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:24.060744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a63a2599-a312-4fc1-b5d3-b6d2aa9883b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:24.061352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a63a2599-a312-4fc1-b5d3-b6d2aa9883b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:24.068101 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63a2599-a312-4fc1-b5d3-b6d2aa9883b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:24.068607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63a2599-a312-4fc1-b5d3-b6d2aa9883b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:24.069039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63a2599-a312-4fc1-b5d3-b6d2aa9883b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:24.069728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63a2599-a312-4fc1-b5d3-b6d2aa9883b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:24.070174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63a2599-a312-4fc1-b5d3-b6d2aa9883b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:24.070590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a63a2599-a312-4fc1-b5d3-b6d2aa9883b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:24.201647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a63a2599-a312-4fc1-b5d3-b6d2aa9883b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:24.210135 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a63a2599-a312-4fc1-b5d3-b6d2aa9883b9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153510 Aug 24 06:35:24.210713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1006/2019] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:24 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:24.267306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:24.267905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:24.275084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:24.275566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:24.276001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:24.276730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:24.277184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:24.277608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:24.412099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:24.421024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:24.422517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:24.423700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d8465ffc-a21e-427d-9848-f0bc7e8d08b4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.160407 Aug 24 06:35:24.424363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1014/2020] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:24.610546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a5d2b8e6-ee5f-429b-8749-f906be2eab33 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:24.611042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a5d2b8e6-ee5f-429b-8749-f906be2eab33 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:24.617704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5d2b8e6-ee5f-429b-8749-f906be2eab33 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:24.618177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5d2b8e6-ee5f-429b-8749-f906be2eab33 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:24.618612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5d2b8e6-ee5f-429b-8749-f906be2eab33 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:24.619307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5d2b8e6-ee5f-429b-8749-f906be2eab33 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:24.619763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5d2b8e6-ee5f-429b-8749-f906be2eab33 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:24.620191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5d2b8e6-ee5f-429b-8749-f906be2eab33 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:24.685074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a5d2b8e6-ee5f-429b-8749-f906be2eab33 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:24.694047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a5d2b8e6-ee5f-429b-8749-f906be2eab33 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089469 Aug 24 06:35:24.694627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1007/2021] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:25.231915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-efbfa439-f08e-4bec-8c15-dde0ce341c83 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:25.232547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-efbfa439-f08e-4bec-8c15-dde0ce341c83 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:25.238961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efbfa439-f08e-4bec-8c15-dde0ce341c83 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:25.239449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efbfa439-f08e-4bec-8c15-dde0ce341c83 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:25.239880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efbfa439-f08e-4bec-8c15-dde0ce341c83 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:25.240616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efbfa439-f08e-4bec-8c15-dde0ce341c83 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:25.241068 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efbfa439-f08e-4bec-8c15-dde0ce341c83 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:25.241490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-efbfa439-f08e-4bec-8c15-dde0ce341c83 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:25.375157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-efbfa439-f08e-4bec-8c15-dde0ce341c83 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:25.383646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-efbfa439-f08e-4bec-8c15-dde0ce341c83 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155632 Aug 24 06:35:25.384229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1015/2022] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:25 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:25.447562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:25.448137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:25.454575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:25.455058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:25.455491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:25.456187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:25.456681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:25.457103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:25.601164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:25.610130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:25.611650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:25.612872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a67d8cf8-8951-4632-8e63-4b5608f4edc6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.169292 Aug 24 06:35:25.613433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1008/2023] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:25.717540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-666f58db-1219-48ff-8369-03cdbf4f5599 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:25.718184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-666f58db-1219-48ff-8369-03cdbf4f5599 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:25.724518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-666f58db-1219-48ff-8369-03cdbf4f5599 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:25.725018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-666f58db-1219-48ff-8369-03cdbf4f5599 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:25.725449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-666f58db-1219-48ff-8369-03cdbf4f5599 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:25.726174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-666f58db-1219-48ff-8369-03cdbf4f5599 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:25.726644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-666f58db-1219-48ff-8369-03cdbf4f5599 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:25.727060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-666f58db-1219-48ff-8369-03cdbf4f5599 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:25.801341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-666f58db-1219-48ff-8369-03cdbf4f5599 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:25.810198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-666f58db-1219-48ff-8369-03cdbf4f5599 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.096501 Aug 24 06:35:25.810792 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1016/2024] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:25 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:26.405461 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-26aaeabe-e703-4ded-bffb-535cede83baf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:26.406083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-26aaeabe-e703-4ded-bffb-535cede83baf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:26.413095 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26aaeabe-e703-4ded-bffb-535cede83baf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:26.413586 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26aaeabe-e703-4ded-bffb-535cede83baf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:26.414027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26aaeabe-e703-4ded-bffb-535cede83baf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:26.414739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26aaeabe-e703-4ded-bffb-535cede83baf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:26.415198 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26aaeabe-e703-4ded-bffb-535cede83baf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:26.415626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-26aaeabe-e703-4ded-bffb-535cede83baf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:26.549727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-26aaeabe-e703-4ded-bffb-535cede83baf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:26.559426 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-26aaeabe-e703-4ded-bffb-535cede83baf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157590 Aug 24 06:35:26.560012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1009/2025] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:26 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:26.636645 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:26.637348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:26.643788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:26.644262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:26.644718 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:26.645907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:26.646352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:26.646765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:26.783177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:26.792808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:26.794370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:26.795581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-42e2abff-f9e7-47b0-b82b-647a5cc7b9ea tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163517 Aug 24 06:35:26.796152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1017/2026] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:26.831367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c55663bf-48b4-47c9-88e7-ec29eb00fa76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:26.831985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c55663bf-48b4-47c9-88e7-ec29eb00fa76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:26.838655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c55663bf-48b4-47c9-88e7-ec29eb00fa76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:26.839142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c55663bf-48b4-47c9-88e7-ec29eb00fa76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:26.839578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c55663bf-48b4-47c9-88e7-ec29eb00fa76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:26.840280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c55663bf-48b4-47c9-88e7-ec29eb00fa76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:26.840767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c55663bf-48b4-47c9-88e7-ec29eb00fa76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:26.841189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c55663bf-48b4-47c9-88e7-ec29eb00fa76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:26.903156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c55663bf-48b4-47c9-88e7-ec29eb00fa76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:26.912060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c55663bf-48b4-47c9-88e7-ec29eb00fa76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084623 Aug 24 06:35:26.912666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1010/2027] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:27.580942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2f664b9b-7874-4048-afef-dc3cdc50dcf2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:27.581557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2f664b9b-7874-4048-afef-dc3cdc50dcf2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:27.587801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f664b9b-7874-4048-afef-dc3cdc50dcf2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:27.588288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f664b9b-7874-4048-afef-dc3cdc50dcf2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:27.588756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f664b9b-7874-4048-afef-dc3cdc50dcf2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:27.589465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f664b9b-7874-4048-afef-dc3cdc50dcf2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:27.589914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f664b9b-7874-4048-afef-dc3cdc50dcf2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:27.590338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2f664b9b-7874-4048-afef-dc3cdc50dcf2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:27.728385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2f664b9b-7874-4048-afef-dc3cdc50dcf2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:27.742561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2f664b9b-7874-4048-afef-dc3cdc50dcf2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.165168 Aug 24 06:35:27.743326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1018/2028] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:27 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:27.819243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:27.819845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:27.826627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:27.827117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:27.827556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:27.828264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:27.828743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:27.829168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:27.935389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-db9fef1e-6903-4583-8fe1-c9a10397eeaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:27.936186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-db9fef1e-6903-4583-8fe1-c9a10397eeaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:27.944620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db9fef1e-6903-4583-8fe1-c9a10397eeaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:27.945275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db9fef1e-6903-4583-8fe1-c9a10397eeaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:27.945866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db9fef1e-6903-4583-8fe1-c9a10397eeaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:27.946873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db9fef1e-6903-4583-8fe1-c9a10397eeaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:27.947480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db9fef1e-6903-4583-8fe1-c9a10397eeaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:27.948091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-db9fef1e-6903-4583-8fe1-c9a10397eeaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:27.980129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:27.996188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:27.997667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:27.999261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-994c782b-f1e6-4e7d-8340-d6a5cd67c9b8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.184000 Aug 24 06:35:28.000360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1011/2029] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:28.045123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-db9fef1e-6903-4583-8fe1-c9a10397eeaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:28.054316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-db9fef1e-6903-4583-8fe1-c9a10397eeaf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.124249 Aug 24 06:35:28.054906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1019/2030] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:28.774431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d4e8ae5b-a64c-4890-b9e4-eb0fc1746931 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:28.775044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d4e8ae5b-a64c-4890-b9e4-eb0fc1746931 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:28.781254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4e8ae5b-a64c-4890-b9e4-eb0fc1746931 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:28.781740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4e8ae5b-a64c-4890-b9e4-eb0fc1746931 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:28.782175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4e8ae5b-a64c-4890-b9e4-eb0fc1746931 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:28.782882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4e8ae5b-a64c-4890-b9e4-eb0fc1746931 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:28.783338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4e8ae5b-a64c-4890-b9e4-eb0fc1746931 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:28.783761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4e8ae5b-a64c-4890-b9e4-eb0fc1746931 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:28.919441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d4e8ae5b-a64c-4890-b9e4-eb0fc1746931 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:28.928867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d4e8ae5b-a64c-4890-b9e4-eb0fc1746931 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.158828 Aug 24 06:35:28.929450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1012/2031] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:28 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:29.026091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:29.026771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:29.033087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:29.033561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:29.033989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:29.034680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:29.035125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:29.035646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:29.079334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2b65bc94-776b-4088-9476-78517aef3e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:29.080478 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2b65bc94-776b-4088-9476-78517aef3e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:29.091139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b65bc94-776b-4088-9476-78517aef3e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:29.092010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b65bc94-776b-4088-9476-78517aef3e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:29.092822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b65bc94-776b-4088-9476-78517aef3e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:29.094093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b65bc94-776b-4088-9476-78517aef3e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:29.094935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b65bc94-776b-4088-9476-78517aef3e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:29.095718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b65bc94-776b-4088-9476-78517aef3e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:29.171053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2b65bc94-776b-4088-9476-78517aef3e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:29.182032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2b65bc94-776b-4088-9476-78517aef3e5d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.109252 Aug 24 06:35:29.184696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1013/2032] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:29.193403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:29.202936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:29.204456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:29.205660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ab91dcf8-9f38-47b8-99bb-d8f2ee0b8275 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.183641 Aug 24 06:35:29.206225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1020/2033] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:29 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:29.952440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e1aaf605-1327-4d44-9ad8-66ac6b51c84b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:29.953107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e1aaf605-1327-4d44-9ad8-66ac6b51c84b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:29.959905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1aaf605-1327-4d44-9ad8-66ac6b51c84b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:29.960299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1aaf605-1327-4d44-9ad8-66ac6b51c84b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:29.960767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1aaf605-1327-4d44-9ad8-66ac6b51c84b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:29.961473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1aaf605-1327-4d44-9ad8-66ac6b51c84b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:29.961938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1aaf605-1327-4d44-9ad8-66ac6b51c84b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:29.962359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1aaf605-1327-4d44-9ad8-66ac6b51c84b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:30.103683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e1aaf605-1327-4d44-9ad8-66ac6b51c84b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:30.112816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e1aaf605-1327-4d44-9ad8-66ac6b51c84b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164092 Aug 24 06:35:30.113404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1014/2034] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:29 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:30.203192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-79199931-6186-4084-b80a-158220a70712 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:30.204004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-79199931-6186-4084-b80a-158220a70712 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:30.210833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79199931-6186-4084-b80a-158220a70712 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:30.211244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79199931-6186-4084-b80a-158220a70712 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:30.211774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79199931-6186-4084-b80a-158220a70712 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:30.212449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79199931-6186-4084-b80a-158220a70712 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:30.212964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79199931-6186-4084-b80a-158220a70712 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:30.213391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-79199931-6186-4084-b80a-158220a70712 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:30.230037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:30.230660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:30.236981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:30.237466 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:30.237899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:30.238605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:30.239634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:30.240063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:30.278669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-79199931-6186-4084-b80a-158220a70712 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:30.288280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-79199931-6186-4084-b80a-158220a70712 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089258 Aug 24 06:35:30.288918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1021/2035] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:30.401386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:30.410269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:30.412668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:30.413562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9a567be6-29ac-474f-b41a-b971a03f711c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.187611 Aug 24 06:35:30.414124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1015/2036] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:31.135707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-abfa9877-4b03-47c4-b868-c9cc800d0fc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:31.136223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-abfa9877-4b03-47c4-b868-c9cc800d0fc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:31.142582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-abfa9877-4b03-47c4-b868-c9cc800d0fc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:31.143074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-abfa9877-4b03-47c4-b868-c9cc800d0fc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:31.143662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-abfa9877-4b03-47c4-b868-c9cc800d0fc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:31.144375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-abfa9877-4b03-47c4-b868-c9cc800d0fc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:31.145356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-abfa9877-4b03-47c4-b868-c9cc800d0fc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:31.145783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-abfa9877-4b03-47c4-b868-c9cc800d0fc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:31.297960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-abfa9877-4b03-47c4-b868-c9cc800d0fc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:31.306854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-abfa9877-4b03-47c4-b868-c9cc800d0fc2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.175049 Aug 24 06:35:31.307443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1022/2037] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:31 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:31.310085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5b1d6330-596a-442f-8f34-606f70f43501 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:31.310699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5b1d6330-596a-442f-8f34-606f70f43501 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:31.317568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b1d6330-596a-442f-8f34-606f70f43501 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:31.318056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b1d6330-596a-442f-8f34-606f70f43501 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:31.318489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b1d6330-596a-442f-8f34-606f70f43501 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:31.319196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b1d6330-596a-442f-8f34-606f70f43501 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:31.319656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b1d6330-596a-442f-8f34-606f70f43501 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:31.320071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b1d6330-596a-442f-8f34-606f70f43501 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:31.382736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5b1d6330-596a-442f-8f34-606f70f43501 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:31.390946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5b1d6330-596a-442f-8f34-606f70f43501 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084977 Aug 24 06:35:31.391449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1016/2038] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:31 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:31.437662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:31.438299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:31.444398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:31.444922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:31.445355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:31.446052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:31.446505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:31.446931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:31.585675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:31.594562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:31.596072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:31.597311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-185f21a3-27fd-4fd6-8bf5-13eab7726ae5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163990 Aug 24 06:35:31.597888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1023/2039] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:32.328597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-18255a3b-9c72-4245-a50e-a10a8ecf577d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:32.329249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-18255a3b-9c72-4245-a50e-a10a8ecf577d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:32.336032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18255a3b-9c72-4245-a50e-a10a8ecf577d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:32.336546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18255a3b-9c72-4245-a50e-a10a8ecf577d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:32.336990 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18255a3b-9c72-4245-a50e-a10a8ecf577d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:32.337701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18255a3b-9c72-4245-a50e-a10a8ecf577d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:32.338159 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18255a3b-9c72-4245-a50e-a10a8ecf577d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:32.338586 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-18255a3b-9c72-4245-a50e-a10a8ecf577d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:32.354915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:32.412466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-341804eb-8493-4955-9115-b68dc85a2a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:32.413156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-341804eb-8493-4955-9115-b68dc85a2a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:32.419601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-341804eb-8493-4955-9115-b68dc85a2a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:32.420091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-341804eb-8493-4955-9115-b68dc85a2a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:32.420557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-341804eb-8493-4955-9115-b68dc85a2a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:32.421326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-341804eb-8493-4955-9115-b68dc85a2a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:32.421781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-341804eb-8493-4955-9115-b68dc85a2a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:32.422210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-341804eb-8493-4955-9115-b68dc85a2a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:32.469890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-18255a3b-9c72-4245-a50e-a10a8ecf577d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:32.478715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-18255a3b-9c72-4245-a50e-a10a8ecf577d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154128 Aug 24 06:35:32.479288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1017/2040] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:32 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:32.487101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-341804eb-8493-4955-9115-b68dc85a2a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:32.496694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-341804eb-8493-4955-9115-b68dc85a2a26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088540 Aug 24 06:35:32.497295 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1024/2041] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:32.620310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:32.620869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:32.626918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:32.627399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:32.627828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:32.628545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:32.629004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:32.629424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:32.766728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:32.776837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:32.778400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:32.779651 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4f1227be-912c-44e3-b527-b8b552ef5b9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163489 Aug 24 06:35:32.780217 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1018/2042] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:33.500568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6baa088a-519f-42ba-97a3-05f8fe3ca3cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:33.501151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6baa088a-519f-42ba-97a3-05f8fe3ca3cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:33.507600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6baa088a-519f-42ba-97a3-05f8fe3ca3cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:33.508072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6baa088a-519f-42ba-97a3-05f8fe3ca3cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:33.508513 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6baa088a-519f-42ba-97a3-05f8fe3ca3cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:33.509214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6baa088a-519f-42ba-97a3-05f8fe3ca3cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:33.509662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6baa088a-519f-42ba-97a3-05f8fe3ca3cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:33.510072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6baa088a-519f-42ba-97a3-05f8fe3ca3cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:33.518875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dbfb7bf5-837c-4891-a998-63a159f79158 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:33.520279 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dbfb7bf5-837c-4891-a998-63a159f79158 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:33.527003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbfb7bf5-837c-4891-a998-63a159f79158 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:33.527485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbfb7bf5-837c-4891-a998-63a159f79158 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:33.527917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbfb7bf5-837c-4891-a998-63a159f79158 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:33.528670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbfb7bf5-837c-4891-a998-63a159f79158 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:33.529130 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbfb7bf5-837c-4891-a998-63a159f79158 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:33.529545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dbfb7bf5-837c-4891-a998-63a159f79158 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:33.596152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dbfb7bf5-837c-4891-a998-63a159f79158 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:33.605351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dbfb7bf5-837c-4891-a998-63a159f79158 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.091326 Aug 24 06:35:33.606066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1019/2043] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:33.665975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6baa088a-519f-42ba-97a3-05f8fe3ca3cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:33.674413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6baa088a-519f-42ba-97a3-05f8fe3ca3cb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.177807 Aug 24 06:35:33.674998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1025/2044] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:33 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:33.804589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:33.805093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:33.811512 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:33.811998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:33.812432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:33.813188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:33.813641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:33.814059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:33.946259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:33.955303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:33.956864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:33.958711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f5f329ae-722c-4b52-83e0-44e30eec2f13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159050 Aug 24 06:35:33.959264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1020/2045] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:34.638039 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-51ea603d-15c0-49cf-a014-5141eb9fd077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:34.638578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-51ea603d-15c0-49cf-a014-5141eb9fd077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:34.645729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ea603d-15c0-49cf-a014-5141eb9fd077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:34.646203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ea603d-15c0-49cf-a014-5141eb9fd077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:34.646635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ea603d-15c0-49cf-a014-5141eb9fd077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:34.647331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ea603d-15c0-49cf-a014-5141eb9fd077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:34.647786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ea603d-15c0-49cf-a014-5141eb9fd077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:34.648201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-51ea603d-15c0-49cf-a014-5141eb9fd077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:34.696429 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f6e48d89-62c7-48bb-9f39-42bd320ee82e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:34.697183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f6e48d89-62c7-48bb-9f39-42bd320ee82e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:34.704783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e48d89-62c7-48bb-9f39-42bd320ee82e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:34.705273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e48d89-62c7-48bb-9f39-42bd320ee82e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:34.705708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e48d89-62c7-48bb-9f39-42bd320ee82e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:34.706508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e48d89-62c7-48bb-9f39-42bd320ee82e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:34.706910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e48d89-62c7-48bb-9f39-42bd320ee82e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:34.707928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f6e48d89-62c7-48bb-9f39-42bd320ee82e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:34.712909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-51ea603d-15c0-49cf-a014-5141eb9fd077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:34.721618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-51ea603d-15c0-49cf-a014-5141eb9fd077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087473 Aug 24 06:35:34.722206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1026/2046] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:34 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:34.843640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f6e48d89-62c7-48bb-9f39-42bd320ee82e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:34.852736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f6e48d89-62c7-48bb-9f39-42bd320ee82e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.160069 Aug 24 06:35:34.853315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1021/2047] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:34 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:34.982127 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:34.983338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:34.992790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:34.993282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:34.993723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:34.994431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:34.994885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:34.995311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:35.125754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:35.135088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:35.136602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:35.137754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cda5bfac-bc8d-4fe4-b117-21e3ed940919 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.160173 Aug 24 06:35:35.138306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1027/2048] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:34 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:35.742861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-aea62f64-46d0-4b67-a407-1b0ca3dbd7bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:35.743491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-aea62f64-46d0-4b67-a407-1b0ca3dbd7bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:35.749930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aea62f64-46d0-4b67-a407-1b0ca3dbd7bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:35.750401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aea62f64-46d0-4b67-a407-1b0ca3dbd7bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:35.750822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aea62f64-46d0-4b67-a407-1b0ca3dbd7bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:35.751506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aea62f64-46d0-4b67-a407-1b0ca3dbd7bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:35.751953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aea62f64-46d0-4b67-a407-1b0ca3dbd7bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:35.752367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-aea62f64-46d0-4b67-a407-1b0ca3dbd7bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:35.815393 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-aea62f64-46d0-4b67-a407-1b0ca3dbd7bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:35.824139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-aea62f64-46d0-4b67-a407-1b0ca3dbd7bc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085089 Aug 24 06:35:35.824750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1022/2049] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:35.874446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fe026147-1cfe-407d-9c2e-edab48ad1af5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:35.875089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fe026147-1cfe-407d-9c2e-edab48ad1af5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:35.882140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fe026147-1cfe-407d-9c2e-edab48ad1af5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:35.882627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fe026147-1cfe-407d-9c2e-edab48ad1af5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:35.883066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fe026147-1cfe-407d-9c2e-edab48ad1af5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:35.883791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fe026147-1cfe-407d-9c2e-edab48ad1af5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:35.884248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fe026147-1cfe-407d-9c2e-edab48ad1af5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:35.884714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fe026147-1cfe-407d-9c2e-edab48ad1af5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:36.021271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fe026147-1cfe-407d-9c2e-edab48ad1af5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:36.029597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fe026147-1cfe-407d-9c2e-edab48ad1af5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.159166 Aug 24 06:35:36.030171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1028/2050] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:35 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:36.160480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:36.161113 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:36.167260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:36.167748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:36.168182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:36.169045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:36.169500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:36.169922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:36.297305 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:35:36.297544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:35:36.300645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:36.310233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:36.313261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:36.313261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fcad74b6-5a4d-4d73-8dab-e58f3d867725 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156369 Aug 24 06:35:36.313517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1023/2051] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:36.845599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-78b46743-1b93-440b-83e8-34f4a780df45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:36.846213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-78b46743-1b93-440b-83e8-34f4a780df45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:36.852887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78b46743-1b93-440b-83e8-34f4a780df45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:36.853368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78b46743-1b93-440b-83e8-34f4a780df45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:36.853797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78b46743-1b93-440b-83e8-34f4a780df45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:36.854487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78b46743-1b93-440b-83e8-34f4a780df45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:36.854930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78b46743-1b93-440b-83e8-34f4a780df45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:36.855343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78b46743-1b93-440b-83e8-34f4a780df45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:36.858013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:36.918362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-78b46743-1b93-440b-83e8-34f4a780df45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:36.927345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-78b46743-1b93-440b-83e8-34f4a780df45 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085578 Aug 24 06:35:36.927915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1029/2052] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:36 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:37.052057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bb24ef06-2ed2-4dee-89dd-07354d4c20a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:37.052622 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bb24ef06-2ed2-4dee-89dd-07354d4c20a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:37.059523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb24ef06-2ed2-4dee-89dd-07354d4c20a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:37.060003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb24ef06-2ed2-4dee-89dd-07354d4c20a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:37.060430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb24ef06-2ed2-4dee-89dd-07354d4c20a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:37.061153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb24ef06-2ed2-4dee-89dd-07354d4c20a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:37.061608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb24ef06-2ed2-4dee-89dd-07354d4c20a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:37.062028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bb24ef06-2ed2-4dee-89dd-07354d4c20a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:37.190091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bb24ef06-2ed2-4dee-89dd-07354d4c20a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:37.198505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bb24ef06-2ed2-4dee-89dd-07354d4c20a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151059 Aug 24 06:35:37.199078 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1024/2053] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:37 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:37.337674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:37.338302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:37.344646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:37.345174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:37.345615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:37.346312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:37.346797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:37.347221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:37.475694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:37.484525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:37.486038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:37.487197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5d5ae885-a456-4dc3-8039-13c20093460a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.153776 Aug 24 06:35:37.487773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1030/2054] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:37.948742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-455b584c-434b-4123-bbe4-915406d8bd59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:37.949379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-455b584c-434b-4123-bbe4-915406d8bd59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:37.955581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-455b584c-434b-4123-bbe4-915406d8bd59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:37.956064 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-455b584c-434b-4123-bbe4-915406d8bd59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:37.956519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-455b584c-434b-4123-bbe4-915406d8bd59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:37.957235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-455b584c-434b-4123-bbe4-915406d8bd59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:37.957685 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-455b584c-434b-4123-bbe4-915406d8bd59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:37.958142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-455b584c-434b-4123-bbe4-915406d8bd59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:38.024354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-455b584c-434b-4123-bbe4-915406d8bd59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:38.032633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-455b584c-434b-4123-bbe4-915406d8bd59 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087806 Aug 24 06:35:38.033205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1025/2055] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:38.220008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-487e45cc-ec5a-4d9a-8c30-0fab0c3b5365 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:38.220628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-487e45cc-ec5a-4d9a-8c30-0fab0c3b5365 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:38.227213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-487e45cc-ec5a-4d9a-8c30-0fab0c3b5365 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:38.227686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-487e45cc-ec5a-4d9a-8c30-0fab0c3b5365 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:38.228113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-487e45cc-ec5a-4d9a-8c30-0fab0c3b5365 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:38.228831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-487e45cc-ec5a-4d9a-8c30-0fab0c3b5365 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:38.229277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-487e45cc-ec5a-4d9a-8c30-0fab0c3b5365 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:38.229694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-487e45cc-ec5a-4d9a-8c30-0fab0c3b5365 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:38.367144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-487e45cc-ec5a-4d9a-8c30-0fab0c3b5365 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:38.375589 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-487e45cc-ec5a-4d9a-8c30-0fab0c3b5365 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.159398 Aug 24 06:35:38.376188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1031/2056] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:38 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:38.510134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:38.510759 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:38.517168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:38.517640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:38.518064 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:38.518744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:38.519189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:38.519604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:38.650412 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:38.659106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:38.661264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:38.662426 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2d037946-df43-4812-aef7-f0d2ae0a06ff tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156276 Aug 24 06:35:38.662986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1026/2057] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:39.053219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-10324e4c-2ef1-4a8b-978b-1a2d4fb34f29 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:39.053823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-10324e4c-2ef1-4a8b-978b-1a2d4fb34f29 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:39.060059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10324e4c-2ef1-4a8b-978b-1a2d4fb34f29 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:39.060566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10324e4c-2ef1-4a8b-978b-1a2d4fb34f29 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:39.061002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10324e4c-2ef1-4a8b-978b-1a2d4fb34f29 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:39.061681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10324e4c-2ef1-4a8b-978b-1a2d4fb34f29 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:39.062138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10324e4c-2ef1-4a8b-978b-1a2d4fb34f29 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:39.062559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10324e4c-2ef1-4a8b-978b-1a2d4fb34f29 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:39.123290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-10324e4c-2ef1-4a8b-978b-1a2d4fb34f29 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:39.132055 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-10324e4c-2ef1-4a8b-978b-1a2d4fb34f29 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082812 Aug 24 06:35:39.132707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1032/2058] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:39 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:39.397109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4b6d1966-36b5-45c7-8241-9a0f1193eeb8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:39.397662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4b6d1966-36b5-45c7-8241-9a0f1193eeb8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:39.403967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b6d1966-36b5-45c7-8241-9a0f1193eeb8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:39.404452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b6d1966-36b5-45c7-8241-9a0f1193eeb8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:39.404916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b6d1966-36b5-45c7-8241-9a0f1193eeb8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:39.405633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b6d1966-36b5-45c7-8241-9a0f1193eeb8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:39.406068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b6d1966-36b5-45c7-8241-9a0f1193eeb8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:39.406487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b6d1966-36b5-45c7-8241-9a0f1193eeb8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:39.536065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4b6d1966-36b5-45c7-8241-9a0f1193eeb8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:39.544307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4b6d1966-36b5-45c7-8241-9a0f1193eeb8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151739 Aug 24 06:35:39.544900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1027/2059] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:39 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:39.686383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:39.686985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:39.693417 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:39.693891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:39.694316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:39.694997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:39.695438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:39.695853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:39.826826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:39.835543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:39.837082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:39.838233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-649836e6-43d5-4919-8808-c66651b3ee67 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156183 Aug 24 06:35:39.838789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1033/2060] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:40.153412 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-93deff97-a779-4a7b-8c50-0643b034ec1e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:40.153996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-93deff97-a779-4a7b-8c50-0643b034ec1e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:40.159986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93deff97-a779-4a7b-8c50-0643b034ec1e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:40.160480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93deff97-a779-4a7b-8c50-0643b034ec1e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:40.160945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93deff97-a779-4a7b-8c50-0643b034ec1e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:40.161634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93deff97-a779-4a7b-8c50-0643b034ec1e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:40.162115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93deff97-a779-4a7b-8c50-0643b034ec1e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:40.162541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93deff97-a779-4a7b-8c50-0643b034ec1e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:40.223338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-93deff97-a779-4a7b-8c50-0643b034ec1e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:40.231742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-93deff97-a779-4a7b-8c50-0643b034ec1e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082271 Aug 24 06:35:40.232329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1028/2061] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:40 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:40.566011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b1e8974f-68b3-42e1-bd74-a60fac227ae0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:40.567117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b1e8974f-68b3-42e1-bd74-a60fac227ae0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:40.573180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1e8974f-68b3-42e1-bd74-a60fac227ae0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:40.573656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1e8974f-68b3-42e1-bd74-a60fac227ae0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:40.574087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1e8974f-68b3-42e1-bd74-a60fac227ae0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:40.574768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1e8974f-68b3-42e1-bd74-a60fac227ae0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:40.575215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1e8974f-68b3-42e1-bd74-a60fac227ae0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:40.575634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1e8974f-68b3-42e1-bd74-a60fac227ae0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:40.702205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b1e8974f-68b3-42e1-bd74-a60fac227ae0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:40.711056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b1e8974f-68b3-42e1-bd74-a60fac227ae0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.148887 Aug 24 06:35:40.711629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1034/2062] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:40 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:40.862667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:40.863201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:40.869647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:40.870127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:40.870558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:40.871242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:40.871690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:40.872107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:41.220322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:41.229596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:41.231106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:41.232255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-55f1674f-6746-4174-8a06-b9e53306815b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.373639 Aug 24 06:35:41.232854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1029/2063] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:41.257561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6aa09678-3eca-47e6-8b5d-235992d95242 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:41.258202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6aa09678-3eca-47e6-8b5d-235992d95242 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:41.264704 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aa09678-3eca-47e6-8b5d-235992d95242 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:41.265192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aa09678-3eca-47e6-8b5d-235992d95242 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:41.265623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aa09678-3eca-47e6-8b5d-235992d95242 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:41.266317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aa09678-3eca-47e6-8b5d-235992d95242 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:41.266761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aa09678-3eca-47e6-8b5d-235992d95242 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:41.267177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6aa09678-3eca-47e6-8b5d-235992d95242 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:41.329701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6aa09678-3eca-47e6-8b5d-235992d95242 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:41.338467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6aa09678-3eca-47e6-8b5d-235992d95242 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089402 Aug 24 06:35:41.339029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1035/2064] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:41 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:41.732592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a7c4c3a9-298f-41ac-9022-068e9defdc00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:41.733125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a7c4c3a9-298f-41ac-9022-068e9defdc00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:41.739671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7c4c3a9-298f-41ac-9022-068e9defdc00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:41.740165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7c4c3a9-298f-41ac-9022-068e9defdc00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:41.741608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7c4c3a9-298f-41ac-9022-068e9defdc00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:41.741608 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7c4c3a9-298f-41ac-9022-068e9defdc00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:41.741841 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7c4c3a9-298f-41ac-9022-068e9defdc00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:41.742187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a7c4c3a9-298f-41ac-9022-068e9defdc00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:41.874903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a7c4c3a9-298f-41ac-9022-068e9defdc00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:41.883618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a7c4c3a9-298f-41ac-9022-068e9defdc00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154915 Aug 24 06:35:41.884192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1030/2065] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:41 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:42.257973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:42.258527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:42.264892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:42.265366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:42.265790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:42.266464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:42.266907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:42.267318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:42.358749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6183466f-0520-4539-ae8b-4423b478b937 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:42.359428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6183466f-0520-4539-ae8b-4423b478b937 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:42.365989 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6183466f-0520-4539-ae8b-4423b478b937 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:42.366472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6183466f-0520-4539-ae8b-4423b478b937 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:42.366924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6183466f-0520-4539-ae8b-4423b478b937 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:42.367618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6183466f-0520-4539-ae8b-4423b478b937 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:42.368069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6183466f-0520-4539-ae8b-4423b478b937 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:42.368510 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6183466f-0520-4539-ae8b-4423b478b937 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:42.400874 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:42.409780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:42.412071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:42.413278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4c2992bd-fa68-47fe-9f2a-1beae90f097a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159371 Aug 24 06:35:42.413830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1036/2066] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:42.431163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6183466f-0520-4539-ae8b-4423b478b937 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:42.439744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6183466f-0520-4539-ae8b-4423b478b937 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084839 Aug 24 06:35:42.440302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1031/2067] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:42 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:42.904613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-20736ca8-0841-42cb-b7e2-ae708dd3f650 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:42.905251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-20736ca8-0841-42cb-b7e2-ae708dd3f650 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:42.911765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20736ca8-0841-42cb-b7e2-ae708dd3f650 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:42.912237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20736ca8-0841-42cb-b7e2-ae708dd3f650 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:42.912705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20736ca8-0841-42cb-b7e2-ae708dd3f650 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:42.913391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20736ca8-0841-42cb-b7e2-ae708dd3f650 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:42.913840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20736ca8-0841-42cb-b7e2-ae708dd3f650 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:42.914261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-20736ca8-0841-42cb-b7e2-ae708dd3f650 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:43.039932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-20736ca8-0841-42cb-b7e2-ae708dd3f650 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:43.048098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-20736ca8-0841-42cb-b7e2-ae708dd3f650 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.147436 Aug 24 06:35:43.048752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1037/2068] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:42 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:43.436632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:43.437310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:43.444473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:43.444964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:43.445387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:43.446061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:43.446500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:43.446913 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:43.459779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-917b48ea-5bd2-4abe-b019-fef345ccb0f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:43.460393 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-917b48ea-5bd2-4abe-b019-fef345ccb0f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:43.466804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-917b48ea-5bd2-4abe-b019-fef345ccb0f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:43.467287 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-917b48ea-5bd2-4abe-b019-fef345ccb0f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:43.467726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-917b48ea-5bd2-4abe-b019-fef345ccb0f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:43.468424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-917b48ea-5bd2-4abe-b019-fef345ccb0f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:43.468907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-917b48ea-5bd2-4abe-b019-fef345ccb0f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:43.469329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-917b48ea-5bd2-4abe-b019-fef345ccb0f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:43.532828 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-917b48ea-5bd2-4abe-b019-fef345ccb0f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:43.541845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-917b48ea-5bd2-4abe-b019-fef345ccb0f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085835 Aug 24 06:35:43.542608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1038/2069] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:43 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:43.580643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:43.589201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:43.590686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:43.591828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-065a7d32-c500-43b4-972d-e102d2d72411 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159603 Aug 24 06:35:43.592378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1032/2070] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:44.069144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-023337d1-bb18-4a6c-96c7-fc380e94bedd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:44.069698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-023337d1-bb18-4a6c-96c7-fc380e94bedd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:44.075690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-023337d1-bb18-4a6c-96c7-fc380e94bedd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:44.076166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-023337d1-bb18-4a6c-96c7-fc380e94bedd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:44.076629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-023337d1-bb18-4a6c-96c7-fc380e94bedd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:44.077310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-023337d1-bb18-4a6c-96c7-fc380e94bedd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:44.077759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-023337d1-bb18-4a6c-96c7-fc380e94bedd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:44.078177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-023337d1-bb18-4a6c-96c7-fc380e94bedd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:44.208062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-023337d1-bb18-4a6c-96c7-fc380e94bedd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:44.216298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-023337d1-bb18-4a6c-96c7-fc380e94bedd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151094 Aug 24 06:35:44.216905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1039/2071] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:44 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:44.563671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-10de20b1-bdec-45a1-b77e-827731f325ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:44.568714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-10de20b1-bdec-45a1-b77e-827731f325ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:44.571481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10de20b1-bdec-45a1-b77e-827731f325ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:44.571967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10de20b1-bdec-45a1-b77e-827731f325ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:44.572467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10de20b1-bdec-45a1-b77e-827731f325ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:44.573196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10de20b1-bdec-45a1-b77e-827731f325ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:44.573647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10de20b1-bdec-45a1-b77e-827731f325ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:44.574068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-10de20b1-bdec-45a1-b77e-827731f325ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:44.615863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:44.616461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:44.622952 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:44.624233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:44.624233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:44.624605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:44.625066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:44.625472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:44.636315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-10de20b1-bdec-45a1-b77e-827731f325ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:44.646765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-10de20b1-bdec-45a1-b77e-827731f325ea tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086921 Aug 24 06:35:44.657904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1033/2072] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:44 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:44.758810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:44.767586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:44.769043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:44.770240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f490586d-f672-4718-bbdc-f25ec85fe318 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158961 Aug 24 06:35:44.770795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1040/2073] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:35:45.238312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0d6b4847-3a11-452f-b67b-ec9cfc484a42 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:45.238917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0d6b4847-3a11-452f-b67b-ec9cfc484a42 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:45.244841 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d6b4847-3a11-452f-b67b-ec9cfc484a42 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:45.245312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d6b4847-3a11-452f-b67b-ec9cfc484a42 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:45.245747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d6b4847-3a11-452f-b67b-ec9cfc484a42 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:45.246435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d6b4847-3a11-452f-b67b-ec9cfc484a42 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:45.246883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d6b4847-3a11-452f-b67b-ec9cfc484a42 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:45.247322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0d6b4847-3a11-452f-b67b-ec9cfc484a42 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:45.249835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:45.381521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0d6b4847-3a11-452f-b67b-ec9cfc484a42 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:45.390022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0d6b4847-3a11-452f-b67b-ec9cfc484a42 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155770 Aug 24 06:35:45.390567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1034/2074] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:45 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:45.669154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b0323340-b9c5-418b-8c71-2d8f60a6c796 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:45.669760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b0323340-b9c5-418b-8c71-2d8f60a6c796 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:45.676721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0323340-b9c5-418b-8c71-2d8f60a6c796 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:45.677200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0323340-b9c5-418b-8c71-2d8f60a6c796 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:45.677631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0323340-b9c5-418b-8c71-2d8f60a6c796 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:45.678311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0323340-b9c5-418b-8c71-2d8f60a6c796 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:45.678762 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0323340-b9c5-418b-8c71-2d8f60a6c796 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:45.679198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0323340-b9c5-418b-8c71-2d8f60a6c796 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:45.741448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b0323340-b9c5-418b-8c71-2d8f60a6c796 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:45.749817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b0323340-b9c5-418b-8c71-2d8f60a6c796 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084483 Aug 24 06:35:45.750385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1041/2075] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:45 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:45.792953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:45.793556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:45.800296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:45.801357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:45.801782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:45.802457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:45.802899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:45.803313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:45.930077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:45.938925 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:45.940413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:45.941637 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-95dfa064-f67a-45c7-8d13-73ff060b8ac7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.152592 Aug 24 06:35:45.942192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1035/2076] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:46.411938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-83ef3705-11dd-44e9-9d7e-60f10c43a6d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:46.412469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-83ef3705-11dd-44e9-9d7e-60f10c43a6d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:46.418386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83ef3705-11dd-44e9-9d7e-60f10c43a6d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:46.418855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83ef3705-11dd-44e9-9d7e-60f10c43a6d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:46.419279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83ef3705-11dd-44e9-9d7e-60f10c43a6d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:46.419955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83ef3705-11dd-44e9-9d7e-60f10c43a6d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:46.420395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83ef3705-11dd-44e9-9d7e-60f10c43a6d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:46.420948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83ef3705-11dd-44e9-9d7e-60f10c43a6d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:46.552297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-83ef3705-11dd-44e9-9d7e-60f10c43a6d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:46.560916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-83ef3705-11dd-44e9-9d7e-60f10c43a6d5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.152919 Aug 24 06:35:46.561466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1042/2077] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:46 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:46.771804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-04b5f4f5-acb0-4e20-90df-66d92726b77f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:46.772436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-04b5f4f5-acb0-4e20-90df-66d92726b77f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:46.774291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=80 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:46.779059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04b5f4f5-acb0-4e20-90df-66d92726b77f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:46.784448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04b5f4f5-acb0-4e20-90df-66d92726b77f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:46.784448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04b5f4f5-acb0-4e20-90df-66d92726b77f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:46.784448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04b5f4f5-acb0-4e20-90df-66d92726b77f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:46.784448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04b5f4f5-acb0-4e20-90df-66d92726b77f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:46.784873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-04b5f4f5-acb0-4e20-90df-66d92726b77f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:46.842204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-04b5f4f5-acb0-4e20-90df-66d92726b77f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:46.851451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-04b5f4f5-acb0-4e20-90df-66d92726b77f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084181 Aug 24 06:35:46.852033 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1036/2078] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:46.964321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:46.964943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:46.971586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:46.972065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:46.973125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:46.973808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:46.974251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:46.974667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:47.102970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:47.111509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:47.113858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:47.114166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a1ae5927-c65b-492e-ab77-5741333c67ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.153917 Aug 24 06:35:47.114720 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1043/2079] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:47.581416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a374fbc2-5d78-4793-8262-ee670f80a2d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:47.582703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a374fbc2-5d78-4793-8262-ee670f80a2d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:47.588811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a374fbc2-5d78-4793-8262-ee670f80a2d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:47.589287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a374fbc2-5d78-4793-8262-ee670f80a2d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:47.589716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a374fbc2-5d78-4793-8262-ee670f80a2d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:47.590403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a374fbc2-5d78-4793-8262-ee670f80a2d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:47.590854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a374fbc2-5d78-4793-8262-ee670f80a2d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:47.591312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a374fbc2-5d78-4793-8262-ee670f80a2d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:47.723962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a374fbc2-5d78-4793-8262-ee670f80a2d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:47.732212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a374fbc2-5d78-4793-8262-ee670f80a2d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154730 Aug 24 06:35:47.732819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1037/2080] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:47 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:47.873262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ce01908b-4542-4ee6-8a04-e18412a76e7b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:47.873781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ce01908b-4542-4ee6-8a04-e18412a76e7b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:47.880723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce01908b-4542-4ee6-8a04-e18412a76e7b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:47.881197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce01908b-4542-4ee6-8a04-e18412a76e7b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:47.881625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce01908b-4542-4ee6-8a04-e18412a76e7b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:47.882301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce01908b-4542-4ee6-8a04-e18412a76e7b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:47.882747 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce01908b-4542-4ee6-8a04-e18412a76e7b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:47.883159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ce01908b-4542-4ee6-8a04-e18412a76e7b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:47.949422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ce01908b-4542-4ee6-8a04-e18412a76e7b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:47.957568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ce01908b-4542-4ee6-8a04-e18412a76e7b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088309 Aug 24 06:35:47.958160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1044/2081] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:48.136743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:48.137301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:48.143575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:48.144044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:48.144475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:48.145169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:48.145613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:48.146025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:48.272727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:48.282166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:48.283661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:48.285430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9a96d632-b2a3-441f-ad62-68c07dca9bd1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.152066 Aug 24 06:35:48.285993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1038/2082] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:48.753298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b16790e6-3bd1-4122-816a-35e39d3e04e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:48.754562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b16790e6-3bd1-4122-816a-35e39d3e04e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:48.761041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b16790e6-3bd1-4122-816a-35e39d3e04e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:48.761510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b16790e6-3bd1-4122-816a-35e39d3e04e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:48.761936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b16790e6-3bd1-4122-816a-35e39d3e04e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:48.762609 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b16790e6-3bd1-4122-816a-35e39d3e04e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:48.763052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b16790e6-3bd1-4122-816a-35e39d3e04e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:48.763464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b16790e6-3bd1-4122-816a-35e39d3e04e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:48.890483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b16790e6-3bd1-4122-816a-35e39d3e04e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:48.892788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:48.899491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b16790e6-3bd1-4122-816a-35e39d3e04e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150076 Aug 24 06:35:48.900054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1045/2083] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:48 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:48.978892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-37f626ac-f963-4a0c-bb5c-00fe15d05e26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:48.979451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-37f626ac-f963-4a0c-bb5c-00fe15d05e26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:48.985360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f626ac-f963-4a0c-bb5c-00fe15d05e26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:48.985829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f626ac-f963-4a0c-bb5c-00fe15d05e26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:48.986249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f626ac-f963-4a0c-bb5c-00fe15d05e26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:48.986916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f626ac-f963-4a0c-bb5c-00fe15d05e26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:48.987359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f626ac-f963-4a0c-bb5c-00fe15d05e26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:48.987773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f626ac-f963-4a0c-bb5c-00fe15d05e26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:49.048001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-37f626ac-f963-4a0c-bb5c-00fe15d05e26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:49.056722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-37f626ac-f963-4a0c-bb5c-00fe15d05e26 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.081692 Aug 24 06:35:49.057284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1039/2084] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:49.308798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:49.309583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:49.316088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:49.316597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:49.317030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:49.317708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:49.318154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:49.318572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:49.444434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:49.453046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:49.454534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:49.455672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-95af66ae-e973-4a4c-a09f-accbfca7a649 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.151012 Aug 24 06:35:49.456225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1046/2085] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:49.921145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f8211995-480b-4fa9-9e48-f0d248705924 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:49.921755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f8211995-480b-4fa9-9e48-f0d248705924 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:49.928919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f8211995-480b-4fa9-9e48-f0d248705924 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:49.929407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f8211995-480b-4fa9-9e48-f0d248705924 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:49.929838 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f8211995-480b-4fa9-9e48-f0d248705924 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:49.930530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f8211995-480b-4fa9-9e48-f0d248705924 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:49.930983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f8211995-480b-4fa9-9e48-f0d248705924 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:49.931403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f8211995-480b-4fa9-9e48-f0d248705924 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:50.064897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f8211995-480b-4fa9-9e48-f0d248705924 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:50.073761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f8211995-480b-4fa9-9e48-f0d248705924 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.156496 Aug 24 06:35:50.074323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1040/2086] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:49 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:50.077381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0a9cffa6-0d57-4e32-a089-4c1cfe3abc1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:50.077980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0a9cffa6-0d57-4e32-a089-4c1cfe3abc1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:50.084532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a9cffa6-0d57-4e32-a089-4c1cfe3abc1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:50.085009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a9cffa6-0d57-4e32-a089-4c1cfe3abc1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:50.085438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a9cffa6-0d57-4e32-a089-4c1cfe3abc1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:50.086117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a9cffa6-0d57-4e32-a089-4c1cfe3abc1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:50.086614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a9cffa6-0d57-4e32-a089-4c1cfe3abc1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:50.087030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a9cffa6-0d57-4e32-a089-4c1cfe3abc1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:50.151662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0a9cffa6-0d57-4e32-a089-4c1cfe3abc1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:50.159851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0a9cffa6-0d57-4e32-a089-4c1cfe3abc1a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086512 Aug 24 06:35:50.160435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1047/2087] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:50.479291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:50.479890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:50.485885 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:50.486358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:50.486781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:50.487453 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:50.487894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:50.488308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:50.620958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:50.630645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:50.632423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:50.633754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-012d0efd-3c78-4678-99a3-9f5aacc626ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158400 Aug 24 06:35:50.634357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1041/2088] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:51.095315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-76c6a5a1-43b2-46c4-993c-56b2806df790 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:51.095911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-76c6a5a1-43b2-46c4-993c-56b2806df790 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:51.102329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76c6a5a1-43b2-46c4-993c-56b2806df790 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:51.102797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76c6a5a1-43b2-46c4-993c-56b2806df790 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:51.103221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76c6a5a1-43b2-46c4-993c-56b2806df790 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:51.103944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76c6a5a1-43b2-46c4-993c-56b2806df790 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:51.104389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76c6a5a1-43b2-46c4-993c-56b2806df790 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:51.104827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-76c6a5a1-43b2-46c4-993c-56b2806df790 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:51.180506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bdcee88d-6538-453b-a27b-94a7af0767e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:51.181683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bdcee88d-6538-453b-a27b-94a7af0767e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:51.187825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bdcee88d-6538-453b-a27b-94a7af0767e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:51.188303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bdcee88d-6538-453b-a27b-94a7af0767e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:51.188758 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bdcee88d-6538-453b-a27b-94a7af0767e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:51.189524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bdcee88d-6538-453b-a27b-94a7af0767e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:51.189976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bdcee88d-6538-453b-a27b-94a7af0767e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:51.190395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bdcee88d-6538-453b-a27b-94a7af0767e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:51.234072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-76c6a5a1-43b2-46c4-993c-56b2806df790 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:51.242436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-76c6a5a1-43b2-46c4-993c-56b2806df790 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150990 Aug 24 06:35:51.242998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1048/2089] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:51 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:51.252646 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bdcee88d-6538-453b-a27b-94a7af0767e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:51.261315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bdcee88d-6538-453b-a27b-94a7af0767e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084675 Aug 24 06:35:51.261865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1042/2090] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:51.658510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:51.659103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:51.665338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:51.665816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:51.666247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:51.666924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:51.667371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:51.667787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:51.795617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:51.806087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:51.807591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:51.808807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-08fc101a-9cae-40d5-bb7e-f4f1e189d004 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.154257 Aug 24 06:35:51.809619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1049/2091] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:51 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:52.263757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fedb649f-3f4d-4a6f-9ddf-bdaf7ab538c4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:52.264454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fedb649f-3f4d-4a6f-9ddf-bdaf7ab538c4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:52.271383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fedb649f-3f4d-4a6f-9ddf-bdaf7ab538c4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:52.271855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fedb649f-3f4d-4a6f-9ddf-bdaf7ab538c4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:52.272284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fedb649f-3f4d-4a6f-9ddf-bdaf7ab538c4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:52.272975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fedb649f-3f4d-4a6f-9ddf-bdaf7ab538c4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:52.273417 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fedb649f-3f4d-4a6f-9ddf-bdaf7ab538c4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:52.273826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fedb649f-3f4d-4a6f-9ddf-bdaf7ab538c4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:52.282269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e3169838-b192-4f36-ad2b-469b8486a42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:52.282906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e3169838-b192-4f36-ad2b-469b8486a42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:52.289661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3169838-b192-4f36-ad2b-469b8486a42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:52.290263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3169838-b192-4f36-ad2b-469b8486a42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:52.290702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3169838-b192-4f36-ad2b-469b8486a42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:52.291385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3169838-b192-4f36-ad2b-469b8486a42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:52.291841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3169838-b192-4f36-ad2b-469b8486a42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:52.292257 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e3169838-b192-4f36-ad2b-469b8486a42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:52.358589 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e3169838-b192-4f36-ad2b-469b8486a42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:52.367672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e3169838-b192-4f36-ad2b-469b8486a42b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089189 Aug 24 06:35:52.368249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1050/2092] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:52 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:52.405751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fedb649f-3f4d-4a6f-9ddf-bdaf7ab538c4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:52.414485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fedb649f-3f4d-4a6f-9ddf-bdaf7ab538c4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154625 Aug 24 06:35:52.415046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1043/2093] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:52 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:52.831244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:52.831853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:52.838557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:52.839032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:52.839463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:52.840147 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:52.840640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:52.841145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:52.967623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:52.976307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:52.977842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:52.978978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-03bd098b-e120-4b19-bda6-9ad2ebf9c8f3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.151707 Aug 24 06:35:52.979527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1051/2094] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:53.387932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c74144fa-0788-46b7-84e6-7ff151f96ab4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:53.388529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c74144fa-0788-46b7-84e6-7ff151f96ab4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:53.394814 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c74144fa-0788-46b7-84e6-7ff151f96ab4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:53.395954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c74144fa-0788-46b7-84e6-7ff151f96ab4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:53.396382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c74144fa-0788-46b7-84e6-7ff151f96ab4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:53.397086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c74144fa-0788-46b7-84e6-7ff151f96ab4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:53.397535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c74144fa-0788-46b7-84e6-7ff151f96ab4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:53.397944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c74144fa-0788-46b7-84e6-7ff151f96ab4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:53.435568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-567bbac0-30e3-482f-8cd9-1944149e64af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:53.436176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-567bbac0-30e3-482f-8cd9-1944149e64af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:53.443272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-567bbac0-30e3-482f-8cd9-1944149e64af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:53.443723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-567bbac0-30e3-482f-8cd9-1944149e64af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:53.444156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-567bbac0-30e3-482f-8cd9-1944149e64af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:53.444878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-567bbac0-30e3-482f-8cd9-1944149e64af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:53.445335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-567bbac0-30e3-482f-8cd9-1944149e64af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:53.445754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-567bbac0-30e3-482f-8cd9-1944149e64af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:53.459395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c74144fa-0788-46b7-84e6-7ff151f96ab4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:53.467627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c74144fa-0788-46b7-84e6-7ff151f96ab4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083655 Aug 24 06:35:53.468195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1044/2095] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:53.571965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-567bbac0-30e3-482f-8cd9-1944149e64af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:53.580158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-567bbac0-30e3-482f-8cd9-1944149e64af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.148704 Aug 24 06:35:53.580748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1052/2096] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:53 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:54.002466 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:54.002987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:54.009132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:54.009616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:54.010100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:54.010784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:54.011232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:54.011653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:54.138638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:54.147389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:54.148951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:54.150124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5ddc9fc6-9c82-4190-9583-d22968fba446 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.151861 Aug 24 06:35:54.150685 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1045/2097] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:54.487329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f5aa8a49-7f9c-459e-9349-5901571659e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:54.487938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f5aa8a49-7f9c-459e-9349-5901571659e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:54.490294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=80 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:54.495084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5aa8a49-7f9c-459e-9349-5901571659e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:54.495565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5aa8a49-7f9c-459e-9349-5901571659e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:54.496036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5aa8a49-7f9c-459e-9349-5901571659e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:54.496759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5aa8a49-7f9c-459e-9349-5901571659e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:54.497213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5aa8a49-7f9c-459e-9349-5901571659e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:54.497657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f5aa8a49-7f9c-459e-9349-5901571659e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:54.564782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f5aa8a49-7f9c-459e-9349-5901571659e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:54.573251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f5aa8a49-7f9c-459e-9349-5901571659e4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089868 Aug 24 06:35:54.573809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1053/2098] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:54.601518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d9a2a6ed-bbac-425f-ae64-6d69d397a241 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:54.602126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d9a2a6ed-bbac-425f-ae64-6d69d397a241 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:54.609100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9a2a6ed-bbac-425f-ae64-6d69d397a241 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:54.609572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9a2a6ed-bbac-425f-ae64-6d69d397a241 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:54.610006 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9a2a6ed-bbac-425f-ae64-6d69d397a241 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:54.610744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9a2a6ed-bbac-425f-ae64-6d69d397a241 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:54.611197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9a2a6ed-bbac-425f-ae64-6d69d397a241 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:54.611613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9a2a6ed-bbac-425f-ae64-6d69d397a241 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:54.743768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d9a2a6ed-bbac-425f-ae64-6d69d397a241 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:54.752328 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d9a2a6ed-bbac-425f-ae64-6d69d397a241 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154686 Aug 24 06:35:54.752915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1046/2099] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:54 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:35:55.173396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:55.174054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:55.179963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:55.180832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:55.180954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:55.181596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:55.182044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:55.182457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:55.308141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:55.317063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:55.318557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:55.319699 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8d8ef8a7-17fe-46f0-bc34-7073688302da tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.150216 Aug 24 06:35:55.320258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1054/2100] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:55.594870 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4aa19bb9-3d98-4b53-90dd-4ccc0a7e54e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:55.595391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4aa19bb9-3d98-4b53-90dd-4ccc0a7e54e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:55.601294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aa19bb9-3d98-4b53-90dd-4ccc0a7e54e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:55.601767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aa19bb9-3d98-4b53-90dd-4ccc0a7e54e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:55.602342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aa19bb9-3d98-4b53-90dd-4ccc0a7e54e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:55.602846 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aa19bb9-3d98-4b53-90dd-4ccc0a7e54e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:55.603289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aa19bb9-3d98-4b53-90dd-4ccc0a7e54e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:55.603703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4aa19bb9-3d98-4b53-90dd-4ccc0a7e54e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:55.664872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4aa19bb9-3d98-4b53-90dd-4ccc0a7e54e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:55.673930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4aa19bb9-3d98-4b53-90dd-4ccc0a7e54e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082609 Aug 24 06:35:55.674524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1047/2101] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:55 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:55.775257 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fed0d7c4-56cb-4a92-b858-1bbab76734c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:55.775859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fed0d7c4-56cb-4a92-b858-1bbab76734c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:55.781772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fed0d7c4-56cb-4a92-b858-1bbab76734c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:55.782237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fed0d7c4-56cb-4a92-b858-1bbab76734c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:55.782662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fed0d7c4-56cb-4a92-b858-1bbab76734c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:55.783329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fed0d7c4-56cb-4a92-b858-1bbab76734c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:55.783769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fed0d7c4-56cb-4a92-b858-1bbab76734c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:55.784181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fed0d7c4-56cb-4a92-b858-1bbab76734c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:55.911660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fed0d7c4-56cb-4a92-b858-1bbab76734c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:55.920082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fed0d7c4-56cb-4a92-b858-1bbab76734c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.149840 Aug 24 06:35:55.920706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1055/2102] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:55 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:56.342862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:56.343485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:56.349892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:56.350361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:56.350780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:56.351450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:56.351892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:56.352307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:56.482191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:56.491443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:56.492963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:56.494115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0de6c037-240d-4e33-9a6c-2d515cccbc72 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155161 Aug 24 06:35:56.494662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1048/2103] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:56.696220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-02e6b83a-9f0b-4c86-89f1-50d037580adf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:56.696872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-02e6b83a-9f0b-4c86-89f1-50d037580adf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:56.702947 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02e6b83a-9f0b-4c86-89f1-50d037580adf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:56.703423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02e6b83a-9f0b-4c86-89f1-50d037580adf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:56.703857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02e6b83a-9f0b-4c86-89f1-50d037580adf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:56.704568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02e6b83a-9f0b-4c86-89f1-50d037580adf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:56.705021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02e6b83a-9f0b-4c86-89f1-50d037580adf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:56.705443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02e6b83a-9f0b-4c86-89f1-50d037580adf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:56.771863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-02e6b83a-9f0b-4c86-89f1-50d037580adf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:56.780588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-02e6b83a-9f0b-4c86-89f1-50d037580adf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088268 Aug 24 06:35:56.781217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1056/2104] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:56.942182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b6c9be54-99f7-4dfe-b3eb-8e4814d454bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:56.942795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b6c9be54-99f7-4dfe-b3eb-8e4814d454bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:56.949470 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6c9be54-99f7-4dfe-b3eb-8e4814d454bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:56.949894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6c9be54-99f7-4dfe-b3eb-8e4814d454bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:56.950325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6c9be54-99f7-4dfe-b3eb-8e4814d454bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:56.951043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6c9be54-99f7-4dfe-b3eb-8e4814d454bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:56.951493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6c9be54-99f7-4dfe-b3eb-8e4814d454bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:56.951911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b6c9be54-99f7-4dfe-b3eb-8e4814d454bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:57.079043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b6c9be54-99f7-4dfe-b3eb-8e4814d454bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:57.087902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b6c9be54-99f7-4dfe-b3eb-8e4814d454bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.149571 Aug 24 06:35:57.088477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1049/2105] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:56 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:57.517257 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:57.517865 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:57.523911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:57.524416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:57.524882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:57.525565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:57.526014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:57.527123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:57.655522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:57.664238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:57.665772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:57.666918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1ba26eb4-a6b5-4e3a-bc06-2e0f39fff8a5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.153588 Aug 24 06:35:57.667475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1057/2106] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:57 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:57.802583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5ebc053c-7920-455f-9a90-a74a5ed69f76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:57.803138 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5ebc053c-7920-455f-9a90-a74a5ed69f76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:57.809472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebc053c-7920-455f-9a90-a74a5ed69f76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:57.809951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebc053c-7920-455f-9a90-a74a5ed69f76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:57.810384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebc053c-7920-455f-9a90-a74a5ed69f76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:57.811064 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebc053c-7920-455f-9a90-a74a5ed69f76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:57.811513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebc053c-7920-455f-9a90-a74a5ed69f76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:57.811933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5ebc053c-7920-455f-9a90-a74a5ed69f76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:57.872129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5ebc053c-7920-455f-9a90-a74a5ed69f76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:57.874327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:35:57.880930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5ebc053c-7920-455f-9a90-a74a5ed69f76 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082936 Aug 24 06:35:57.881479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1050/2107] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:57 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:58.108552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-882826bc-8b90-4e4f-8db2-e2ad1e1c6471 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:58.109125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-882826bc-8b90-4e4f-8db2-e2ad1e1c6471 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:58.116106 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-882826bc-8b90-4e4f-8db2-e2ad1e1c6471 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:58.116605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-882826bc-8b90-4e4f-8db2-e2ad1e1c6471 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:58.117033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-882826bc-8b90-4e4f-8db2-e2ad1e1c6471 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:58.117725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-882826bc-8b90-4e4f-8db2-e2ad1e1c6471 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:58.118146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-882826bc-8b90-4e4f-8db2-e2ad1e1c6471 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:58.118557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-882826bc-8b90-4e4f-8db2-e2ad1e1c6471 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:58.244249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-882826bc-8b90-4e4f-8db2-e2ad1e1c6471 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:58.252330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-882826bc-8b90-4e4f-8db2-e2ad1e1c6471 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.147786 Aug 24 06:35:58.252925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1058/2108] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:58 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:58.691594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:58.692722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:58.699731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:58.700211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:58.700669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:58.701359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:58.702037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:58.702464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:58.834358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:58.843117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:58.844648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:58.845798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-de31170c-8504-4ad1-b78e-f6f3c3e1101d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158648 Aug 24 06:35:58.846447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1051/2109] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:58 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:35:58.902817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b7bc0ab4-a5e9-4d73-bd33-461a367c26d8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:58.903502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b7bc0ab4-a5e9-4d73-bd33-461a367c26d8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:58.909538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7bc0ab4-a5e9-4d73-bd33-461a367c26d8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:58.910019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7bc0ab4-a5e9-4d73-bd33-461a367c26d8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:58.910483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7bc0ab4-a5e9-4d73-bd33-461a367c26d8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:58.911781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7bc0ab4-a5e9-4d73-bd33-461a367c26d8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:58.912230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7bc0ab4-a5e9-4d73-bd33-461a367c26d8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:58.912689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b7bc0ab4-a5e9-4d73-bd33-461a367c26d8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:58.977489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b7bc0ab4-a5e9-4d73-bd33-461a367c26d8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:58.985748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b7bc0ab4-a5e9-4d73-bd33-461a367c26d8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086756 Aug 24 06:35:58.986311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1059/2110] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:59.274007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6dad4318-bac9-43d7-99b9-d55ba23fa06d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:59.274658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6dad4318-bac9-43d7-99b9-d55ba23fa06d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:59.280731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dad4318-bac9-43d7-99b9-d55ba23fa06d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:59.281215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dad4318-bac9-43d7-99b9-d55ba23fa06d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:59.281645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dad4318-bac9-43d7-99b9-d55ba23fa06d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:59.282322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dad4318-bac9-43d7-99b9-d55ba23fa06d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:59.282771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dad4318-bac9-43d7-99b9-d55ba23fa06d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:59.283188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dad4318-bac9-43d7-99b9-d55ba23fa06d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:59.409486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6dad4318-bac9-43d7-99b9-d55ba23fa06d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:35:59.417579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6dad4318-bac9-43d7-99b9-d55ba23fa06d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.148191 Aug 24 06:35:59.418138 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1052/2111] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:35:59 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:35:59.869415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:35:59.870019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:35:59.876402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:59.876915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:59.877342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:35:59.878013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:35:59.878460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:35:59.878871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:00.007430 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-901dcfd1-1c42-4ba5-86fc-ac90652ab63a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:00.008038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-901dcfd1-1c42-4ba5-86fc-ac90652ab63a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:00.010077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:00.013982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-901dcfd1-1c42-4ba5-86fc-ac90652ab63a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:00.014460 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-901dcfd1-1c42-4ba5-86fc-ac90652ab63a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:00.014884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-901dcfd1-1c42-4ba5-86fc-ac90652ab63a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:00.015568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-901dcfd1-1c42-4ba5-86fc-ac90652ab63a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:00.016061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-901dcfd1-1c42-4ba5-86fc-ac90652ab63a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:00.016482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-901dcfd1-1c42-4ba5-86fc-ac90652ab63a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:00.019188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:00.020774 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:00.022005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6bc1bdea-f6d4-4834-8b29-baed39ebef9a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156414 Aug 24 06:36:00.022564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1060/2112] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:35:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:00.079774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-901dcfd1-1c42-4ba5-86fc-ac90652ab63a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:00.088030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-901dcfd1-1c42-4ba5-86fc-ac90652ab63a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085324 Aug 24 06:36:00.088635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1053/2113] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:00.438671 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d4a6a647-0fb5-484a-a5c8-8b174a14eeb0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:00.445385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d4a6a647-0fb5-484a-a5c8-8b174a14eeb0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:00.445385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4a6a647-0fb5-484a-a5c8-8b174a14eeb0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:00.445807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4a6a647-0fb5-484a-a5c8-8b174a14eeb0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:00.446241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4a6a647-0fb5-484a-a5c8-8b174a14eeb0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:00.446921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4a6a647-0fb5-484a-a5c8-8b174a14eeb0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:00.447369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4a6a647-0fb5-484a-a5c8-8b174a14eeb0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:00.447787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4a6a647-0fb5-484a-a5c8-8b174a14eeb0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:00.576928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d4a6a647-0fb5-484a-a5c8-8b174a14eeb0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:00.585673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d4a6a647-0fb5-484a-a5c8-8b174a14eeb0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150892 Aug 24 06:36:00.586232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1061/2114] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:00 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:01.053973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:01.054528 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:01.061119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:01.061590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:01.062013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:01.062694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:01.063178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:01.063589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:01.109205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9e3323be-d464-4337-9941-00db10a45e78 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:01.109930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9e3323be-d464-4337-9941-00db10a45e78 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:01.117293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e3323be-d464-4337-9941-00db10a45e78 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:01.117764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e3323be-d464-4337-9941-00db10a45e78 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:01.118188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e3323be-d464-4337-9941-00db10a45e78 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:01.118872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e3323be-d464-4337-9941-00db10a45e78 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:01.119315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e3323be-d464-4337-9941-00db10a45e78 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:01.119728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e3323be-d464-4337-9941-00db10a45e78 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:01.135427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:01.182269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9e3323be-d464-4337-9941-00db10a45e78 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:01.190877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9e3323be-d464-4337-9941-00db10a45e78 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085422 Aug 24 06:36:01.191474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1062/2115] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:01.197524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:01.206370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:01.207884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:01.209076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8bc95b7b-a28e-4bf8-a4fd-32d22ad6d068 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161870 Aug 24 06:36:01.209638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1054/2116] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:01.607749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8b9d25a1-fd5a-4d7e-af00-7b459fd15744 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:01.608355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8b9d25a1-fd5a-4d7e-af00-7b459fd15744 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:01.615085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b9d25a1-fd5a-4d7e-af00-7b459fd15744 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:01.615556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b9d25a1-fd5a-4d7e-af00-7b459fd15744 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:01.616006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b9d25a1-fd5a-4d7e-af00-7b459fd15744 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:01.616716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b9d25a1-fd5a-4d7e-af00-7b459fd15744 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:01.617164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b9d25a1-fd5a-4d7e-af00-7b459fd15744 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:01.617605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8b9d25a1-fd5a-4d7e-af00-7b459fd15744 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:01.744033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8b9d25a1-fd5a-4d7e-af00-7b459fd15744 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:01.752232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8b9d25a1-fd5a-4d7e-af00-7b459fd15744 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.148406 Aug 24 06:36:01.752830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1063/2117] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:01 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:02.211711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7f617f40-90a9-4bf1-9ab6-35dcb1b89a01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:02.212326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7f617f40-90a9-4bf1-9ab6-35dcb1b89a01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:02.218919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f617f40-90a9-4bf1-9ab6-35dcb1b89a01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:02.219395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f617f40-90a9-4bf1-9ab6-35dcb1b89a01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:02.219829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f617f40-90a9-4bf1-9ab6-35dcb1b89a01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:02.220524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f617f40-90a9-4bf1-9ab6-35dcb1b89a01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:02.220987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f617f40-90a9-4bf1-9ab6-35dcb1b89a01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:02.221433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7f617f40-90a9-4bf1-9ab6-35dcb1b89a01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:02.231302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:02.232006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:02.238723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:02.239725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:02.240157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:02.240874 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:02.241331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:02.241753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:02.282799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7f617f40-90a9-4bf1-9ab6-35dcb1b89a01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:02.291605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7f617f40-90a9-4bf1-9ab6-35dcb1b89a01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083789 Aug 24 06:36:02.292249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1055/2118] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:02 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:02.377946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:02.386659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:02.388147 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:02.389326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5327dd64-7424-4d21-ab68-604bf4cfbe4a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161973 Aug 24 06:36:02.389877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1064/2119] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:36:02.774097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-57fccb77-367a-4254-984c-e7d2a811ba14 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:02.774752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-57fccb77-367a-4254-984c-e7d2a811ba14 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:02.780892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57fccb77-367a-4254-984c-e7d2a811ba14 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:02.781368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57fccb77-367a-4254-984c-e7d2a811ba14 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:02.781799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57fccb77-367a-4254-984c-e7d2a811ba14 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:02.782500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57fccb77-367a-4254-984c-e7d2a811ba14 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:02.782945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57fccb77-367a-4254-984c-e7d2a811ba14 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:02.783360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57fccb77-367a-4254-984c-e7d2a811ba14 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:02.911568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-57fccb77-367a-4254-984c-e7d2a811ba14 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:02.919689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-57fccb77-367a-4254-984c-e7d2a811ba14 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.149980 Aug 24 06:36:02.920249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1056/2120] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:02 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:03.312195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0c723067-7323-4c6f-87f2-21f1a764d5e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:03.312847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0c723067-7323-4c6f-87f2-21f1a764d5e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:03.319852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c723067-7323-4c6f-87f2-21f1a764d5e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:03.320327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c723067-7323-4c6f-87f2-21f1a764d5e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:03.320784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c723067-7323-4c6f-87f2-21f1a764d5e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:03.321467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c723067-7323-4c6f-87f2-21f1a764d5e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:03.321917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c723067-7323-4c6f-87f2-21f1a764d5e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:03.322336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c723067-7323-4c6f-87f2-21f1a764d5e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:03.383241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0c723067-7323-4c6f-87f2-21f1a764d5e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:03.391447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0c723067-7323-4c6f-87f2-21f1a764d5e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083397 Aug 24 06:36:03.392009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1065/2121] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:03 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:03.411304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:03.411926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:03.417888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:03.418371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:03.418800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:03.419481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:03.419938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:03.420355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:03.549570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:03.558663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:03.560423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:03.561601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7cd71b52-9174-4a07-8372-fb48b63fab55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.154308 Aug 24 06:36:03.562153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1057/2122] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:03.941323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d6059735-9bf8-4c5a-862a-bde2435ca525 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:03.941985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d6059735-9bf8-4c5a-862a-bde2435ca525 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:03.947926 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6059735-9bf8-4c5a-862a-bde2435ca525 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:03.948461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6059735-9bf8-4c5a-862a-bde2435ca525 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:03.948921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6059735-9bf8-4c5a-862a-bde2435ca525 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:03.949605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6059735-9bf8-4c5a-862a-bde2435ca525 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:03.950053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6059735-9bf8-4c5a-862a-bde2435ca525 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:03.950482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d6059735-9bf8-4c5a-862a-bde2435ca525 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:04.078468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d6059735-9bf8-4c5a-862a-bde2435ca525 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:04.086782 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d6059735-9bf8-4c5a-862a-bde2435ca525 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.149524 Aug 24 06:36:04.087347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1066/2123] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:03 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:04.412546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f67664c7-7aa3-4341-9cfd-7a8332195d23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:04.413193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f67664c7-7aa3-4341-9cfd-7a8332195d23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:04.419646 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f67664c7-7aa3-4341-9cfd-7a8332195d23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:04.420122 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f67664c7-7aa3-4341-9cfd-7a8332195d23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:04.420585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f67664c7-7aa3-4341-9cfd-7a8332195d23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:04.421269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f67664c7-7aa3-4341-9cfd-7a8332195d23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:04.421747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f67664c7-7aa3-4341-9cfd-7a8332195d23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:04.422165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f67664c7-7aa3-4341-9cfd-7a8332195d23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:04.483027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f67664c7-7aa3-4341-9cfd-7a8332195d23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:04.491241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f67664c7-7aa3-4341-9cfd-7a8332195d23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083195 Aug 24 06:36:04.491804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1058/2124] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:04.585385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:04.585995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:04.592370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:04.592878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:04.593311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:04.593996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:04.594439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:04.594855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:04.725657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:04.734781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:04.736320 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:04.737521 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9bc9612e-a14f-4854-979b-19ec5960a022 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156682 Aug 24 06:36:04.738085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1067/2125] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:04 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:05.108589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1d122b20-a921-4247-be2a-ae664e731467 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:05.109123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1d122b20-a921-4247-be2a-ae664e731467 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:05.115507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d122b20-a921-4247-be2a-ae664e731467 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:05.115984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d122b20-a921-4247-be2a-ae664e731467 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:05.116436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d122b20-a921-4247-be2a-ae664e731467 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:05.117110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d122b20-a921-4247-be2a-ae664e731467 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:05.117555 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d122b20-a921-4247-be2a-ae664e731467 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:05.117967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d122b20-a921-4247-be2a-ae664e731467 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:05.246137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1d122b20-a921-4247-be2a-ae664e731467 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:05.254336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1d122b20-a921-4247-be2a-ae664e731467 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.149698 Aug 24 06:36:05.254931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1059/2126] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:05 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:05.512339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c4ef6056-fa85-4c47-80b6-9e0f28e6e106 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:05.512968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c4ef6056-fa85-4c47-80b6-9e0f28e6e106 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:05.518931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4ef6056-fa85-4c47-80b6-9e0f28e6e106 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:05.519416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4ef6056-fa85-4c47-80b6-9e0f28e6e106 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:05.519828 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4ef6056-fa85-4c47-80b6-9e0f28e6e106 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:05.520514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4ef6056-fa85-4c47-80b6-9e0f28e6e106 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:05.520978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4ef6056-fa85-4c47-80b6-9e0f28e6e106 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:05.521392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4ef6056-fa85-4c47-80b6-9e0f28e6e106 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:05.581814 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c4ef6056-fa85-4c47-80b6-9e0f28e6e106 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:05.590043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c4ef6056-fa85-4c47-80b6-9e0f28e6e106 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.081567 Aug 24 06:36:05.590640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1068/2127] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:05.766879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:05.767437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:05.774398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:05.774878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:05.775304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:05.776110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:05.776591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:05.777013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:05.907669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:05.917039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:05.918564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:05.919717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-169c94a9-8287-4cb7-9f92-e6f645e537b2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156829 Aug 24 06:36:05.920271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1060/2128] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:06.276247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a6498b60-a00c-4920-b517-c72e28d7a185 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:06.276880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a6498b60-a00c-4920-b517-c72e28d7a185 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:06.283304 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6498b60-a00c-4920-b517-c72e28d7a185 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:06.283784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6498b60-a00c-4920-b517-c72e28d7a185 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:06.284214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6498b60-a00c-4920-b517-c72e28d7a185 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:06.284948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6498b60-a00c-4920-b517-c72e28d7a185 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:06.285381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6498b60-a00c-4920-b517-c72e28d7a185 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:06.285803 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6498b60-a00c-4920-b517-c72e28d7a185 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:06.411034 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a6498b60-a00c-4920-b517-c72e28d7a185 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:06.419151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a6498b60-a00c-4920-b517-c72e28d7a185 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.146823 Aug 24 06:36:06.419713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1069/2129] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:06 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:06.610819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-122f3614-ae45-4894-bceb-98127b5b2af8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:06.611375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-122f3614-ae45-4894-bceb-98127b5b2af8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:06.617851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-122f3614-ae45-4894-bceb-98127b5b2af8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:06.618331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-122f3614-ae45-4894-bceb-98127b5b2af8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:06.618769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-122f3614-ae45-4894-bceb-98127b5b2af8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:06.619445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-122f3614-ae45-4894-bceb-98127b5b2af8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:06.619893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-122f3614-ae45-4894-bceb-98127b5b2af8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:06.620472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-122f3614-ae45-4894-bceb-98127b5b2af8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:06.680617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-122f3614-ae45-4894-bceb-98127b5b2af8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:06.689153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-122f3614-ae45-4894-bceb-98127b5b2af8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082236 Aug 24 06:36:06.689947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1061/2130] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:06.942358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:06.943217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:06.949044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:06.949522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:06.949954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:06.950648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:06.951096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:06.951520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:07.080616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:07.089430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:07.090911 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:07.092078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2590bb84-1c3c-4682-ae2e-c0be5e2fd1d7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.153683 Aug 24 06:36:07.092669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1070/2131] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:07.440869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8ac0392a-694e-4b9a-9bcf-cedd6840bfba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:07.442196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8ac0392a-694e-4b9a-9bcf-cedd6840bfba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:07.448424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac0392a-694e-4b9a-9bcf-cedd6840bfba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:07.448928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac0392a-694e-4b9a-9bcf-cedd6840bfba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:07.449410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac0392a-694e-4b9a-9bcf-cedd6840bfba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:07.450037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac0392a-694e-4b9a-9bcf-cedd6840bfba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:07.450480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac0392a-694e-4b9a-9bcf-cedd6840bfba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:07.450894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac0392a-694e-4b9a-9bcf-cedd6840bfba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:07.582163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8ac0392a-694e-4b9a-9bcf-cedd6840bfba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:07.590293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8ac0392a-694e-4b9a-9bcf-cedd6840bfba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153243 Aug 24 06:36:07.590854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1062/2132] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:07 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:07.710450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b0f8bb92-5d8f-4d87-8884-04f24c64f26f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:07.711065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b0f8bb92-5d8f-4d87-8884-04f24c64f26f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:07.717885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f8bb92-5d8f-4d87-8884-04f24c64f26f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:07.718372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f8bb92-5d8f-4d87-8884-04f24c64f26f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:07.718871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f8bb92-5d8f-4d87-8884-04f24c64f26f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:07.719583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f8bb92-5d8f-4d87-8884-04f24c64f26f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:07.720053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f8bb92-5d8f-4d87-8884-04f24c64f26f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:07.720489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0f8bb92-5d8f-4d87-8884-04f24c64f26f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:07.783309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b0f8bb92-5d8f-4d87-8884-04f24c64f26f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:07.792028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b0f8bb92-5d8f-4d87-8884-04f24c64f26f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085479 Aug 24 06:36:07.792753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1071/2133] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:08.115909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:08.116404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:08.122799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:08.123282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:08.123705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:08.124400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:08.124873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:08.125287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:08.260845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:08.270536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:08.272035 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:08.273249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-57976ea6-3cc9-4adc-919f-1a770a2eda5a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161469 Aug 24 06:36:08.273819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1063/2134] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:08.611778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b5b3179a-29bc-4a11-8598-e789ecd00ffe tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:08.612537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b5b3179a-29bc-4a11-8598-e789ecd00ffe tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:08.619138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5b3179a-29bc-4a11-8598-e789ecd00ffe tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:08.619612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5b3179a-29bc-4a11-8598-e789ecd00ffe tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:08.620045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5b3179a-29bc-4a11-8598-e789ecd00ffe tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:08.620758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5b3179a-29bc-4a11-8598-e789ecd00ffe tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:08.621208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5b3179a-29bc-4a11-8598-e789ecd00ffe tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:08.621625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5b3179a-29bc-4a11-8598-e789ecd00ffe tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:08.752398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b5b3179a-29bc-4a11-8598-e789ecd00ffe tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:08.761673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b5b3179a-29bc-4a11-8598-e789ecd00ffe tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153663 Aug 24 06:36:08.762253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1072/2135] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:08 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:08.814071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ad24772a-96d1-4efe-8810-9d8088d358cf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:08.814613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ad24772a-96d1-4efe-8810-9d8088d358cf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:08.821816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad24772a-96d1-4efe-8810-9d8088d358cf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:08.822277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad24772a-96d1-4efe-8810-9d8088d358cf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:08.822707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad24772a-96d1-4efe-8810-9d8088d358cf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:08.823468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad24772a-96d1-4efe-8810-9d8088d358cf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:08.823948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad24772a-96d1-4efe-8810-9d8088d358cf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:08.824400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad24772a-96d1-4efe-8810-9d8088d358cf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:08.885945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ad24772a-96d1-4efe-8810-9d8088d358cf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:08.894202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ad24772a-96d1-4efe-8810-9d8088d358cf tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084114 Aug 24 06:36:08.894824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1064/2136] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:09.296405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:09.297050 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:09.303594 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:09.304070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:09.304518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:09.305210 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:09.305659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:09.306078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:09.440000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:09.448780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:09.450325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:09.451411 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3db4ab54-f854-4e6b-b7c6-c441ffe556c7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158959 Aug 24 06:36:09.451970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1073/2137] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:09.783145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ef2a6c10-5f40-43a5-a560-6a06b5e79a47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:09.783745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ef2a6c10-5f40-43a5-a560-6a06b5e79a47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:09.790230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2a6c10-5f40-43a5-a560-6a06b5e79a47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:09.790703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2a6c10-5f40-43a5-a560-6a06b5e79a47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:09.791132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2a6c10-5f40-43a5-a560-6a06b5e79a47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:09.791806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2a6c10-5f40-43a5-a560-6a06b5e79a47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:09.792249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2a6c10-5f40-43a5-a560-6a06b5e79a47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:09.792697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef2a6c10-5f40-43a5-a560-6a06b5e79a47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:09.915267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-39740bea-6fb4-4d85-9d23-c15c0954c077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:09.915860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-39740bea-6fb4-4d85-9d23-c15c0954c077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:09.922505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-39740bea-6fb4-4d85-9d23-c15c0954c077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:09.922989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-39740bea-6fb4-4d85-9d23-c15c0954c077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:09.923422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-39740bea-6fb4-4d85-9d23-c15c0954c077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:09.924120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-39740bea-6fb4-4d85-9d23-c15c0954c077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:09.924603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-39740bea-6fb4-4d85-9d23-c15c0954c077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:09.925026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-39740bea-6fb4-4d85-9d23-c15c0954c077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:09.927229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ef2a6c10-5f40-43a5-a560-6a06b5e79a47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:09.935836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ef2a6c10-5f40-43a5-a560-6a06b5e79a47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.156526 Aug 24 06:36:09.936409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1065/2138] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:09 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:09.987794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-39740bea-6fb4-4d85-9d23-c15c0954c077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:09.996797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-39740bea-6fb4-4d85-9d23-c15c0954c077 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085292 Aug 24 06:36:09.997363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1074/2139] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:09 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:10.474647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:10.475260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:10.481339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:10.481819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:10.482250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:10.482944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:10.483434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:10.483865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:10.613106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:10.621734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:10.623232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:10.624380 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5524ed5a-cb79-4ae1-a579-165d7615a58f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.153803 Aug 24 06:36:10.624976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1066/2140] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:10 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:10.957506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-255c4f7c-73d2-4927-94f8-22f67a64a72f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:10.958118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-255c4f7c-73d2-4927-94f8-22f67a64a72f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:10.964634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-255c4f7c-73d2-4927-94f8-22f67a64a72f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:10.965114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-255c4f7c-73d2-4927-94f8-22f67a64a72f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:10.965551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-255c4f7c-73d2-4927-94f8-22f67a64a72f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:10.966238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-255c4f7c-73d2-4927-94f8-22f67a64a72f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:10.966714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-255c4f7c-73d2-4927-94f8-22f67a64a72f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:10.967140 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-255c4f7c-73d2-4927-94f8-22f67a64a72f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:11.017396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3b191bdd-609a-4122-a472-c60e1826f918 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:11.018006 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3b191bdd-609a-4122-a472-c60e1826f918 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:11.025023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b191bdd-609a-4122-a472-c60e1826f918 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:11.025504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b191bdd-609a-4122-a472-c60e1826f918 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:11.025940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b191bdd-609a-4122-a472-c60e1826f918 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:11.026646 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b191bdd-609a-4122-a472-c60e1826f918 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:11.027112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b191bdd-609a-4122-a472-c60e1826f918 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:11.027573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b191bdd-609a-4122-a472-c60e1826f918 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:11.043682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:11.090993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3b191bdd-609a-4122-a472-c60e1826f918 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:11.099872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3b191bdd-609a-4122-a472-c60e1826f918 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086278 Aug 24 06:36:11.100449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1067/2141] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:11.101006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-255c4f7c-73d2-4927-94f8-22f67a64a72f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:11.109434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-255c4f7c-73d2-4927-94f8-22f67a64a72f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.156381 Aug 24 06:36:11.109994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1075/2142] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:10 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:11.648540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:11.649223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:11.655210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:11.655684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:11.656113 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:11.656892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:11.657366 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:11.657786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:11.801527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:11.811391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:11.812969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:11.817050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-32e513ed-9046-493f-b3aa-eca9bb80d9ef tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.170089 Aug 24 06:36:11.817050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1068/2143] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:12.121089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4c2990a8-b97b-4a99-ab56-dc2010da7141 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:12.121717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4c2990a8-b97b-4a99-ab56-dc2010da7141 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:12.128379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2990a8-b97b-4a99-ab56-dc2010da7141 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:12.128897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2990a8-b97b-4a99-ab56-dc2010da7141 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:12.129328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2990a8-b97b-4a99-ab56-dc2010da7141 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:12.130014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2990a8-b97b-4a99-ab56-dc2010da7141 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:12.130455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2990a8-b97b-4a99-ab56-dc2010da7141 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:12.130870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c2990a8-b97b-4a99-ab56-dc2010da7141 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:12.131089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ec1d26d8-6ae3-407d-a2eb-8ac3b903a943 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:12.131704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ec1d26d8-6ae3-407d-a2eb-8ac3b903a943 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:12.138369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec1d26d8-6ae3-407d-a2eb-8ac3b903a943 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:12.138858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec1d26d8-6ae3-407d-a2eb-8ac3b903a943 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:12.139289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec1d26d8-6ae3-407d-a2eb-8ac3b903a943 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:12.140052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec1d26d8-6ae3-407d-a2eb-8ac3b903a943 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:12.140520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec1d26d8-6ae3-407d-a2eb-8ac3b903a943 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:12.140951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec1d26d8-6ae3-407d-a2eb-8ac3b903a943 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:12.195685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4c2990a8-b97b-4a99-ab56-dc2010da7141 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:12.204109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4c2990a8-b97b-4a99-ab56-dc2010da7141 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087058 Aug 24 06:36:12.204704 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1076/2144] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:12.271684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ec1d26d8-6ae3-407d-a2eb-8ac3b903a943 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:12.280172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ec1d26d8-6ae3-407d-a2eb-8ac3b903a943 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153015 Aug 24 06:36:12.280777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1069/2145] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:12 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:12.837516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:12.838114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:12.844134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:12.844644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:12.845071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:12.845747 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:12.846189 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:12.846605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:12.974802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:12.983578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:12.985104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:12.986252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-dcf39911-0b1b-4409-92f7-e5061dea2d08 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.152694 Aug 24 06:36:12.986812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1077/2146] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:13.225533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f1bc084d-d9a0-4b48-bc3c-54c6a994f512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:13.226063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f1bc084d-d9a0-4b48-bc3c-54c6a994f512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:13.232897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1bc084d-d9a0-4b48-bc3c-54c6a994f512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:13.233375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1bc084d-d9a0-4b48-bc3c-54c6a994f512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:13.233804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1bc084d-d9a0-4b48-bc3c-54c6a994f512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:13.234491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1bc084d-d9a0-4b48-bc3c-54c6a994f512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:13.234965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1bc084d-d9a0-4b48-bc3c-54c6a994f512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:13.235384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f1bc084d-d9a0-4b48-bc3c-54c6a994f512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:13.298045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f1bc084d-d9a0-4b48-bc3c-54c6a994f512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:13.302353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-019a7d15-b58f-4d98-9fe3-beeb48f15e5d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:13.302959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-019a7d15-b58f-4d98-9fe3-beeb48f15e5d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:13.306468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f1bc084d-d9a0-4b48-bc3c-54c6a994f512 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085590 Aug 24 06:36:13.307049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1070/2147] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:13.308930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-019a7d15-b58f-4d98-9fe3-beeb48f15e5d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:13.309660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-019a7d15-b58f-4d98-9fe3-beeb48f15e5d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:13.310085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-019a7d15-b58f-4d98-9fe3-beeb48f15e5d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:13.310766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-019a7d15-b58f-4d98-9fe3-beeb48f15e5d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:13.311221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-019a7d15-b58f-4d98-9fe3-beeb48f15e5d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:13.311638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-019a7d15-b58f-4d98-9fe3-beeb48f15e5d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:13.443610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-019a7d15-b58f-4d98-9fe3-beeb48f15e5d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:13.452441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-019a7d15-b58f-4d98-9fe3-beeb48f15e5d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154404 Aug 24 06:36:13.453057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1078/2148] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:13 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:14.009649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:14.010241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:14.016763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:14.017251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:14.017689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:14.018379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:14.018843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:14.019256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:14.160719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:14.168551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:14.170043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:14.171187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e655ca60-1719-4d00-82d1-5b5e96db22ba tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.165560 Aug 24 06:36:14.171783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1071/2149] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:14.327578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-81690121-80f9-4761-ad0b-16b2ac5cb482 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:14.328152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-81690121-80f9-4761-ad0b-16b2ac5cb482 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:14.335313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81690121-80f9-4761-ad0b-16b2ac5cb482 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:14.335797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81690121-80f9-4761-ad0b-16b2ac5cb482 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:14.336229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81690121-80f9-4761-ad0b-16b2ac5cb482 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:14.336957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81690121-80f9-4761-ad0b-16b2ac5cb482 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:14.337407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81690121-80f9-4761-ad0b-16b2ac5cb482 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:14.337831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-81690121-80f9-4761-ad0b-16b2ac5cb482 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:14.340472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:14.401767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-81690121-80f9-4761-ad0b-16b2ac5cb482 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:14.410630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-81690121-80f9-4761-ad0b-16b2ac5cb482 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086980 Aug 24 06:36:14.411228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1079/2150] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:14.473971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-95f88530-e46f-4e6e-a6b3-8ca352284113 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:14.478594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-95f88530-e46f-4e6e-a6b3-8ca352284113 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:14.480908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95f88530-e46f-4e6e-a6b3-8ca352284113 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:14.481392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95f88530-e46f-4e6e-a6b3-8ca352284113 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:14.481799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95f88530-e46f-4e6e-a6b3-8ca352284113 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:14.482477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95f88530-e46f-4e6e-a6b3-8ca352284113 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:14.482918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95f88530-e46f-4e6e-a6b3-8ca352284113 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:14.483331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-95f88530-e46f-4e6e-a6b3-8ca352284113 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:14.612147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-95f88530-e46f-4e6e-a6b3-8ca352284113 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:14.620764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-95f88530-e46f-4e6e-a6b3-8ca352284113 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150862 Aug 24 06:36:14.621319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1072/2151] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:14 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:15.193949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:15.194582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:15.200656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:15.201136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:15.201566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:15.202272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:15.202704 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:15.203125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:15.330584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:15.340628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:15.342170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:15.343363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-be97260e-c210-4104-8b7b-941ae0b9d3b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.153855 Aug 24 06:36:15.343928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1080/2152] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:15.432014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6df82f2c-bc81-4f4d-ae5f-35520cbe37c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:15.432669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6df82f2c-bc81-4f4d-ae5f-35520cbe37c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:15.439384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6df82f2c-bc81-4f4d-ae5f-35520cbe37c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:15.439873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6df82f2c-bc81-4f4d-ae5f-35520cbe37c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:15.440315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6df82f2c-bc81-4f4d-ae5f-35520cbe37c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:15.441053 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6df82f2c-bc81-4f4d-ae5f-35520cbe37c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:15.442097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6df82f2c-bc81-4f4d-ae5f-35520cbe37c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:15.442518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6df82f2c-bc81-4f4d-ae5f-35520cbe37c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:15.506839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6df82f2c-bc81-4f4d-ae5f-35520cbe37c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:15.515459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6df82f2c-bc81-4f4d-ae5f-35520cbe37c0 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087361 Aug 24 06:36:15.516051 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1073/2153] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:15 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:15.643714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-97d047f2-34b4-4ea5-8587-0f5764cd9996 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:15.644394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-97d047f2-34b4-4ea5-8587-0f5764cd9996 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:15.651106 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97d047f2-34b4-4ea5-8587-0f5764cd9996 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:15.651735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97d047f2-34b4-4ea5-8587-0f5764cd9996 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:15.652255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97d047f2-34b4-4ea5-8587-0f5764cd9996 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:15.653095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97d047f2-34b4-4ea5-8587-0f5764cd9996 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:15.653633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97d047f2-34b4-4ea5-8587-0f5764cd9996 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:15.654132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-97d047f2-34b4-4ea5-8587-0f5764cd9996 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:15.795586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-97d047f2-34b4-4ea5-8587-0f5764cd9996 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:15.802173 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-97d047f2-34b4-4ea5-8587-0f5764cd9996 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.162373 Aug 24 06:36:15.802749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1081/2154] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:15 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:16.366592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:16.367087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:16.373365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:16.373848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:16.374276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:16.374966 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:16.375409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:16.375823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:16.516274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:16.521161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:16.522660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:16.523856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0bbc4585-1db0-40f2-94d3-96d3ec3d86a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161366 Aug 24 06:36:16.524423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1074/2155] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:16 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:16.536312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c0283eb3-8503-47b6-bf7c-a60e6af21153 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:16.538500 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c0283eb3-8503-47b6-bf7c-a60e6af21153 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:16.543610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0283eb3-8503-47b6-bf7c-a60e6af21153 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:16.544096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0283eb3-8503-47b6-bf7c-a60e6af21153 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:16.544555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0283eb3-8503-47b6-bf7c-a60e6af21153 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:16.545267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0283eb3-8503-47b6-bf7c-a60e6af21153 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:16.545717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0283eb3-8503-47b6-bf7c-a60e6af21153 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:16.546146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0283eb3-8503-47b6-bf7c-a60e6af21153 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:16.610849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c0283eb3-8503-47b6-bf7c-a60e6af21153 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:16.619269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c0283eb3-8503-47b6-bf7c-a60e6af21153 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086704 Aug 24 06:36:16.619810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1082/2156] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:16.823158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8b820454-7030-4c76-9274-6df839113236 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:16.823793 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8b820454-7030-4c76-9274-6df839113236 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:16.829987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b820454-7030-4c76-9274-6df839113236 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:16.830480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b820454-7030-4c76-9274-6df839113236 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:16.830916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b820454-7030-4c76-9274-6df839113236 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:16.831603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b820454-7030-4c76-9274-6df839113236 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:16.832679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b820454-7030-4c76-9274-6df839113236 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:16.833060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8b820454-7030-4c76-9274-6df839113236 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:16.973692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8b820454-7030-4c76-9274-6df839113236 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:16.981980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8b820454-7030-4c76-9274-6df839113236 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.162676 Aug 24 06:36:16.982537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1075/2157] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:16 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:17.547953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:17.548554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:17.554888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:17.555472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:17.555886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:17.556625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:17.557078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:17.557501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:17.641319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1d4f5881-6a28-4c2a-b4d9-f7bc516c3a38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:17.641939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1d4f5881-6a28-4c2a-b4d9-f7bc516c3a38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:17.644363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=80 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:17.649756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d4f5881-6a28-4c2a-b4d9-f7bc516c3a38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:17.650265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d4f5881-6a28-4c2a-b4d9-f7bc516c3a38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:17.650927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d4f5881-6a28-4c2a-b4d9-f7bc516c3a38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:17.651640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d4f5881-6a28-4c2a-b4d9-f7bc516c3a38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:17.652092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d4f5881-6a28-4c2a-b4d9-f7bc516c3a38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:17.652577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d4f5881-6a28-4c2a-b4d9-f7bc516c3a38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:17.695029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:17.705588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:17.707429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:17.712322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-40d336fb-7b2f-44a8-9728-89c53fcd57cb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.164721 Aug 24 06:36:17.712322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1083/2158] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:17.720889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1d4f5881-6a28-4c2a-b4d9-f7bc516c3a38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:17.730192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1d4f5881-6a28-4c2a-b4d9-f7bc516c3a38 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093096 Aug 24 06:36:17.730781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1076/2159] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:17 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:18.003195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-252c1e03-e1ba-44c9-9a00-fc4ef56e2014 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:18.004334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-252c1e03-e1ba-44c9-9a00-fc4ef56e2014 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:18.010462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-252c1e03-e1ba-44c9-9a00-fc4ef56e2014 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:18.010942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-252c1e03-e1ba-44c9-9a00-fc4ef56e2014 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:18.011373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-252c1e03-e1ba-44c9-9a00-fc4ef56e2014 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:18.012060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-252c1e03-e1ba-44c9-9a00-fc4ef56e2014 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:18.012525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-252c1e03-e1ba-44c9-9a00-fc4ef56e2014 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:18.012948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-252c1e03-e1ba-44c9-9a00-fc4ef56e2014 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:18.146444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-252c1e03-e1ba-44c9-9a00-fc4ef56e2014 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:18.154640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-252c1e03-e1ba-44c9-9a00-fc4ef56e2014 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155305 Aug 24 06:36:18.155211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1084/2160] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:17 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:18.731858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:18.732551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:18.740167 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:18.740684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:18.741114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:18.741806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:18.742256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:18.742721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:18.752415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cd62e5e2-50d9-423f-a06e-99060e42a1f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:18.753271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cd62e5e2-50d9-423f-a06e-99060e42a1f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:18.761117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd62e5e2-50d9-423f-a06e-99060e42a1f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:18.761686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd62e5e2-50d9-423f-a06e-99060e42a1f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:18.762188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd62e5e2-50d9-423f-a06e-99060e42a1f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:18.763023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd62e5e2-50d9-423f-a06e-99060e42a1f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:18.763588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd62e5e2-50d9-423f-a06e-99060e42a1f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:18.764163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cd62e5e2-50d9-423f-a06e-99060e42a1f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:18.838109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cd62e5e2-50d9-423f-a06e-99060e42a1f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:18.850535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cd62e5e2-50d9-423f-a06e-99060e42a1f8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.102363 Aug 24 06:36:18.851327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1085/2161] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:18.897143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:18.906073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:18.907645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:18.908840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f0904356-ef81-44e3-8267-ebb3cca37c3d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.181209 Aug 24 06:36:18.909396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1077/2162] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:19.176368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-722f74e6-9065-47f7-a42e-6f32838db7c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:19.177094 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-722f74e6-9065-47f7-a42e-6f32838db7c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:19.183108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-722f74e6-9065-47f7-a42e-6f32838db7c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:19.183589 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-722f74e6-9065-47f7-a42e-6f32838db7c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:19.184025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-722f74e6-9065-47f7-a42e-6f32838db7c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:19.184995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-722f74e6-9065-47f7-a42e-6f32838db7c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:19.185447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-722f74e6-9065-47f7-a42e-6f32838db7c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:19.185866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-722f74e6-9065-47f7-a42e-6f32838db7c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:19.317135 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-722f74e6-9065-47f7-a42e-6f32838db7c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:19.325530 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-722f74e6-9065-47f7-a42e-6f32838db7c9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153524 Aug 24 06:36:19.326038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1086/2163] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:19 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:19.872316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b60d0546-8b00-46be-adf6-60fc0123549b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:19.872930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b60d0546-8b00-46be-adf6-60fc0123549b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:19.879635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b60d0546-8b00-46be-adf6-60fc0123549b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:19.880193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b60d0546-8b00-46be-adf6-60fc0123549b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:19.880573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b60d0546-8b00-46be-adf6-60fc0123549b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:19.881274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b60d0546-8b00-46be-adf6-60fc0123549b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:19.881718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b60d0546-8b00-46be-adf6-60fc0123549b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:19.887685 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b60d0546-8b00-46be-adf6-60fc0123549b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:19.932433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:19.938024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:19.940461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:19.940980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:19.941465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:19.942401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:19.942916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:19.943346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:19.947552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b60d0546-8b00-46be-adf6-60fc0123549b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:19.955751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b60d0546-8b00-46be-adf6-60fc0123549b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087377 Aug 24 06:36:19.956330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1078/2164] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:20.080552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:20.089986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:20.091482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:20.092688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b24bfb21-3bf4-4793-ba5d-e2b3a43c5f98 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.164123 Aug 24 06:36:20.093249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1087/2165] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:36:20.346648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-40eca5e9-6412-45ee-902f-9c35110ca67a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:20.347294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-40eca5e9-6412-45ee-902f-9c35110ca67a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:20.353363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40eca5e9-6412-45ee-902f-9c35110ca67a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:20.353843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40eca5e9-6412-45ee-902f-9c35110ca67a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:20.354277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40eca5e9-6412-45ee-902f-9c35110ca67a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:20.354957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40eca5e9-6412-45ee-902f-9c35110ca67a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:20.355405 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40eca5e9-6412-45ee-902f-9c35110ca67a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:20.355823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-40eca5e9-6412-45ee-902f-9c35110ca67a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:20.485981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-40eca5e9-6412-45ee-902f-9c35110ca67a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:20.494515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-40eca5e9-6412-45ee-902f-9c35110ca67a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151831 Aug 24 06:36:20.495081 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1079/2166] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:20 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:20.977902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-44fd2154-2b73-40cf-bad8-a6f39575ab5b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:20.978502 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-44fd2154-2b73-40cf-bad8-a6f39575ab5b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:20.985030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44fd2154-2b73-40cf-bad8-a6f39575ab5b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:20.985512 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44fd2154-2b73-40cf-bad8-a6f39575ab5b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:20.985946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44fd2154-2b73-40cf-bad8-a6f39575ab5b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:20.986634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44fd2154-2b73-40cf-bad8-a6f39575ab5b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:20.987088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44fd2154-2b73-40cf-bad8-a6f39575ab5b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:20.987512 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44fd2154-2b73-40cf-bad8-a6f39575ab5b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:21.051191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-44fd2154-2b73-40cf-bad8-a6f39575ab5b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:21.059765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-44fd2154-2b73-40cf-bad8-a6f39575ab5b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.085490 Aug 24 06:36:21.060341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1088/2167] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:21.116738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:21.117341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:21.124009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:21.124483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:21.124977 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:21.125669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:21.126117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:21.126537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:21.256046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:21.264884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:21.266382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:21.267526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-abd33faf-2b43-4242-9e4b-d4b7ddbb6ea8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155480 Aug 24 06:36:21.268091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1080/2168] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:21.516481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7f806b6a-d53b-4ca5-87dd-bfbe9219d4bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:21.517040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7f806b6a-d53b-4ca5-87dd-bfbe9219d4bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:21.523711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f806b6a-d53b-4ca5-87dd-bfbe9219d4bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:21.524190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f806b6a-d53b-4ca5-87dd-bfbe9219d4bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:21.524660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f806b6a-d53b-4ca5-87dd-bfbe9219d4bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:21.525352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f806b6a-d53b-4ca5-87dd-bfbe9219d4bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:21.525802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f806b6a-d53b-4ca5-87dd-bfbe9219d4bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:21.526222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7f806b6a-d53b-4ca5-87dd-bfbe9219d4bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:21.659230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7f806b6a-d53b-4ca5-87dd-bfbe9219d4bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:21.668389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7f806b6a-d53b-4ca5-87dd-bfbe9219d4bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155825 Aug 24 06:36:21.669016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1089/2169] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:21 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:22.080044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2787e7f0-43b1-4fa0-b534-eafd6a7290ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:22.080813 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2787e7f0-43b1-4fa0-b534-eafd6a7290ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:22.087508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2787e7f0-43b1-4fa0-b534-eafd6a7290ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:22.088001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2787e7f0-43b1-4fa0-b534-eafd6a7290ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:22.088437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2787e7f0-43b1-4fa0-b534-eafd6a7290ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:22.089250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2787e7f0-43b1-4fa0-b534-eafd6a7290ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:22.089702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2787e7f0-43b1-4fa0-b534-eafd6a7290ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:22.090123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2787e7f0-43b1-4fa0-b534-eafd6a7290ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:22.153746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2787e7f0-43b1-4fa0-b534-eafd6a7290ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:22.162774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2787e7f0-43b1-4fa0-b534-eafd6a7290ee tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086699 Aug 24 06:36:22.163353 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1081/2170] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:22.291775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:22.292378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:22.299375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:22.299857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:22.300292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:22.301017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:22.301465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:22.301884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:22.431355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:22.440699 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:22.442224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:22.443397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9f30e00a-ec9d-4c54-960f-fa1226ae827e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155718 Aug 24 06:36:22.443961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1090/2171] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:22 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:22.691955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-191d192c-9b46-4f23-86fd-96ed6abafbaf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:22.692594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-191d192c-9b46-4f23-86fd-96ed6abafbaf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:22.699286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-191d192c-9b46-4f23-86fd-96ed6abafbaf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:22.704091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-191d192c-9b46-4f23-86fd-96ed6abafbaf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:22.704091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-191d192c-9b46-4f23-86fd-96ed6abafbaf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:22.704091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-191d192c-9b46-4f23-86fd-96ed6abafbaf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:22.704091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-191d192c-9b46-4f23-86fd-96ed6abafbaf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:22.704451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-191d192c-9b46-4f23-86fd-96ed6abafbaf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:22.835801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-191d192c-9b46-4f23-86fd-96ed6abafbaf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:22.844259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-191d192c-9b46-4f23-86fd-96ed6abafbaf tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157704 Aug 24 06:36:22.844852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1082/2172] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:22 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:23.187678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-34933d7c-bf95-4195-b42f-e403df58ff8f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:23.188292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-34933d7c-bf95-4195-b42f-e403df58ff8f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:23.194759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34933d7c-bf95-4195-b42f-e403df58ff8f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:23.195249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34933d7c-bf95-4195-b42f-e403df58ff8f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:23.195690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34933d7c-bf95-4195-b42f-e403df58ff8f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:23.196399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34933d7c-bf95-4195-b42f-e403df58ff8f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:23.196877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34933d7c-bf95-4195-b42f-e403df58ff8f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:23.197302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-34933d7c-bf95-4195-b42f-e403df58ff8f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:23.259346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-34933d7c-bf95-4195-b42f-e403df58ff8f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:23.267576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-34933d7c-bf95-4195-b42f-e403df58ff8f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084061 Aug 24 06:36:23.268166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1091/2173] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:23 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:23.467407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:23.467963 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:23.475102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:23.475579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:23.476011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:23.476733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:23.477187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:23.477610 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:23.603821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:23.612408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:23.614515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:23.615667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-896620ac-47b9-4f33-b490-1a691a05dedb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.152321 Aug 24 06:36:23.616222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1083/2174] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:23.864591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e332a166-5334-48aa-9980-a758ff76cb9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:23.865150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e332a166-5334-48aa-9980-a758ff76cb9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:23.871728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e332a166-5334-48aa-9980-a758ff76cb9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:23.872223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e332a166-5334-48aa-9980-a758ff76cb9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:23.872713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e332a166-5334-48aa-9980-a758ff76cb9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:23.873439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e332a166-5334-48aa-9980-a758ff76cb9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:23.873893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e332a166-5334-48aa-9980-a758ff76cb9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:23.874343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e332a166-5334-48aa-9980-a758ff76cb9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:24.011619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e332a166-5334-48aa-9980-a758ff76cb9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:24.020890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e332a166-5334-48aa-9980-a758ff76cb9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.160174 Aug 24 06:36:24.021474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1092/2175] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:23 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:24.288858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6f8c7259-00bb-4c48-92c1-1ba833481d05 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:24.289474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6f8c7259-00bb-4c48-92c1-1ba833481d05 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:24.295420 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f8c7259-00bb-4c48-92c1-1ba833481d05 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:24.295891 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f8c7259-00bb-4c48-92c1-1ba833481d05 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:24.296322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f8c7259-00bb-4c48-92c1-1ba833481d05 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:24.297031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f8c7259-00bb-4c48-92c1-1ba833481d05 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:24.297484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f8c7259-00bb-4c48-92c1-1ba833481d05 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:24.297906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6f8c7259-00bb-4c48-92c1-1ba833481d05 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:24.300406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:24.358847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6f8c7259-00bb-4c48-92c1-1ba833481d05 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:24.367544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6f8c7259-00bb-4c48-92c1-1ba833481d05 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082517 Aug 24 06:36:24.368106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1084/2176] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:24.637681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:24.638192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:24.640046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=80 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:24.644997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:24.645483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:24.645954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:24.646660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:24.647167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:24.647591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:24.778724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:24.787872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:24.789407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:24.790556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b1bcd2d6-cfe4-4542-bee4-63150644aafc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156845 Aug 24 06:36:24.791119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1093/2177] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:25.041838 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-03339487-65f9-4b8b-8edb-37ed978d0b97 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:25.147727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-03339487-65f9-4b8b-8edb-37ed978d0b97 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:25.147727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03339487-65f9-4b8b-8edb-37ed978d0b97 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:25.147727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03339487-65f9-4b8b-8edb-37ed978d0b97 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:25.147727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03339487-65f9-4b8b-8edb-37ed978d0b97 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:25.148486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03339487-65f9-4b8b-8edb-37ed978d0b97 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:25.148486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03339487-65f9-4b8b-8edb-37ed978d0b97 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:25.148486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03339487-65f9-4b8b-8edb-37ed978d0b97 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:25.196871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-03339487-65f9-4b8b-8edb-37ed978d0b97 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:25.205139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-03339487-65f9-4b8b-8edb-37ed978d0b97 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.167356 Aug 24 06:36:25.205716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1085/2178] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:25 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:25.389073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4eea7db0-f490-4ae1-86b0-bcba3b56e7ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:25.389640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4eea7db0-f490-4ae1-86b0-bcba3b56e7ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:25.396686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4eea7db0-f490-4ae1-86b0-bcba3b56e7ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:25.397174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4eea7db0-f490-4ae1-86b0-bcba3b56e7ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:25.397608 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4eea7db0-f490-4ae1-86b0-bcba3b56e7ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:25.398302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4eea7db0-f490-4ae1-86b0-bcba3b56e7ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:25.398751 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4eea7db0-f490-4ae1-86b0-bcba3b56e7ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:25.399171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4eea7db0-f490-4ae1-86b0-bcba3b56e7ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:25.460389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4eea7db0-f490-4ae1-86b0-bcba3b56e7ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:25.468557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4eea7db0-f490-4ae1-86b0-bcba3b56e7ec tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083535 Aug 24 06:36:25.469121 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1094/2179] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:25 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:25.813051 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:25.813655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:25.820117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:25.820631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:25.821060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:25.821736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:25.822182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:25.822596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:25.952828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:25.961692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:25.963129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:25.964289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6dc7f7c3-4712-4010-83bc-dba29716d380 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155478 Aug 24 06:36:25.965230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1086/2180] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:26.226940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c4fc88d0-3481-4c9d-a4bd-fc956ef3ad6d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:26.227460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c4fc88d0-3481-4c9d-a4bd-fc956ef3ad6d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:26.233468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4fc88d0-3481-4c9d-a4bd-fc956ef3ad6d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:26.233949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4fc88d0-3481-4c9d-a4bd-fc956ef3ad6d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:26.234381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4fc88d0-3481-4c9d-a4bd-fc956ef3ad6d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:26.235068 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4fc88d0-3481-4c9d-a4bd-fc956ef3ad6d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:26.235518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4fc88d0-3481-4c9d-a4bd-fc956ef3ad6d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:26.235935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c4fc88d0-3481-4c9d-a4bd-fc956ef3ad6d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:26.366560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c4fc88d0-3481-4c9d-a4bd-fc956ef3ad6d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:26.368800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:26.375366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c4fc88d0-3481-4c9d-a4bd-fc956ef3ad6d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.152413 Aug 24 06:36:26.375932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1095/2181] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:26 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:26.490604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-db621dd6-d119-48f9-9adc-04f42ca823e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:26.491153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-db621dd6-d119-48f9-9adc-04f42ca823e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:26.497509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db621dd6-d119-48f9-9adc-04f42ca823e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:26.497980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db621dd6-d119-48f9-9adc-04f42ca823e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:26.498408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db621dd6-d119-48f9-9adc-04f42ca823e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:26.499077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db621dd6-d119-48f9-9adc-04f42ca823e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:26.499519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db621dd6-d119-48f9-9adc-04f42ca823e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:26.499932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db621dd6-d119-48f9-9adc-04f42ca823e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:26.560812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-db621dd6-d119-48f9-9adc-04f42ca823e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:26.569056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-db621dd6-d119-48f9-9adc-04f42ca823e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083055 Aug 24 06:36:26.569612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1087/2182] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:26.987748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:26.988414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:26.995323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:26.995802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:26.996232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:26.996953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:26.997400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:26.997821 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:27.125418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:27.138763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:27.140316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:27.141547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-92204f45-4eb6-448a-a53f-b90fc9d421a8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157707 Aug 24 06:36:27.142100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1096/2183] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:27.396910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ae7e0f7f-8a05-49a8-9971-aa29db7aa258 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:27.397457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ae7e0f7f-8a05-49a8-9971-aa29db7aa258 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:27.403421 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae7e0f7f-8a05-49a8-9971-aa29db7aa258 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:27.403896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae7e0f7f-8a05-49a8-9971-aa29db7aa258 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:27.404323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae7e0f7f-8a05-49a8-9971-aa29db7aa258 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:27.405025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae7e0f7f-8a05-49a8-9971-aa29db7aa258 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:27.405472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae7e0f7f-8a05-49a8-9971-aa29db7aa258 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:27.405883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ae7e0f7f-8a05-49a8-9971-aa29db7aa258 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:27.536547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ae7e0f7f-8a05-49a8-9971-aa29db7aa258 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:27.545330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ae7e0f7f-8a05-49a8-9971-aa29db7aa258 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.152448 Aug 24 06:36:27.546076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1088/2184] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:27 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:27.590396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e8e9a3a5-0c9c-475a-859c-ff3334aa87e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:27.591044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e8e9a3a5-0c9c-475a-859c-ff3334aa87e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:27.597352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e9a3a5-0c9c-475a-859c-ff3334aa87e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:27.600606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e9a3a5-0c9c-475a-859c-ff3334aa87e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:27.600606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e9a3a5-0c9c-475a-859c-ff3334aa87e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:27.600606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e9a3a5-0c9c-475a-859c-ff3334aa87e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:27.600606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e9a3a5-0c9c-475a-859c-ff3334aa87e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:27.601040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e8e9a3a5-0c9c-475a-859c-ff3334aa87e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:27.662842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e8e9a3a5-0c9c-475a-859c-ff3334aa87e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:27.671777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e8e9a3a5-0c9c-475a-859c-ff3334aa87e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084780 Aug 24 06:36:27.671777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1097/2185] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:28.166052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:28.166689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:28.172959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:28.173439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:28.173864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:28.174565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:28.175010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:28.175426 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:28.307882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:28.316863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:28.318365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:28.319519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-557c6995-ff9f-4a79-9a5b-8c50f0b40e7c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157725 Aug 24 06:36:28.320080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1089/2186] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:28 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:28.568433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-511a6a10-9525-4442-a47e-102618890fc0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:28.569038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-511a6a10-9525-4442-a47e-102618890fc0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:28.575443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-511a6a10-9525-4442-a47e-102618890fc0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:28.575923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-511a6a10-9525-4442-a47e-102618890fc0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:28.576354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-511a6a10-9525-4442-a47e-102618890fc0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:28.577245 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-511a6a10-9525-4442-a47e-102618890fc0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:28.577649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-511a6a10-9525-4442-a47e-102618890fc0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:28.578072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-511a6a10-9525-4442-a47e-102618890fc0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:28.693570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4a8a3fdb-8960-4e1e-834a-4492c60723f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:28.694189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4a8a3fdb-8960-4e1e-834a-4492c60723f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:28.700749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8a3fdb-8960-4e1e-834a-4492c60723f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:28.701226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8a3fdb-8960-4e1e-834a-4492c60723f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:28.701646 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8a3fdb-8960-4e1e-834a-4492c60723f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:28.702336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8a3fdb-8960-4e1e-834a-4492c60723f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:28.702779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8a3fdb-8960-4e1e-834a-4492c60723f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:28.703197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8a3fdb-8960-4e1e-834a-4492c60723f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:28.711531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-511a6a10-9525-4442-a47e-102618890fc0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:28.719832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-511a6a10-9525-4442-a47e-102618890fc0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155876 Aug 24 06:36:28.720399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1098/2187] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:28 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:28.769835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4a8a3fdb-8960-4e1e-834a-4492c60723f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:28.778074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4a8a3fdb-8960-4e1e-834a-4492c60723f7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088961 Aug 24 06:36:28.778638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1090/2188] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:28 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:29.342965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:29.343575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:29.350138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:29.350619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:29.351055 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:29.351742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:29.352190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:29.352660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:29.480212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:29.489627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:29.491161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:29.492308 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-da585a2f-82de-46d2-bbbc-8872ea7de1bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.153348 Aug 24 06:36:29.492898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1099/2189] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:29 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:29.741239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-32264d7f-97a3-4d62-a1ba-c299f0276e39 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:29.741779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-32264d7f-97a3-4d62-a1ba-c299f0276e39 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:29.748183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32264d7f-97a3-4d62-a1ba-c299f0276e39 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:29.748715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32264d7f-97a3-4d62-a1ba-c299f0276e39 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:29.749154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32264d7f-97a3-4d62-a1ba-c299f0276e39 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:29.749842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32264d7f-97a3-4d62-a1ba-c299f0276e39 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:29.750298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32264d7f-97a3-4d62-a1ba-c299f0276e39 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:29.750723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-32264d7f-97a3-4d62-a1ba-c299f0276e39 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:29.799179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bc804f3d-17e5-4a06-acc2-a3c7d2f172d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:29.799786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bc804f3d-17e5-4a06-acc2-a3c7d2f172d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:29.806261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc804f3d-17e5-4a06-acc2-a3c7d2f172d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:29.806771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc804f3d-17e5-4a06-acc2-a3c7d2f172d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:29.807196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc804f3d-17e5-4a06-acc2-a3c7d2f172d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:29.807879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc804f3d-17e5-4a06-acc2-a3c7d2f172d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:29.808322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc804f3d-17e5-4a06-acc2-a3c7d2f172d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:29.808760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bc804f3d-17e5-4a06-acc2-a3c7d2f172d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:29.871182 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bc804f3d-17e5-4a06-acc2-a3c7d2f172d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:29.879904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bc804f3d-17e5-4a06-acc2-a3c7d2f172d2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084548 Aug 24 06:36:29.880513 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1100/2190] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:29.880681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-32264d7f-97a3-4d62-a1ba-c299f0276e39 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:29.889038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-32264d7f-97a3-4d62-a1ba-c299f0276e39 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.151748 Aug 24 06:36:29.889887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1091/2191] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:29 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:30.515590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:30.516182 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:30.522725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:30.523236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:30.523665 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:30.524414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:30.524881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:30.525305 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:30.655604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:30.664854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:30.666374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:30.667504 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-201cccbb-6c51-4a17-ae67-04028fd28008 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156012 Aug 24 06:36:30.668056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1101/2192] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:30.904791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c8ec643b-06ed-444a-8a3a-d61620e9c284 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:30.905423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c8ec643b-06ed-444a-8a3a-d61620e9c284 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:30.910226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a417b13a-c090-4151-83bc-47fe13354b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:30.910991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a417b13a-c090-4151-83bc-47fe13354b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:30.912127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ec643b-06ed-444a-8a3a-d61620e9c284 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:30.912668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ec643b-06ed-444a-8a3a-d61620e9c284 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:30.913099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ec643b-06ed-444a-8a3a-d61620e9c284 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:30.913826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ec643b-06ed-444a-8a3a-d61620e9c284 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:30.914275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ec643b-06ed-444a-8a3a-d61620e9c284 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:30.914775 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c8ec643b-06ed-444a-8a3a-d61620e9c284 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:30.917621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a417b13a-c090-4151-83bc-47fe13354b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:30.918095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a417b13a-c090-4151-83bc-47fe13354b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:30.918525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a417b13a-c090-4151-83bc-47fe13354b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:30.919218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a417b13a-c090-4151-83bc-47fe13354b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:30.919664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a417b13a-c090-4151-83bc-47fe13354b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:30.920175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a417b13a-c090-4151-83bc-47fe13354b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:30.976961 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c8ec643b-06ed-444a-8a3a-d61620e9c284 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:30.985265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c8ec643b-06ed-444a-8a3a-d61620e9c284 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.084519 Aug 24 06:36:30.985847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1092/2193] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:31.047934 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a417b13a-c090-4151-83bc-47fe13354b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:31.056231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a417b13a-c090-4151-83bc-47fe13354b2d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.149887 Aug 24 06:36:31.056831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1102/2194] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:30 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:31.691221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:31.691818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:31.697869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:31.698341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:31.698766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:31.699443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:31.699888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:31.700301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:31.830813 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:31.840180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:31.841711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:31.842880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f9984f2b-14b4-4c31-86d8-3c993c30b957 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156137 Aug 24 06:36:31.843432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1093/2195] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:32.005885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ef0d5f23-cf16-41d8-a444-eb52cd74dfae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:32.006454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ef0d5f23-cf16-41d8-a444-eb52cd74dfae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:32.012913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef0d5f23-cf16-41d8-a444-eb52cd74dfae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:32.013384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef0d5f23-cf16-41d8-a444-eb52cd74dfae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:32.013807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef0d5f23-cf16-41d8-a444-eb52cd74dfae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:32.014488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef0d5f23-cf16-41d8-a444-eb52cd74dfae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:32.014932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef0d5f23-cf16-41d8-a444-eb52cd74dfae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:32.015348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ef0d5f23-cf16-41d8-a444-eb52cd74dfae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:32.077918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-254178ed-969b-46ca-ae36-7ade84d2adf7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:32.078709 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-254178ed-969b-46ca-ae36-7ade84d2adf7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:32.079298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ef0d5f23-cf16-41d8-a444-eb52cd74dfae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:32.085642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254178ed-969b-46ca-ae36-7ade84d2adf7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:32.086123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254178ed-969b-46ca-ae36-7ade84d2adf7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:32.086548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254178ed-969b-46ca-ae36-7ade84d2adf7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:32.087229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254178ed-969b-46ca-ae36-7ade84d2adf7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:32.087674 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254178ed-969b-46ca-ae36-7ade84d2adf7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:32.088025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ef0d5f23-cf16-41d8-a444-eb52cd74dfae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086078 Aug 24 06:36:32.088146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254178ed-969b-46ca-ae36-7ade84d2adf7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:32.088624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1103/2196] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:32.214601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-254178ed-969b-46ca-ae36-7ade84d2adf7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:32.223264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-254178ed-969b-46ca-ae36-7ade84d2adf7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.149173 Aug 24 06:36:32.223829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1094/2197] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:32 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:32.865987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:32.866585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:32.872708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:32.873181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:32.873607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:32.874365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:32.874827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:32.875225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:33.006902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:33.016429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:33.017968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:33.019763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-05a9e008-03e0-4930-b0d9-06022df71295 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157828 Aug 24 06:36:33.020323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1104/2198] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:33.108551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-38460857-a11e-4e09-b43a-b3afdf677ba1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:33.109158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-38460857-a11e-4e09-b43a-b3afdf677ba1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:33.115299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38460857-a11e-4e09-b43a-b3afdf677ba1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:33.115774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38460857-a11e-4e09-b43a-b3afdf677ba1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:33.116201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38460857-a11e-4e09-b43a-b3afdf677ba1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:33.116915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38460857-a11e-4e09-b43a-b3afdf677ba1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:33.117365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38460857-a11e-4e09-b43a-b3afdf677ba1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:33.117780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38460857-a11e-4e09-b43a-b3afdf677ba1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:33.178504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-38460857-a11e-4e09-b43a-b3afdf677ba1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:33.187065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-38460857-a11e-4e09-b43a-b3afdf677ba1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.082373 Aug 24 06:36:33.187633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1095/2199] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:33.244362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b53fd35f-4113-4059-995d-a5a552246dca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:33.244991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b53fd35f-4113-4059-995d-a5a552246dca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:33.250990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b53fd35f-4113-4059-995d-a5a552246dca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:33.251463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b53fd35f-4113-4059-995d-a5a552246dca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:33.251887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b53fd35f-4113-4059-995d-a5a552246dca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:33.252597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b53fd35f-4113-4059-995d-a5a552246dca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:33.253737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b53fd35f-4113-4059-995d-a5a552246dca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:33.254489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b53fd35f-4113-4059-995d-a5a552246dca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:33.382753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b53fd35f-4113-4059-995d-a5a552246dca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:33.390908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b53fd35f-4113-4059-995d-a5a552246dca tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150353 Aug 24 06:36:33.391732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1105/2200] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:33 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:34.042372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:34.042984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:34.049285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:34.050392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:34.050832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:34.051549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:34.052006 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:34.052432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:34.185051 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:34.194075 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:34.195579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:34.196785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2e817147-97d7-4e25-8c9f-f103ba6c3fd2 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158390 Aug 24 06:36:34.197337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1096/2201] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:34 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:34.207587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4b57a183-761c-49ff-9840-907de5340822 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:34.208235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4b57a183-761c-49ff-9840-907de5340822 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:34.214880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b57a183-761c-49ff-9840-907de5340822 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:34.215388 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b57a183-761c-49ff-9840-907de5340822 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:34.215828 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b57a183-761c-49ff-9840-907de5340822 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:34.216549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b57a183-761c-49ff-9840-907de5340822 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:34.217078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b57a183-761c-49ff-9840-907de5340822 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:34.217429 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4b57a183-761c-49ff-9840-907de5340822 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:34.282508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4b57a183-761c-49ff-9840-907de5340822 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:34.291016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4b57a183-761c-49ff-9840-907de5340822 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087773 Aug 24 06:36:34.291588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1106/2202] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:34 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:34.413478 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d06335cb-520f-4b0d-bee6-ed01bdcb1967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:34.414092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d06335cb-520f-4b0d-bee6-ed01bdcb1967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:34.420076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d06335cb-520f-4b0d-bee6-ed01bdcb1967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:34.420588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d06335cb-520f-4b0d-bee6-ed01bdcb1967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:34.421023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d06335cb-520f-4b0d-bee6-ed01bdcb1967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:34.421711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d06335cb-520f-4b0d-bee6-ed01bdcb1967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:34.422160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d06335cb-520f-4b0d-bee6-ed01bdcb1967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:34.422579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d06335cb-520f-4b0d-bee6-ed01bdcb1967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:34.549280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d06335cb-520f-4b0d-bee6-ed01bdcb1967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:34.557455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d06335cb-520f-4b0d-bee6-ed01bdcb1967 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.148550 Aug 24 06:36:34.558274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1097/2203] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:34 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:35.219529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:35.220138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:35.227297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:35.227771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:35.228205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:35.228928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:35.229380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:35.229799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:35.312335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9c7041bc-b76e-4117-879d-d3dea02cbed7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:35.312983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9c7041bc-b76e-4117-879d-d3dea02cbed7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:35.319578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c7041bc-b76e-4117-879d-d3dea02cbed7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:35.320065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c7041bc-b76e-4117-879d-d3dea02cbed7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:35.320518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c7041bc-b76e-4117-879d-d3dea02cbed7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:35.321223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c7041bc-b76e-4117-879d-d3dea02cbed7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:35.321686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c7041bc-b76e-4117-879d-d3dea02cbed7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:35.322109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c7041bc-b76e-4117-879d-d3dea02cbed7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:35.361190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:35.370280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:35.371790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:35.373005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-03f1bb8d-b3d8-4476-8ff6-7e4d69b12a91 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157458 Aug 24 06:36:35.373575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1107/2204] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:35.567510 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9c7041bc-b76e-4117-879d-d3dea02cbed7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:35.576142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9c7041bc-b76e-4117-879d-d3dea02cbed7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.268549 Aug 24 06:36:35.576745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1098/2205] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:35.579198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4f314373-df2a-40a8-be86-e4a7922968bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:35.579802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4f314373-df2a-40a8-be86-e4a7922968bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:35.586456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f314373-df2a-40a8-be86-e4a7922968bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:35.586931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f314373-df2a-40a8-be86-e4a7922968bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:35.587355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f314373-df2a-40a8-be86-e4a7922968bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:35.588043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f314373-df2a-40a8-be86-e4a7922968bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:35.588485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f314373-df2a-40a8-be86-e4a7922968bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:35.588922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f314373-df2a-40a8-be86-e4a7922968bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:35.720995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4f314373-df2a-40a8-be86-e4a7922968bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:35.729463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4f314373-df2a-40a8-be86-e4a7922968bb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.154063 Aug 24 06:36:35.730047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1108/2206] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:35 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:36.397056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:36.397696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:36.404152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:36.404681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:36.405113 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:36.405799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:36.406255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:36.406675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:36.544977 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:36.555039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:36.556538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:36.557753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-758da321-c69d-4249-a411-bfeba3c74c5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.164617 Aug 24 06:36:36.558306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1099/2207] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:36.597644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-eb50dc10-608a-4711-ba3c-0b321f6bc4b1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:36.598296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-eb50dc10-608a-4711-ba3c-0b321f6bc4b1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:36.604770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb50dc10-608a-4711-ba3c-0b321f6bc4b1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:36.605246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb50dc10-608a-4711-ba3c-0b321f6bc4b1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:36.605674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb50dc10-608a-4711-ba3c-0b321f6bc4b1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:36.606364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb50dc10-608a-4711-ba3c-0b321f6bc4b1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:36.606807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb50dc10-608a-4711-ba3c-0b321f6bc4b1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:36.607220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb50dc10-608a-4711-ba3c-0b321f6bc4b1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:36.673196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-eb50dc10-608a-4711-ba3c-0b321f6bc4b1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:36.687173 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-eb50dc10-608a-4711-ba3c-0b321f6bc4b1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093513 Aug 24 06:36:36.687755 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1109/2208] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:36 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:36.751094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2690ef13-7336-4822-93dc-399e2810582f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:36.751715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2690ef13-7336-4822-93dc-399e2810582f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:36.758143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2690ef13-7336-4822-93dc-399e2810582f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:36.758624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2690ef13-7336-4822-93dc-399e2810582f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:36.759057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2690ef13-7336-4822-93dc-399e2810582f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:36.759757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2690ef13-7336-4822-93dc-399e2810582f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:36.760207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2690ef13-7336-4822-93dc-399e2810582f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:36.760666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2690ef13-7336-4822-93dc-399e2810582f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:36.900898 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2690ef13-7336-4822-93dc-399e2810582f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:36.903288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:36.911143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2690ef13-7336-4822-93dc-399e2810582f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.163848 Aug 24 06:36:36.911741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1100/2209] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:36 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:37.583474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:37.584638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:37.592023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:37.592534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:37.592978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:37.593685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:37.594144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:37.594579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:37.715314 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5e8ddecb-2642-4643-8634-f45374fc8674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:37.716745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5e8ddecb-2642-4643-8634-f45374fc8674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:37.728680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ddecb-2642-4643-8634-f45374fc8674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:37.729468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ddecb-2642-4643-8634-f45374fc8674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:37.730166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ddecb-2642-4643-8634-f45374fc8674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:37.731342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ddecb-2642-4643-8634-f45374fc8674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:37.732086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ddecb-2642-4643-8634-f45374fc8674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:37.732836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5e8ddecb-2642-4643-8634-f45374fc8674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:37.841534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5e8ddecb-2642-4643-8634-f45374fc8674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:37.857257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5e8ddecb-2642-4643-8634-f45374fc8674 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.148520 Aug 24 06:36:37.858266 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1101/2210] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:37.941173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-80861a10-8db5-47d3-878b-eb2a850336fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:37.942306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-80861a10-8db5-47d3-878b-eb2a850336fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:37.959056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80861a10-8db5-47d3-878b-eb2a850336fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:37.959336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80861a10-8db5-47d3-878b-eb2a850336fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:37.960650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80861a10-8db5-47d3-878b-eb2a850336fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:37.962169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80861a10-8db5-47d3-878b-eb2a850336fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:37.963212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80861a10-8db5-47d3-878b-eb2a850336fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:37.964902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-80861a10-8db5-47d3-878b-eb2a850336fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:38.087054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:38.103401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:38.106350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:38.108609 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b4ad08f5-45be-470b-a834-f0babbd9ee1b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.530317 Aug 24 06:36:38.129010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1110/2211] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:38.188190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-80861a10-8db5-47d3-878b-eb2a850336fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:38.196731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-80861a10-8db5-47d3-878b-eb2a850336fc tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.265793 Aug 24 06:36:38.197313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1102/2212] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:37 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:38.889780 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-07dd63cb-5e0d-4181-af19-35bfc554bb39 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:38.890543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-07dd63cb-5e0d-4181-af19-35bfc554bb39 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:38.897826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dd63cb-5e0d-4181-af19-35bfc554bb39 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:38.898312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dd63cb-5e0d-4181-af19-35bfc554bb39 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:38.898757 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dd63cb-5e0d-4181-af19-35bfc554bb39 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:38.899433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dd63cb-5e0d-4181-af19-35bfc554bb39 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:38.899873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dd63cb-5e0d-4181-af19-35bfc554bb39 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:38.900288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dd63cb-5e0d-4181-af19-35bfc554bb39 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:38.968659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-07dd63cb-5e0d-4181-af19-35bfc554bb39 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:38.984155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-07dd63cb-5e0d-4181-af19-35bfc554bb39 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.098094 Aug 24 06:36:38.985246 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1111/2213] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:38 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:39.146860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:39.147577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:39.154668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:39.155208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:39.155701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:39.156436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:39.156955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:39.157412 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:39.221956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-da777192-a0b0-4609-b0fe-bc9c6ad3ace6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:39.223032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-da777192-a0b0-4609-b0fe-bc9c6ad3ace6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:39.230461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da777192-a0b0-4609-b0fe-bc9c6ad3ace6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:39.231096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da777192-a0b0-4609-b0fe-bc9c6ad3ace6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:39.231727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da777192-a0b0-4609-b0fe-bc9c6ad3ace6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:39.232566 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da777192-a0b0-4609-b0fe-bc9c6ad3ace6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:39.233118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da777192-a0b0-4609-b0fe-bc9c6ad3ace6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:39.233635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-da777192-a0b0-4609-b0fe-bc9c6ad3ace6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:39.252045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:39.317268 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:39.326539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:39.328073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:39.329318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1e5ee39d-4c55-4bb4-9fa5-47ce261e0245 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.186502 Aug 24 06:36:39.329886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1103/2214] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:36:39.422990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-da777192-a0b0-4609-b0fe-bc9c6ad3ace6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:39.432344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-da777192-a0b0-4609-b0fe-bc9c6ad3ace6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.217540 Aug 24 06:36:39.432951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1112/2215] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:39 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:40.007087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-20061213-4bd8-405f-a4cd-2c70c9150d93 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:40.007610 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-20061213-4bd8-405f-a4cd-2c70c9150d93 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:40.013822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20061213-4bd8-405f-a4cd-2c70c9150d93 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:40.014306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20061213-4bd8-405f-a4cd-2c70c9150d93 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:40.014734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20061213-4bd8-405f-a4cd-2c70c9150d93 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:40.015425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20061213-4bd8-405f-a4cd-2c70c9150d93 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:40.015870 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20061213-4bd8-405f-a4cd-2c70c9150d93 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:40.016289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20061213-4bd8-405f-a4cd-2c70c9150d93 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:40.086926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-20061213-4bd8-405f-a4cd-2c70c9150d93 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:40.102162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-20061213-4bd8-405f-a4cd-2c70c9150d93 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.099183 Aug 24 06:36:40.103179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1104/2216] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:40 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:40.453914 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cb7665c1-ffea-4194-a004-82cebaa8997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:40.454972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cb7665c1-ffea-4194-a004-82cebaa8997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:40.461495 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb7665c1-ffea-4194-a004-82cebaa8997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:40.462081 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb7665c1-ffea-4194-a004-82cebaa8997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:40.462425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb7665c1-ffea-4194-a004-82cebaa8997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:40.463133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb7665c1-ffea-4194-a004-82cebaa8997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:40.463582 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb7665c1-ffea-4194-a004-82cebaa8997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:40.464009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb7665c1-ffea-4194-a004-82cebaa8997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:40.518767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:40.519857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:40.528547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:40.529100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:40.529582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:40.530416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:40.531172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:40.531695 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:40.647589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cb7665c1-ffea-4194-a004-82cebaa8997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:40.662515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cb7665c1-ffea-4194-a004-82cebaa8997e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.211947 Aug 24 06:36:40.663927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1105/2217] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:40 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:40.820307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:40.830336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:40.831938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:40.833170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d4f959f8-75c1-44ce-89d9-c3144f705fb0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.484302 Aug 24 06:36:40.833729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1113/2218] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:41.135564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-99fff1c4-2b8d-4298-a258-a254dbd4a5aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:41.136167 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-99fff1c4-2b8d-4298-a258-a254dbd4a5aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:41.142283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99fff1c4-2b8d-4298-a258-a254dbd4a5aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:41.142759 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99fff1c4-2b8d-4298-a258-a254dbd4a5aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:41.143212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99fff1c4-2b8d-4298-a258-a254dbd4a5aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:41.143895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99fff1c4-2b8d-4298-a258-a254dbd4a5aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:41.144339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99fff1c4-2b8d-4298-a258-a254dbd4a5aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:41.144785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-99fff1c4-2b8d-4298-a258-a254dbd4a5aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:41.212694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-99fff1c4-2b8d-4298-a258-a254dbd4a5aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:41.223847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-99fff1c4-2b8d-4298-a258-a254dbd4a5aa tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.091884 Aug 24 06:36:41.224775 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1106/2219] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:41 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:41.685870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9675d37b-d2aa-4142-bb7e-5090db336614 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:41.686779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9675d37b-d2aa-4142-bb7e-5090db336614 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:41.697559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9675d37b-d2aa-4142-bb7e-5090db336614 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:41.698431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9675d37b-d2aa-4142-bb7e-5090db336614 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:41.699200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9675d37b-d2aa-4142-bb7e-5090db336614 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:41.700413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9675d37b-d2aa-4142-bb7e-5090db336614 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:41.701251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9675d37b-d2aa-4142-bb7e-5090db336614 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:41.702000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9675d37b-d2aa-4142-bb7e-5090db336614 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:41.871686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:41.872907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:41.884686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:41.885600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:41.886394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:41.887721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:41.888611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:41.889401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:41.921933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9675d37b-d2aa-4142-bb7e-5090db336614 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:41.934819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9675d37b-d2aa-4142-bb7e-5090db336614 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.252008 Aug 24 06:36:41.944146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1114/2220] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:41 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:42.083343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:42.092699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:42.094212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:42.095393 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d3e1b65a-9586-4a49-8193-85a03805c351 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.229853 Aug 24 06:36:42.095953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1107/2221] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:41 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:42.357611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-50b7c590-4bc2-4baa-abed-6f6c513fc4f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:42.358219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-50b7c590-4bc2-4baa-abed-6f6c513fc4f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:42.364765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50b7c590-4bc2-4baa-abed-6f6c513fc4f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:42.365250 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50b7c590-4bc2-4baa-abed-6f6c513fc4f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:42.365679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50b7c590-4bc2-4baa-abed-6f6c513fc4f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:42.366396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50b7c590-4bc2-4baa-abed-6f6c513fc4f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:42.366849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50b7c590-4bc2-4baa-abed-6f6c513fc4f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:42.367270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50b7c590-4bc2-4baa-abed-6f6c513fc4f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:42.428847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-50b7c590-4bc2-4baa-abed-6f6c513fc4f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:42.437437 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-50b7c590-4bc2-4baa-abed-6f6c513fc4f3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.194142 Aug 24 06:36:42.438020 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1115/2222] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:42 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:42.956816 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-de1151da-cd9c-45e5-ba72-682a0e4c6598 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:42.957423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-de1151da-cd9c-45e5-ba72-682a0e4c6598 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:42.963992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de1151da-cd9c-45e5-ba72-682a0e4c6598 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:42.964406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de1151da-cd9c-45e5-ba72-682a0e4c6598 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:42.964866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de1151da-cd9c-45e5-ba72-682a0e4c6598 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:42.965556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de1151da-cd9c-45e5-ba72-682a0e4c6598 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:42.966004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de1151da-cd9c-45e5-ba72-682a0e4c6598 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:42.966419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-de1151da-cd9c-45e5-ba72-682a0e4c6598 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:43.097440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-de1151da-cd9c-45e5-ba72-682a0e4c6598 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:43.105614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-de1151da-cd9c-45e5-ba72-682a0e4c6598 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153625 Aug 24 06:36:43.106176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1108/2223] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:42 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:43.118767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:43.119454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:43.126397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:43.126881 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:43.127305 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:43.128584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:43.129031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:43.129447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:43.260478 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:43.269769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:43.271253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:43.272395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3059e4f5-dbe5-4d19-af22-c0995d7a3de1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157485 Aug 24 06:36:43.273028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1116/2224] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:43.459242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c411acb2-55ca-4425-99ff-50ca1edb389b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:43.459845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c411acb2-55ca-4425-99ff-50ca1edb389b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:43.465898 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c411acb2-55ca-4425-99ff-50ca1edb389b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:43.466367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c411acb2-55ca-4425-99ff-50ca1edb389b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:43.466787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c411acb2-55ca-4425-99ff-50ca1edb389b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:43.467462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c411acb2-55ca-4425-99ff-50ca1edb389b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:43.467916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c411acb2-55ca-4425-99ff-50ca1edb389b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:43.468317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c411acb2-55ca-4425-99ff-50ca1edb389b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:43.529495 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c411acb2-55ca-4425-99ff-50ca1edb389b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:43.538210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c411acb2-55ca-4425-99ff-50ca1edb389b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083219 Aug 24 06:36:43.538780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1109/2225] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:43 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:44.128359 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4bed9125-c348-416e-ad2c-c74a01defc1f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:44.128972 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4bed9125-c348-416e-ad2c-c74a01defc1f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:44.135495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4bed9125-c348-416e-ad2c-c74a01defc1f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:44.136007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4bed9125-c348-416e-ad2c-c74a01defc1f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:44.136432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4bed9125-c348-416e-ad2c-c74a01defc1f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:44.137225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4bed9125-c348-416e-ad2c-c74a01defc1f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:44.137675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4bed9125-c348-416e-ad2c-c74a01defc1f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:44.138095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4bed9125-c348-416e-ad2c-c74a01defc1f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:44.273388 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4bed9125-c348-416e-ad2c-c74a01defc1f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:44.281625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4bed9125-c348-416e-ad2c-c74a01defc1f tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157419 Aug 24 06:36:44.282193 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1117/2226] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:44 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:44.295673 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:44.296284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:44.303329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:44.303856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:44.304246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:44.304978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:44.305428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:44.305849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:44.446209 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:44.456043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:44.457586 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:44.458767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-56a10875-b682-43e8-ae9d-1b7d2d03ff99 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.167138 Aug 24 06:36:44.459330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1110/2227] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:36:44.560778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-060017ce-5af3-4df0-85be-041c0df78e22 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:44.561479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-060017ce-5af3-4df0-85be-041c0df78e22 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:44.568353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-060017ce-5af3-4df0-85be-041c0df78e22 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:44.568875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-060017ce-5af3-4df0-85be-041c0df78e22 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:44.569313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-060017ce-5af3-4df0-85be-041c0df78e22 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:44.570035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-060017ce-5af3-4df0-85be-041c0df78e22 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:44.570491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-060017ce-5af3-4df0-85be-041c0df78e22 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:44.570914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-060017ce-5af3-4df0-85be-041c0df78e22 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:44.641884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-060017ce-5af3-4df0-85be-041c0df78e22 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:44.650945 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-060017ce-5af3-4df0-85be-041c0df78e22 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.095069 Aug 24 06:36:44.651451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1118/2228] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:44 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:45.236180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:36:45.236835 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:36:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:36:45.302707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-11e693b6-8fa6-4f6a-ae7a-93b2c8ab8334 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:45.303321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-11e693b6-8fa6-4f6a-ae7a-93b2c8ab8334 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:45.309926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11e693b6-8fa6-4f6a-ae7a-93b2c8ab8334 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:45.310394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11e693b6-8fa6-4f6a-ae7a-93b2c8ab8334 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:45.310818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11e693b6-8fa6-4f6a-ae7a-93b2c8ab8334 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:45.311494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11e693b6-8fa6-4f6a-ae7a-93b2c8ab8334 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:45.311939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11e693b6-8fa6-4f6a-ae7a-93b2c8ab8334 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:45.312477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-11e693b6-8fa6-4f6a-ae7a-93b2c8ab8334 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:45.441246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-11e693b6-8fa6-4f6a-ae7a-93b2c8ab8334 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:45.449664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-11e693b6-8fa6-4f6a-ae7a-93b2c8ab8334 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150896 Aug 24 06:36:45.450239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1111/2229] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:45 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:45.480757 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:45.481299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:45.488314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:45.488823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:45.489258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:45.489944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:45.490395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:45.490818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:45.620900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:45.630161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:45.631659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:45.632830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-810e48b7-c0b8-4ef9-be4a-71fdf37875d5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156047 Aug 24 06:36:45.633385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1119/2230] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:45.671402 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2f16ef19-0482-413a-b0a4-7d8b1ebf626f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:45.672008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2f16ef19-0482-413a-b0a4-7d8b1ebf626f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:45.678423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f16ef19-0482-413a-b0a4-7d8b1ebf626f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:45.678896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f16ef19-0482-413a-b0a4-7d8b1ebf626f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:45.679335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f16ef19-0482-413a-b0a4-7d8b1ebf626f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:45.679992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f16ef19-0482-413a-b0a4-7d8b1ebf626f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:45.680734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f16ef19-0482-413a-b0a4-7d8b1ebf626f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:45.681147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f16ef19-0482-413a-b0a4-7d8b1ebf626f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:45.743146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2f16ef19-0482-413a-b0a4-7d8b1ebf626f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:45.751256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2f16ef19-0482-413a-b0a4-7d8b1ebf626f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.083646 Aug 24 06:36:45.751806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1112/2231] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:45 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:45.842267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:36:45.842484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:36:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:36:46.470016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f6cc5688-2532-4616-ad9d-feebbeed88a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:46.470599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f6cc5688-2532-4616-ad9d-feebbeed88a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:46.477116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6cc5688-2532-4616-ad9d-feebbeed88a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:46.477598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6cc5688-2532-4616-ad9d-feebbeed88a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:46.478030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6cc5688-2532-4616-ad9d-feebbeed88a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:46.478717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6cc5688-2532-4616-ad9d-feebbeed88a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:46.479163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6cc5688-2532-4616-ad9d-feebbeed88a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:46.479584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6cc5688-2532-4616-ad9d-feebbeed88a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:46.608715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f6cc5688-2532-4616-ad9d-feebbeed88a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:46.616976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f6cc5688-2532-4616-ad9d-feebbeed88a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.150879 Aug 24 06:36:46.617539 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1120/2232] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:46 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:46.655735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:46.656325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:46.662860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:46.663334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:46.663768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:46.664449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:46.664922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:46.665340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:46.772249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-03ada4c4-cad2-4853-9c37-eb97334c5540 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:46.772977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-03ada4c4-cad2-4853-9c37-eb97334c5540 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:46.779165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03ada4c4-cad2-4853-9c37-eb97334c5540 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:46.779742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03ada4c4-cad2-4853-9c37-eb97334c5540 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:46.780235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03ada4c4-cad2-4853-9c37-eb97334c5540 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:46.781028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03ada4c4-cad2-4853-9c37-eb97334c5540 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:46.781572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03ada4c4-cad2-4853-9c37-eb97334c5540 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:46.782058 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03ada4c4-cad2-4853-9c37-eb97334c5540 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:46.801120 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:46.810975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:46.812464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:46.813828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-43fa7701-9de6-4384-a1b1-fbe3031c424f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161982 Aug 24 06:36:46.816968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1113/2233] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:46.845796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03ada4c4-cad2-4853-9c37-eb97334c5540 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:46.855255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-03ada4c4-cad2-4853-9c37-eb97334c5540 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087277 Aug 24 06:36:46.855851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1121/2234] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:47.638312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c33038dc-ffb9-4a94-9078-05d5d2aeea48 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:47.638911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c33038dc-ffb9-4a94-9078-05d5d2aeea48 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:47.644920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c33038dc-ffb9-4a94-9078-05d5d2aeea48 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:47.645394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c33038dc-ffb9-4a94-9078-05d5d2aeea48 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:47.645821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c33038dc-ffb9-4a94-9078-05d5d2aeea48 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:47.646495 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c33038dc-ffb9-4a94-9078-05d5d2aeea48 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:47.646936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c33038dc-ffb9-4a94-9078-05d5d2aeea48 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:47.647352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c33038dc-ffb9-4a94-9078-05d5d2aeea48 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:47.785193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c33038dc-ffb9-4a94-9078-05d5d2aeea48 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:47.793981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c33038dc-ffb9-4a94-9078-05d5d2aeea48 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.159422 Aug 24 06:36:47.794730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1114/2235] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:47 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:47.836954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:47.837563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:47.843723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:47.844203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:47.844673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:47.845370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:47.845817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:47.846232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:47.877418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7cc9fc1b-47d9-40e3-84ca-29783ab3d2af tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:47.878705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7cc9fc1b-47d9-40e3-84ca-29783ab3d2af tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:47.880890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=78 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:47.885823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cc9fc1b-47d9-40e3-84ca-29783ab3d2af tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:47.892151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cc9fc1b-47d9-40e3-84ca-29783ab3d2af tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:47.892151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cc9fc1b-47d9-40e3-84ca-29783ab3d2af tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:47.892151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cc9fc1b-47d9-40e3-84ca-29783ab3d2af tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:47.892151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cc9fc1b-47d9-40e3-84ca-29783ab3d2af tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:47.892667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cc9fc1b-47d9-40e3-84ca-29783ab3d2af tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:47.958625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7cc9fc1b-47d9-40e3-84ca-29783ab3d2af tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:47.972488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7cc9fc1b-47d9-40e3-84ca-29783ab3d2af tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.098649 Aug 24 06:36:47.973915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1115/2236] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:47.997344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:48.006267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:48.007790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:48.009064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0c3c8142-7b0c-4e52-a8d9-a8a4c219a705 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.176383 Aug 24 06:36:48.009658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1122/2237] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:48.817381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-65c0b55f-b694-4cbb-b220-6e8b3d1ac65d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:48.818048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-65c0b55f-b694-4cbb-b220-6e8b3d1ac65d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:48.824794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65c0b55f-b694-4cbb-b220-6e8b3d1ac65d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:48.825273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65c0b55f-b694-4cbb-b220-6e8b3d1ac65d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:48.825705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65c0b55f-b694-4cbb-b220-6e8b3d1ac65d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:48.826445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65c0b55f-b694-4cbb-b220-6e8b3d1ac65d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:48.826889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65c0b55f-b694-4cbb-b220-6e8b3d1ac65d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:48.827303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-65c0b55f-b694-4cbb-b220-6e8b3d1ac65d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:48.968542 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-65c0b55f-b694-4cbb-b220-6e8b3d1ac65d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:48.977280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-65c0b55f-b694-4cbb-b220-6e8b3d1ac65d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164641 Aug 24 06:36:48.977902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1116/2238] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:48 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:48.994136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-937fedd6-d93f-43bd-bd9a-3e8a701fa7a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:48.995157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-937fedd6-d93f-43bd-bd9a-3e8a701fa7a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:49.002311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937fedd6-d93f-43bd-bd9a-3e8a701fa7a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:49.003378 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937fedd6-d93f-43bd-bd9a-3e8a701fa7a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:49.003844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937fedd6-d93f-43bd-bd9a-3e8a701fa7a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:49.004621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937fedd6-d93f-43bd-bd9a-3e8a701fa7a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:49.005113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937fedd6-d93f-43bd-bd9a-3e8a701fa7a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:49.005696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-937fedd6-d93f-43bd-bd9a-3e8a701fa7a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:49.034181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:49.034988 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:49.045163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:49.046047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:49.046789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:49.048065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:49.048924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:49.049671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:49.079191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:49.093002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-937fedd6-d93f-43bd-bd9a-3e8a701fa7a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:49.100848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-937fedd6-d93f-43bd-bd9a-3e8a701fa7a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.110587 Aug 24 06:36:49.101605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1123/2239] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:49.206619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:49.215531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:49.217102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:49.218205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8ffb6f9a-89bb-4674-a99a-649e130296d8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.189434 Aug 24 06:36:49.218790 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1117/2240] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:36:49.998783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ea85e9b1-6c38-4391-b6cb-4aa666a4844a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:49.999394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ea85e9b1-6c38-4391-b6cb-4aa666a4844a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:50.006672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea85e9b1-6c38-4391-b6cb-4aa666a4844a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:50.007186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea85e9b1-6c38-4391-b6cb-4aa666a4844a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:50.007580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea85e9b1-6c38-4391-b6cb-4aa666a4844a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:50.008285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea85e9b1-6c38-4391-b6cb-4aa666a4844a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:50.008770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea85e9b1-6c38-4391-b6cb-4aa666a4844a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:50.009194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ea85e9b1-6c38-4391-b6cb-4aa666a4844a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:50.133559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c44c8890-bf93-4eb2-b315-a842f82bcb82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:50.134206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c44c8890-bf93-4eb2-b315-a842f82bcb82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:50.140985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c8890-bf93-4eb2-b315-a842f82bcb82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:50.141472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c8890-bf93-4eb2-b315-a842f82bcb82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:50.141910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c8890-bf93-4eb2-b315-a842f82bcb82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:50.142610 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c8890-bf93-4eb2-b315-a842f82bcb82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:50.143071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c8890-bf93-4eb2-b315-a842f82bcb82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:50.143494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c44c8890-bf93-4eb2-b315-a842f82bcb82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:50.203732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ea85e9b1-6c38-4391-b6cb-4aa666a4844a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:50.214912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ea85e9b1-6c38-4391-b6cb-4aa666a4844a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.219879 Aug 24 06:36:50.215108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c44c8890-bf93-4eb2-b315-a842f82bcb82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:50.215868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1124/2241] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:49 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:50.230547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c44c8890-bf93-4eb2-b315-a842f82bcb82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.100387 Aug 24 06:36:50.231600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1118/2242] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:50.243304 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:50.244230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:50.251266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:50.251808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:50.252333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:50.253228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:50.253776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:50.254330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:50.398495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:50.407445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:50.409560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:50.410734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-874b98fa-9f21-482d-81b3-07a434338b32 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.171830 Aug 24 06:36:50.411299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1125/2243] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:51.250414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fa8c4268-93a4-479e-b2f2-f44b230483f4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:51.251045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fa8c4268-93a4-479e-b2f2-f44b230483f4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:51.258645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa8c4268-93a4-479e-b2f2-f44b230483f4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:51.259125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa8c4268-93a4-479e-b2f2-f44b230483f4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:51.259554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa8c4268-93a4-479e-b2f2-f44b230483f4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:51.260244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa8c4268-93a4-479e-b2f2-f44b230483f4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:51.260677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b79c8b7c-bf85-43c1-ab64-69dfdc0d888b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:51.261438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa8c4268-93a4-479e-b2f2-f44b230483f4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:51.261438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa8c4268-93a4-479e-b2f2-f44b230483f4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:51.261785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b79c8b7c-bf85-43c1-ab64-69dfdc0d888b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:51.270751 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b79c8b7c-bf85-43c1-ab64-69dfdc0d888b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:51.271386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b79c8b7c-bf85-43c1-ab64-69dfdc0d888b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:51.271935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b79c8b7c-bf85-43c1-ab64-69dfdc0d888b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:51.272910 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b79c8b7c-bf85-43c1-ab64-69dfdc0d888b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:51.273481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b79c8b7c-bf85-43c1-ab64-69dfdc0d888b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:51.274137 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b79c8b7c-bf85-43c1-ab64-69dfdc0d888b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:51.358424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b79c8b7c-bf85-43c1-ab64-69dfdc0d888b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:51.371986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b79c8b7c-bf85-43c1-ab64-69dfdc0d888b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.115453 Aug 24 06:36:51.373457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1126/2244] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:51 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:51.422247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fa8c4268-93a4-479e-b2f2-f44b230483f4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:51.431516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fa8c4268-93a4-479e-b2f2-f44b230483f4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.185130 Aug 24 06:36:51.432098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1119/2245] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:51 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:51.442712 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:51.443499 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:51.450815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:51.451316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:51.451751 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:51.452456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:51.452930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:51.453355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:51.589958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:51.599068 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:51.600634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:51.601830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c0089c1a-f956-4f9a-a6e4-0335d2f1af8e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.164237 Aug 24 06:36:51.602394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1127/2246] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:51 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:52.397486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e5e91ef9-1ebd-4d1d-aeb3-90f66c6b83bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:52.398115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e5e91ef9-1ebd-4d1d-aeb3-90f66c6b83bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:52.404706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5e91ef9-1ebd-4d1d-aeb3-90f66c6b83bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:52.405192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5e91ef9-1ebd-4d1d-aeb3-90f66c6b83bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:52.405621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5e91ef9-1ebd-4d1d-aeb3-90f66c6b83bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:52.406309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5e91ef9-1ebd-4d1d-aeb3-90f66c6b83bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:52.406758 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5e91ef9-1ebd-4d1d-aeb3-90f66c6b83bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:52.407175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e5e91ef9-1ebd-4d1d-aeb3-90f66c6b83bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:52.454124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5cc8ee57-343f-4d09-ac32-6c36b38cf20c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:52.454737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5cc8ee57-343f-4d09-ac32-6c36b38cf20c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:52.462114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cc8ee57-343f-4d09-ac32-6c36b38cf20c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:52.462591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cc8ee57-343f-4d09-ac32-6c36b38cf20c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:52.463022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cc8ee57-343f-4d09-ac32-6c36b38cf20c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:52.463715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cc8ee57-343f-4d09-ac32-6c36b38cf20c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:52.464149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cc8ee57-343f-4d09-ac32-6c36b38cf20c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:52.464599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cc8ee57-343f-4d09-ac32-6c36b38cf20c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:52.471346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e5e91ef9-1ebd-4d1d-aeb3-90f66c6b83bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:52.479965 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e5e91ef9-1ebd-4d1d-aeb3-90f66c6b83bd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086756 Aug 24 06:36:52.480590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1120/2247] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:52 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:52.620481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5cc8ee57-343f-4d09-ac32-6c36b38cf20c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:52.625259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:52.625950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:52.630070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5cc8ee57-343f-4d09-ac32-6c36b38cf20c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.180035 Aug 24 06:36:52.630659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1128/2248] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:52 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:52.633309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:52.633789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:52.634212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:52.634899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:52.635343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:52.635755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:52.783623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:52.793895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:52.795451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:52.796679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-25b4da68-dbb8-4c09-84f4-abecba25aa7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.175309 Aug 24 06:36:52.797251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1121/2249] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:36:53.512708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-41e56db7-ecb7-4baf-898a-bb2e7851fec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:53.513427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-41e56db7-ecb7-4baf-898a-bb2e7851fec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:53.520989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-41e56db7-ecb7-4baf-898a-bb2e7851fec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:53.521485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-41e56db7-ecb7-4baf-898a-bb2e7851fec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:53.521962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-41e56db7-ecb7-4baf-898a-bb2e7851fec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:53.522713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-41e56db7-ecb7-4baf-898a-bb2e7851fec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:53.523177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-41e56db7-ecb7-4baf-898a-bb2e7851fec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:53.523606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-41e56db7-ecb7-4baf-898a-bb2e7851fec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:53.526903 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:53.595980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-41e56db7-ecb7-4baf-898a-bb2e7851fec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:53.605602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-41e56db7-ecb7-4baf-898a-bb2e7851fec5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.097306 Aug 24 06:36:53.606211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1129/2250] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:53.653190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b771c723-8073-4381-acdf-b4dbcbd4a7b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:53.654062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b771c723-8073-4381-acdf-b4dbcbd4a7b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:53.661709 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b771c723-8073-4381-acdf-b4dbcbd4a7b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:53.662193 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b771c723-8073-4381-acdf-b4dbcbd4a7b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:53.662634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b771c723-8073-4381-acdf-b4dbcbd4a7b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:53.663372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b771c723-8073-4381-acdf-b4dbcbd4a7b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:53.663827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b771c723-8073-4381-acdf-b4dbcbd4a7b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:53.664250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b771c723-8073-4381-acdf-b4dbcbd4a7b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:53.819655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:53.820381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:53.827029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:53.827525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:53.828709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:53.829445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:53.829897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:53.830360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:53.853416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b771c723-8073-4381-acdf-b4dbcbd4a7b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:53.862757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b771c723-8073-4381-acdf-b4dbcbd4a7b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.213467 Aug 24 06:36:53.863355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1122/2251] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:53 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:53.993593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:54.003965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:54.005528 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:54.006715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cc510e93-5bc3-43ca-878b-6eed86a2bb55 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.191343 Aug 24 06:36:54.007276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1130/2252] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:36:54.629910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fc00647d-9e13-410f-9539-ccdb57dda357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:54.630871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fc00647d-9e13-410f-9539-ccdb57dda357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:54.641446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc00647d-9e13-410f-9539-ccdb57dda357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:54.642236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc00647d-9e13-410f-9539-ccdb57dda357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:54.642921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc00647d-9e13-410f-9539-ccdb57dda357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:54.644560 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc00647d-9e13-410f-9539-ccdb57dda357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:54.645140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc00647d-9e13-410f-9539-ccdb57dda357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:54.645616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc00647d-9e13-410f-9539-ccdb57dda357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:54.728426 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fc00647d-9e13-410f-9539-ccdb57dda357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:54.738605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fc00647d-9e13-410f-9539-ccdb57dda357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.115211 Aug 24 06:36:54.739298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1123/2253] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:54.885908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ec598582-cd75-402d-8381-a65c3902c6cd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:54.886567 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ec598582-cd75-402d-8381-a65c3902c6cd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:54.889033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=76 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:54.894753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec598582-cd75-402d-8381-a65c3902c6cd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:54.895284 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec598582-cd75-402d-8381-a65c3902c6cd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:54.895779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec598582-cd75-402d-8381-a65c3902c6cd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:54.896578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec598582-cd75-402d-8381-a65c3902c6cd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:54.897190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec598582-cd75-402d-8381-a65c3902c6cd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:54.897618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ec598582-cd75-402d-8381-a65c3902c6cd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:55.041656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ec598582-cd75-402d-8381-a65c3902c6cd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:55.048048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:55.049365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:55.050804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ec598582-cd75-402d-8381-a65c3902c6cd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.168836 Aug 24 06:36:55.051391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1131/2254] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:54 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:55.059598 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:55.060386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:55.061127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:55.062371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:55.063167 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:55.063906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:55.234809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:55.244126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:55.245713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:55.246877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8d46b7e0-d58d-428f-aff4-397b3f3990cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.205905 Aug 24 06:36:55.247449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1124/2255] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:55.761616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e4ba27cf-214c-4b40-bb4c-6a4cbc1365a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:55.762221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e4ba27cf-214c-4b40-bb4c-6a4cbc1365a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:55.768448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ba27cf-214c-4b40-bb4c-6a4cbc1365a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:55.768976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ba27cf-214c-4b40-bb4c-6a4cbc1365a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:55.769414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ba27cf-214c-4b40-bb4c-6a4cbc1365a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:55.770148 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ba27cf-214c-4b40-bb4c-6a4cbc1365a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:55.770601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ba27cf-214c-4b40-bb4c-6a4cbc1365a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:55.771025 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ba27cf-214c-4b40-bb4c-6a4cbc1365a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:55.835016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e4ba27cf-214c-4b40-bb4c-6a4cbc1365a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:55.843684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e4ba27cf-214c-4b40-bb4c-6a4cbc1365a9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086017 Aug 24 06:36:55.844373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1132/2256] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:55 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:56.073722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e8816528-25b6-486e-9785-de299fce6560 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:56.074373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e8816528-25b6-486e-9785-de299fce6560 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:56.081532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8816528-25b6-486e-9785-de299fce6560 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:56.082022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8816528-25b6-486e-9785-de299fce6560 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:56.082459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8816528-25b6-486e-9785-de299fce6560 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:56.083179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8816528-25b6-486e-9785-de299fce6560 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:56.083624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8816528-25b6-486e-9785-de299fce6560 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:56.084045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8816528-25b6-486e-9785-de299fce6560 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:56.226134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e8816528-25b6-486e-9785-de299fce6560 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:56.234742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e8816528-25b6-486e-9785-de299fce6560 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164951 Aug 24 06:36:56.235318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1125/2257] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:56 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:56.271144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:56.271801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:56.278994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:56.279477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:56.279900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:56.280648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:56.281104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:56.281523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:56.431541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:56.441878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:56.443404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:56.444609 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-44014086-4eb0-4567-97b6-a984a5a350ae tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.177951 Aug 24 06:36:56.445183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1133/2258] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:56.865862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9bedfad7-d478-4e1c-9256-bc92ac58cb7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:56.866721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9bedfad7-d478-4e1c-9256-bc92ac58cb7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:56.873254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bedfad7-d478-4e1c-9256-bc92ac58cb7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:56.873812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bedfad7-d478-4e1c-9256-bc92ac58cb7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:56.874281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bedfad7-d478-4e1c-9256-bc92ac58cb7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:56.875018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bedfad7-d478-4e1c-9256-bc92ac58cb7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:56.875540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bedfad7-d478-4e1c-9256-bc92ac58cb7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:56.876076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9bedfad7-d478-4e1c-9256-bc92ac58cb7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:56.941725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9bedfad7-d478-4e1c-9256-bc92ac58cb7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:56.950994 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9bedfad7-d478-4e1c-9256-bc92ac58cb7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089507 Aug 24 06:36:56.951567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1126/2259] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:57.270871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-65b3fed3-eaef-4f00-b37e-d9e19c034f13 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:57.271509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-65b3fed3-eaef-4f00-b37e-d9e19c034f13 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:57.277919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65b3fed3-eaef-4f00-b37e-d9e19c034f13 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:57.278397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65b3fed3-eaef-4f00-b37e-d9e19c034f13 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:57.278826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65b3fed3-eaef-4f00-b37e-d9e19c034f13 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:57.279522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65b3fed3-eaef-4f00-b37e-d9e19c034f13 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:57.279967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65b3fed3-eaef-4f00-b37e-d9e19c034f13 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:57.280381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65b3fed3-eaef-4f00-b37e-d9e19c034f13 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:57.424923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-65b3fed3-eaef-4f00-b37e-d9e19c034f13 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:57.433232 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-65b3fed3-eaef-4f00-b37e-d9e19c034f13 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.166865 Aug 24 06:36:57.433808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1134/2260] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:57 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:57.469933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:57.470528 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:57.477319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:57.477735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:57.478162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:57.478853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:57.479297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:57.479710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:57.618810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:57.629105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:57.631177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:57.632359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2784b2dd-295a-4602-8e81-89adf4395340 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.166374 Aug 24 06:36:57.632962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1127/2261] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:57 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:57.985033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0236b95d-fc05-4503-825e-3d496aa05669 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:57.985634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0236b95d-fc05-4503-825e-3d496aa05669 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:57.992413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0236b95d-fc05-4503-825e-3d496aa05669 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:57.992922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0236b95d-fc05-4503-825e-3d496aa05669 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:57.993349 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0236b95d-fc05-4503-825e-3d496aa05669 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:57.994038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0236b95d-fc05-4503-825e-3d496aa05669 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:57.994482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0236b95d-fc05-4503-825e-3d496aa05669 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:57.994896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0236b95d-fc05-4503-825e-3d496aa05669 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:58.058455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0236b95d-fc05-4503-825e-3d496aa05669 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:58.067286 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0236b95d-fc05-4503-825e-3d496aa05669 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086088 Aug 24 06:36:58.067943 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1135/2262] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:57 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:58.455312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8d78bde8-9bac-4bf6-bb4e-16ab8cde2a3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:58.456475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8d78bde8-9bac-4bf6-bb4e-16ab8cde2a3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:58.463007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78bde8-9bac-4bf6-bb4e-16ab8cde2a3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:58.463496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78bde8-9bac-4bf6-bb4e-16ab8cde2a3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:58.463923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78bde8-9bac-4bf6-bb4e-16ab8cde2a3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:58.464648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78bde8-9bac-4bf6-bb4e-16ab8cde2a3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:58.465098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78bde8-9bac-4bf6-bb4e-16ab8cde2a3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:58.465516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8d78bde8-9bac-4bf6-bb4e-16ab8cde2a3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:58.618942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8d78bde8-9bac-4bf6-bb4e-16ab8cde2a3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:58.629520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8d78bde8-9bac-4bf6-bb4e-16ab8cde2a3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.177180 Aug 24 06:36:58.630128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1128/2263] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:58 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:58.655448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:58.656173 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:58.662786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:58.663264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:58.663710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:58.664387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:58.664858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:58.665278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:58.815615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:58.826296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:58.827854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:58.829091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b9af7173-21c8-43d0-b047-3e3cf672958b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.177609 Aug 24 06:36:58.829669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1136/2264] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:58 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:36:59.088470 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-03b4e8e9-b87d-4475-82fd-23f609e3ed53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:59.089177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-03b4e8e9-b87d-4475-82fd-23f609e3ed53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:59.096282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03b4e8e9-b87d-4475-82fd-23f609e3ed53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:59.096805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03b4e8e9-b87d-4475-82fd-23f609e3ed53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:59.097241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03b4e8e9-b87d-4475-82fd-23f609e3ed53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:59.098146 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03b4e8e9-b87d-4475-82fd-23f609e3ed53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:59.098648 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03b4e8e9-b87d-4475-82fd-23f609e3ed53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:59.099074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-03b4e8e9-b87d-4475-82fd-23f609e3ed53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:59.164795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-03b4e8e9-b87d-4475-82fd-23f609e3ed53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:59.173571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-03b4e8e9-b87d-4475-82fd-23f609e3ed53 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089135 Aug 24 06:36:59.174693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1129/2265] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:59 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:59.652219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e9a9ee1c-d043-4049-98be-48ec50e54df5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:59.652896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e9a9ee1c-d043-4049-98be-48ec50e54df5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:59.660703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9a9ee1c-d043-4049-98be-48ec50e54df5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:59.661445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9a9ee1c-d043-4049-98be-48ec50e54df5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:59.661611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9a9ee1c-d043-4049-98be-48ec50e54df5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:59.662335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9a9ee1c-d043-4049-98be-48ec50e54df5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:59.662791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9a9ee1c-d043-4049-98be-48ec50e54df5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:59.663218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e9a9ee1c-d043-4049-98be-48ec50e54df5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:59.827071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e9a9ee1c-d043-4049-98be-48ec50e54df5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:36:59.843586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e9a9ee1c-d043-4049-98be-48ec50e54df5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.194955 Aug 24 06:36:59.844656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1137/2266] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:36:59 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:36:59.857767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:36:59.858852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:36:59.870490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:59.871352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:59.872124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:36:59.873449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:36:59.874354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:36:59.875114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:00.030678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:00.041245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:00.042854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:00.044097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e54659fd-91f2-4aa2-b24a-4e307a2d1813 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.193456 Aug 24 06:37:00.044716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1130/2267] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:36:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:00.208447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8f26dd3f-08af-4502-b618-7b70c4255ea7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:00.209008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8f26dd3f-08af-4502-b618-7b70c4255ea7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:00.215440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8f26dd3f-08af-4502-b618-7b70c4255ea7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:00.215925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8f26dd3f-08af-4502-b618-7b70c4255ea7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:00.216361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8f26dd3f-08af-4502-b618-7b70c4255ea7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:00.217091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8f26dd3f-08af-4502-b618-7b70c4255ea7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:00.217550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8f26dd3f-08af-4502-b618-7b70c4255ea7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:00.217985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8f26dd3f-08af-4502-b618-7b70c4255ea7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:00.284452 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8f26dd3f-08af-4502-b618-7b70c4255ea7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:00.293149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8f26dd3f-08af-4502-b618-7b70c4255ea7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089424 Aug 24 06:37:00.293728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1138/2268] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:00.869487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8795369c-20cb-425c-b544-67c35e3b8b47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:00.870374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8795369c-20cb-425c-b544-67c35e3b8b47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:00.876922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8795369c-20cb-425c-b544-67c35e3b8b47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:00.877400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8795369c-20cb-425c-b544-67c35e3b8b47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:00.877832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8795369c-20cb-425c-b544-67c35e3b8b47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:00.878529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8795369c-20cb-425c-b544-67c35e3b8b47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:00.878979 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8795369c-20cb-425c-b544-67c35e3b8b47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:00.879474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8795369c-20cb-425c-b544-67c35e3b8b47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:01.017725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8795369c-20cb-425c-b544-67c35e3b8b47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:01.026305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8795369c-20cb-425c-b544-67c35e3b8b47 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.160738 Aug 24 06:37:01.026884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1131/2269] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:00 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:01.067761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:01.068676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:01.074991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:01.075473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:01.075913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:01.076650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:01.077105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:01.077532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:01.220663 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:01.230293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:01.231817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:01.233064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d1b58d7e-962f-4b91-9063-30713c9013d9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.169455 Aug 24 06:37:01.233628 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1139/2270] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:01.314917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-00fba5b0-b0a3-45b0-95f3-88a62f289d0b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:01.315531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-00fba5b0-b0a3-45b0-95f3-88a62f289d0b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:01.321801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fba5b0-b0a3-45b0-95f3-88a62f289d0b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:01.322293 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fba5b0-b0a3-45b0-95f3-88a62f289d0b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:01.322727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fba5b0-b0a3-45b0-95f3-88a62f289d0b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:01.323436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fba5b0-b0a3-45b0-95f3-88a62f289d0b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:01.323947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fba5b0-b0a3-45b0-95f3-88a62f289d0b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:01.324377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00fba5b0-b0a3-45b0-95f3-88a62f289d0b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:01.395883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-00fba5b0-b0a3-45b0-95f3-88a62f289d0b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:01.404506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-00fba5b0-b0a3-45b0-95f3-88a62f289d0b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093571 Aug 24 06:37:01.405104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1132/2271] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:01 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:02.047697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-88c351b0-176d-4ae3-a450-2305298514ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:02.048241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-88c351b0-176d-4ae3-a450-2305298514ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:02.055041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88c351b0-176d-4ae3-a450-2305298514ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:02.055524 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88c351b0-176d-4ae3-a450-2305298514ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:02.055997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88c351b0-176d-4ae3-a450-2305298514ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:02.056710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88c351b0-176d-4ae3-a450-2305298514ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:02.057163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88c351b0-176d-4ae3-a450-2305298514ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:02.057587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88c351b0-176d-4ae3-a450-2305298514ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:02.194395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-88c351b0-176d-4ae3-a450-2305298514ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:02.203563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-88c351b0-176d-4ae3-a450-2305298514ec tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.159971 Aug 24 06:37:02.204157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1140/2272] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:02 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:02.261104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:02.262156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:02.274021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:02.274853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:02.275605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:02.276811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:02.277588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:02.278326 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:02.431049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d8ec4ee0-99b8-40f2-be56-68146b4093a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:02.431672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d8ec4ee0-99b8-40f2-be56-68146b4093a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:02.438754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8ec4ee0-99b8-40f2-be56-68146b4093a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:02.439341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8ec4ee0-99b8-40f2-be56-68146b4093a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:02.439786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8ec4ee0-99b8-40f2-be56-68146b4093a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:02.440519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8ec4ee0-99b8-40f2-be56-68146b4093a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:02.440974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8ec4ee0-99b8-40f2-be56-68146b4093a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:02.441398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d8ec4ee0-99b8-40f2-be56-68146b4093a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:02.453362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:02.465217 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:02.468118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:02.470213 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c193f2f8-30ce-49e3-b04d-0155b4df34f1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.216281 Aug 24 06:37:02.473088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1133/2273] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:02.520000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d8ec4ee0-99b8-40f2-be56-68146b4093a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:02.535792 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d8ec4ee0-99b8-40f2-be56-68146b4093a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.111200 Aug 24 06:37:02.536885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1141/2274] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:02 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:03.226047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7c3f39b1-ae08-4028-a5de-0c3aaf4f2db7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:03.226829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7c3f39b1-ae08-4028-a5de-0c3aaf4f2db7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:03.234441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c3f39b1-ae08-4028-a5de-0c3aaf4f2db7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:03.234926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c3f39b1-ae08-4028-a5de-0c3aaf4f2db7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:03.235358 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c3f39b1-ae08-4028-a5de-0c3aaf4f2db7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:03.236069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c3f39b1-ae08-4028-a5de-0c3aaf4f2db7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:03.237117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c3f39b1-ae08-4028-a5de-0c3aaf4f2db7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:03.237550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7c3f39b1-ae08-4028-a5de-0c3aaf4f2db7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:03.240407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:03.372832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7c3f39b1-ae08-4028-a5de-0c3aaf4f2db7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:03.382414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7c3f39b1-ae08-4028-a5de-0c3aaf4f2db7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.160358 Aug 24 06:37:03.382996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1134/2275] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:03 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:03.499577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:03.500251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:03.507297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:03.507775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:03.508211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:03.508994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:03.509441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:03.526167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:03.559855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8f72a5a1-da18-4104-a747-12724e2abfc7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:03.561172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8f72a5a1-da18-4104-a747-12724e2abfc7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:03.572365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f72a5a1-da18-4104-a747-12724e2abfc7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:03.573230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f72a5a1-da18-4104-a747-12724e2abfc7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:03.574018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f72a5a1-da18-4104-a747-12724e2abfc7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:03.575247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f72a5a1-da18-4104-a747-12724e2abfc7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:03.576329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f72a5a1-da18-4104-a747-12724e2abfc7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:03.577137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8f72a5a1-da18-4104-a747-12724e2abfc7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:03.660347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8f72a5a1-da18-4104-a747-12724e2abfc7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:03.675996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8f72a5a1-da18-4104-a747-12724e2abfc7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.121601 Aug 24 06:37:03.677100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1135/2276] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:03 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:03.679993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:03.691151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:03.692683 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:03.693944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0983aad4-c36c-4cad-8b53-8241396d72e5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.198384 Aug 24 06:37:03.694517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1142/2277] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:04.415643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1ea31f91-906a-4389-8cee-4b40ba3bf359 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:04.416415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1ea31f91-906a-4389-8cee-4b40ba3bf359 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:04.424668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ea31f91-906a-4389-8cee-4b40ba3bf359 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:04.425194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ea31f91-906a-4389-8cee-4b40ba3bf359 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:04.425630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ea31f91-906a-4389-8cee-4b40ba3bf359 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:04.426351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ea31f91-906a-4389-8cee-4b40ba3bf359 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:04.426800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ea31f91-906a-4389-8cee-4b40ba3bf359 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:04.427221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1ea31f91-906a-4389-8cee-4b40ba3bf359 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:04.574189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1ea31f91-906a-4389-8cee-4b40ba3bf359 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:04.584023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1ea31f91-906a-4389-8cee-4b40ba3bf359 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.172517 Aug 24 06:37:04.584805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1136/2278] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:04 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:04.701901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5d5b12f3-d101-46c8-8521-2ea089636dd6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:04.702795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5d5b12f3-d101-46c8-8521-2ea089636dd6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:04.710049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5b12f3-d101-46c8-8521-2ea089636dd6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:04.710049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5b12f3-d101-46c8-8521-2ea089636dd6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:04.710451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5b12f3-d101-46c8-8521-2ea089636dd6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:04.711171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5b12f3-d101-46c8-8521-2ea089636dd6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:04.711616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5b12f3-d101-46c8-8521-2ea089636dd6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:04.712151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d5b12f3-d101-46c8-8521-2ea089636dd6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:04.717476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:04.718151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:04.725245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:04.725731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:04.726166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:04.726877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:04.727325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:04.727749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:04.786866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5d5b12f3-d101-46c8-8521-2ea089636dd6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:04.796052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5d5b12f3-d101-46c8-8521-2ea089636dd6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.098222 Aug 24 06:37:04.796685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1143/2279] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:04.894972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:04.905313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:04.906837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:04.908999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5938b45e-2080-49d8-bc81-49403d1506a0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.194811 Aug 24 06:37:04.909514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1137/2280] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:04 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:05.607077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b1632bdf-0f07-4f63-bc8b-495ed208037d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:05.607650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b1632bdf-0f07-4f63-bc8b-495ed208037d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:05.615315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1632bdf-0f07-4f63-bc8b-495ed208037d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:05.615848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1632bdf-0f07-4f63-bc8b-495ed208037d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:05.616541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1632bdf-0f07-4f63-bc8b-495ed208037d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:05.617312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1632bdf-0f07-4f63-bc8b-495ed208037d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:05.617807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1632bdf-0f07-4f63-bc8b-495ed208037d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:05.618283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b1632bdf-0f07-4f63-bc8b-495ed208037d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:05.762781 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b1632bdf-0f07-4f63-bc8b-495ed208037d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:05.771723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b1632bdf-0f07-4f63-bc8b-495ed208037d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.168643 Aug 24 06:37:05.772334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1144/2281] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:05 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:05.829024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bf4145ec-a482-45b6-a81a-dce07a19fc92 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:05.830031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bf4145ec-a482-45b6-a81a-dce07a19fc92 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:05.837128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf4145ec-a482-45b6-a81a-dce07a19fc92 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:05.837623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf4145ec-a482-45b6-a81a-dce07a19fc92 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:05.838058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf4145ec-a482-45b6-a81a-dce07a19fc92 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:05.838769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf4145ec-a482-45b6-a81a-dce07a19fc92 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:05.839253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf4145ec-a482-45b6-a81a-dce07a19fc92 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:05.839676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf4145ec-a482-45b6-a81a-dce07a19fc92 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:05.912406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bf4145ec-a482-45b6-a81a-dce07a19fc92 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:05.921351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bf4145ec-a482-45b6-a81a-dce07a19fc92 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.096303 Aug 24 06:37:05.921952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1138/2282] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:05.933798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:05.934663 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:05.942134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:05.942617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:05.943051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:05.943775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:05.944224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:05.944705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:06.098171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:06.100744 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:06.108916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:06.110533 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:06.111791 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5d6c0cae-37ad-478d-b6ce-7139ab4ebe42 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.182154 Aug 24 06:37:06.112656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1145/2283] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:06.792342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2cd7f0cc-a15b-45aa-b3f8-b81ca5b622a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:06.792973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2cd7f0cc-a15b-45aa-b3f8-b81ca5b622a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:06.799055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cd7f0cc-a15b-45aa-b3f8-b81ca5b622a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:06.799515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cd7f0cc-a15b-45aa-b3f8-b81ca5b622a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:06.799946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cd7f0cc-a15b-45aa-b3f8-b81ca5b622a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:06.800672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cd7f0cc-a15b-45aa-b3f8-b81ca5b622a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:06.801119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cd7f0cc-a15b-45aa-b3f8-b81ca5b622a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:06.801539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cd7f0cc-a15b-45aa-b3f8-b81ca5b622a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:06.938624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2cd7f0cc-a15b-45aa-b3f8-b81ca5b622a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:06.945763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-69522b8a-6ab6-4edf-ab20-921c666c0c7d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:06.946580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-69522b8a-6ab6-4edf-ab20-921c666c0c7d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:06.948229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2cd7f0cc-a15b-45aa-b3f8-b81ca5b622a5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.159737 Aug 24 06:37:06.948868 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1139/2284] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:06 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:06.958494 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-69522b8a-6ab6-4edf-ab20-921c666c0c7d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:06.959369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-69522b8a-6ab6-4edf-ab20-921c666c0c7d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:06.960146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-69522b8a-6ab6-4edf-ab20-921c666c0c7d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:06.961434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-69522b8a-6ab6-4edf-ab20-921c666c0c7d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:06.962257 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-69522b8a-6ab6-4edf-ab20-921c666c0c7d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:06.963029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-69522b8a-6ab6-4edf-ab20-921c666c0c7d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:07.032856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-69522b8a-6ab6-4edf-ab20-921c666c0c7d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:07.041900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-69522b8a-6ab6-4edf-ab20-921c666c0c7d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.100957 Aug 24 06:37:07.042477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1146/2285] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:07.136077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:07.136920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:07.144568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:07.145407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:07.146204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:07.147428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:07.147991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:07.148528 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:07.288112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:07.297003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:07.298533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:07.300308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2b38bf2f-7ec3-4c2f-91bd-1ce2b70791ee tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.168154 Aug 24 06:37:07.300922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1140/2286] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:07 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:07.987633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5cbf0140-521c-4079-bd69-2b8d55f2ea72 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:07.988768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5cbf0140-521c-4079-bd69-2b8d55f2ea72 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:07.997083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbf0140-521c-4079-bd69-2b8d55f2ea72 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:07.997582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbf0140-521c-4079-bd69-2b8d55f2ea72 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:07.998026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbf0140-521c-4079-bd69-2b8d55f2ea72 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:07.998775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbf0140-521c-4079-bd69-2b8d55f2ea72 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:07.999243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbf0140-521c-4079-bd69-2b8d55f2ea72 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:07.999674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5cbf0140-521c-4079-bd69-2b8d55f2ea72 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:08.077546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e0bee47e-c815-4a7b-b961-6d5de2f8ef36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:08.078370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e0bee47e-c815-4a7b-b961-6d5de2f8ef36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:08.086715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0bee47e-c815-4a7b-b961-6d5de2f8ef36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:08.087987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0bee47e-c815-4a7b-b961-6d5de2f8ef36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:08.088334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0bee47e-c815-4a7b-b961-6d5de2f8ef36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:08.089836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0bee47e-c815-4a7b-b961-6d5de2f8ef36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:08.090322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0bee47e-c815-4a7b-b961-6d5de2f8ef36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:08.090762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e0bee47e-c815-4a7b-b961-6d5de2f8ef36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:08.156029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5cbf0140-521c-4079-bd69-2b8d55f2ea72 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:08.172400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5cbf0140-521c-4079-bd69-2b8d55f2ea72 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.192754 Aug 24 06:37:08.173443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1147/2287] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:07 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:08.180179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e0bee47e-c815-4a7b-b961-6d5de2f8ef36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:08.189924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e0bee47e-c815-4a7b-b961-6d5de2f8ef36 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.116190 Aug 24 06:37:08.190522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1141/2288] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:08.335815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:08.336333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:08.342646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:08.343149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:08.343578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:08.344281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:08.344771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:08.345190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:08.489543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:08.499038 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:08.500746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:08.502005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-28d9316e-cfc4-4405-8b64-6b22aeac9543 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.170184 Aug 24 06:37:08.502607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1148/2289] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:09.197243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-20d9c6e8-92df-47d0-af33-29f48bc4f9b5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:09.197968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-20d9c6e8-92df-47d0-af33-29f48bc4f9b5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:09.205737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20d9c6e8-92df-47d0-af33-29f48bc4f9b5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:09.206365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20d9c6e8-92df-47d0-af33-29f48bc4f9b5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:09.206916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20d9c6e8-92df-47d0-af33-29f48bc4f9b5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:09.207746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20d9c6e8-92df-47d0-af33-29f48bc4f9b5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:09.208323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20d9c6e8-92df-47d0-af33-29f48bc4f9b5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:09.208902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20d9c6e8-92df-47d0-af33-29f48bc4f9b5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:09.227352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-17d5bb8e-4bda-46bd-9403-489b5987420e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:09.228475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-17d5bb8e-4bda-46bd-9403-489b5987420e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:09.240428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-17d5bb8e-4bda-46bd-9403-489b5987420e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:09.241352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-17d5bb8e-4bda-46bd-9403-489b5987420e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:09.242154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-17d5bb8e-4bda-46bd-9403-489b5987420e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:09.243390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-17d5bb8e-4bda-46bd-9403-489b5987420e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:09.244043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-17d5bb8e-4bda-46bd-9403-489b5987420e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:09.244866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-17d5bb8e-4bda-46bd-9403-489b5987420e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:09.351281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-17d5bb8e-4bda-46bd-9403-489b5987420e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:09.361849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-17d5bb8e-4bda-46bd-9403-489b5987420e tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.141030 Aug 24 06:37:09.362590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1149/2290] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:09 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:09.368937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-20d9c6e8-92df-47d0-af33-29f48bc4f9b5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:09.384396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-20d9c6e8-92df-47d0-af33-29f48bc4f9b5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.190676 Aug 24 06:37:09.385517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1142/2291] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:09 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:09.526184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:09.526954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:09.534157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:09.534675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:09.535092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:09.535828 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:09.536283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:09.536779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:09.679752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:09.690076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:09.691595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:09.692798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-45bcd34d-e43f-4b31-8dd8-92f5e37581eb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.171096 Aug 24 06:37:09.693365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1150/2292] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:10.396044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-76435f02-e197-43ee-8f9c-240fb8528255 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:10.396717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-76435f02-e197-43ee-8f9c-240fb8528255 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:10.406678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76435f02-e197-43ee-8f9c-240fb8528255 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:10.407123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6556aba9-1c44-43f6-b47e-1f0da0355eb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:10.407739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6556aba9-1c44-43f6-b47e-1f0da0355eb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:10.407917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76435f02-e197-43ee-8f9c-240fb8528255 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:10.409189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76435f02-e197-43ee-8f9c-240fb8528255 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:10.410442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76435f02-e197-43ee-8f9c-240fb8528255 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:10.411274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76435f02-e197-43ee-8f9c-240fb8528255 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:10.412046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-76435f02-e197-43ee-8f9c-240fb8528255 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:10.415843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6556aba9-1c44-43f6-b47e-1f0da0355eb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:10.416409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6556aba9-1c44-43f6-b47e-1f0da0355eb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:10.416878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6556aba9-1c44-43f6-b47e-1f0da0355eb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:10.417580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6556aba9-1c44-43f6-b47e-1f0da0355eb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:10.418033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6556aba9-1c44-43f6-b47e-1f0da0355eb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:10.418451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6556aba9-1c44-43f6-b47e-1f0da0355eb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:10.499080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-76435f02-e197-43ee-8f9c-240fb8528255 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:10.509111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-76435f02-e197-43ee-8f9c-240fb8528255 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.116877 Aug 24 06:37:10.509111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1143/2293] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:10 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:10.594769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6556aba9-1c44-43f6-b47e-1f0da0355eb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:10.604942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6556aba9-1c44-43f6-b47e-1f0da0355eb9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.201544 Aug 24 06:37:10.605714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1151/2294] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:10 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:10.731112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:10.731780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:10.739045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:10.739541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:10.739978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:10.740723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:10.741176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:10.741601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:10.892969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:10.902390 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:10.904184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:10.905227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2cac6556-65a6-4fce-bf2a-689e91db719f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.178621 Aug 24 06:37:10.905782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1144/2295] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:10 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:11.530109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-aba571f1-5e78-45e4-b3be-05441755bd94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:11.530754 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-aba571f1-5e78-45e4-b3be-05441755bd94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:11.538080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aba571f1-5e78-45e4-b3be-05441755bd94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:11.538565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aba571f1-5e78-45e4-b3be-05441755bd94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:11.539000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aba571f1-5e78-45e4-b3be-05441755bd94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:11.539705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aba571f1-5e78-45e4-b3be-05441755bd94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:11.540154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aba571f1-5e78-45e4-b3be-05441755bd94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:11.540603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-aba571f1-5e78-45e4-b3be-05441755bd94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:11.611830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-aba571f1-5e78-45e4-b3be-05441755bd94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:11.620623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-aba571f1-5e78-45e4-b3be-05441755bd94 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.094579 Aug 24 06:37:11.621223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1152/2296] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:11.626663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9393d1ef-b476-4f7a-88a9-8b8b7b4ff6eb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:11.627317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9393d1ef-b476-4f7a-88a9-8b8b7b4ff6eb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:11.634848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9393d1ef-b476-4f7a-88a9-8b8b7b4ff6eb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:11.635337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9393d1ef-b476-4f7a-88a9-8b8b7b4ff6eb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:11.635763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9393d1ef-b476-4f7a-88a9-8b8b7b4ff6eb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:11.636457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9393d1ef-b476-4f7a-88a9-8b8b7b4ff6eb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:11.636957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9393d1ef-b476-4f7a-88a9-8b8b7b4ff6eb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:11.637368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9393d1ef-b476-4f7a-88a9-8b8b7b4ff6eb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:11.791625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9393d1ef-b476-4f7a-88a9-8b8b7b4ff6eb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:11.801369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9393d1ef-b476-4f7a-88a9-8b8b7b4ff6eb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.178411 Aug 24 06:37:11.801956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1145/2297] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:11 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:11.930296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:11.930958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:11.938673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:11.939212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:11.940209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:11.941024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:11.941589 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:11.942087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:12.144059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:12.153649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:12.155176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:12.156357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f55b2ff0-7a2a-4057-a3dd-c5a0d32268d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.230062 Aug 24 06:37:12.156957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1153/2298] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:12.641856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4ad45b4b-a222-4373-8ea5-fe9cad9812c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:12.643344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4ad45b4b-a222-4373-8ea5-fe9cad9812c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:12.650650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ad45b4b-a222-4373-8ea5-fe9cad9812c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:12.651263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ad45b4b-a222-4373-8ea5-fe9cad9812c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:12.651793 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ad45b4b-a222-4373-8ea5-fe9cad9812c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:12.652662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ad45b4b-a222-4373-8ea5-fe9cad9812c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:12.653229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ad45b4b-a222-4373-8ea5-fe9cad9812c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:12.653747 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4ad45b4b-a222-4373-8ea5-fe9cad9812c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:12.737295 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4ad45b4b-a222-4373-8ea5-fe9cad9812c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:12.746973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4ad45b4b-a222-4373-8ea5-fe9cad9812c6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.108953 Aug 24 06:37:12.748995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1146/2299] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:12.825336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e036d6c6-ce2e-415b-814b-2fab459b4328 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:12.826001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e036d6c6-ce2e-415b-814b-2fab459b4328 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:12.833936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e036d6c6-ce2e-415b-814b-2fab459b4328 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:12.834433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e036d6c6-ce2e-415b-814b-2fab459b4328 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:12.834885 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e036d6c6-ce2e-415b-814b-2fab459b4328 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:12.835653 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e036d6c6-ce2e-415b-814b-2fab459b4328 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:12.836127 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e036d6c6-ce2e-415b-814b-2fab459b4328 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:12.836617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e036d6c6-ce2e-415b-814b-2fab459b4328 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:12.996145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e036d6c6-ce2e-415b-814b-2fab459b4328 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:13.004856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e036d6c6-ce2e-415b-814b-2fab459b4328 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.183961 Aug 24 06:37:13.005440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1154/2300] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:12 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:13.181823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:13.182427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:13.189008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:13.189496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:13.189960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:13.190670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:13.191125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:13.191555 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:13.338438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:13.347830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:13.349456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:13.350664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-be424b75-f70e-486e-91c0-97baffc78462 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.173360 Aug 24 06:37:13.351241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1147/2301] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:13 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:13.769190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-62910e48-da50-4ae8-b0e4-8090af03c1c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:13.769790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-62910e48-da50-4ae8-b0e4-8090af03c1c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:13.776046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62910e48-da50-4ae8-b0e4-8090af03c1c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:13.776681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62910e48-da50-4ae8-b0e4-8090af03c1c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:13.777111 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62910e48-da50-4ae8-b0e4-8090af03c1c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:13.777796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62910e48-da50-4ae8-b0e4-8090af03c1c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:13.778241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62910e48-da50-4ae8-b0e4-8090af03c1c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:13.778660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-62910e48-da50-4ae8-b0e4-8090af03c1c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:13.849507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-62910e48-da50-4ae8-b0e4-8090af03c1c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:13.864606 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-62910e48-da50-4ae8-b0e4-8090af03c1c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.098699 Aug 24 06:37:13.865404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1155/2302] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:14.025632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-38d061e3-5352-44f9-a626-ec4f75adb2b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:14.026218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-38d061e3-5352-44f9-a626-ec4f75adb2b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:14.032832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d061e3-5352-44f9-a626-ec4f75adb2b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:14.033907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d061e3-5352-44f9-a626-ec4f75adb2b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:14.034340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d061e3-5352-44f9-a626-ec4f75adb2b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:14.035039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d061e3-5352-44f9-a626-ec4f75adb2b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:14.035492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d061e3-5352-44f9-a626-ec4f75adb2b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:14.035913 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-38d061e3-5352-44f9-a626-ec4f75adb2b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:14.171004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-38d061e3-5352-44f9-a626-ec4f75adb2b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:14.179463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-38d061e3-5352-44f9-a626-ec4f75adb2b1 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157871 Aug 24 06:37:14.180125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1148/2303] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:14 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:14.374556 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:14.375079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:14.382333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:14.382965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:14.383441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:14.384183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:14.384735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:14.385198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:14.530769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:14.541470 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:14.542975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:14.544146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ffba3d76-46e4-49cc-a50c-254f64692e0b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.173694 Aug 24 06:37:14.544739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1156/2304] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:14.897986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0fb1b02e-059c-4a20-abb5-2ba0d953091c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:14.898625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0fb1b02e-059c-4a20-abb5-2ba0d953091c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:14.905364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0fb1b02e-059c-4a20-abb5-2ba0d953091c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:14.905846 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0fb1b02e-059c-4a20-abb5-2ba0d953091c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:14.906264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0fb1b02e-059c-4a20-abb5-2ba0d953091c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:14.907034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0fb1b02e-059c-4a20-abb5-2ba0d953091c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:14.907479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0fb1b02e-059c-4a20-abb5-2ba0d953091c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:14.907896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0fb1b02e-059c-4a20-abb5-2ba0d953091c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:14.973435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0fb1b02e-059c-4a20-abb5-2ba0d953091c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:14.982865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0fb1b02e-059c-4a20-abb5-2ba0d953091c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088895 Aug 24 06:37:14.983508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1149/2305] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:15.201959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4121222d-742f-43cf-a9cf-7b7aca89329c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:15.202699 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4121222d-742f-43cf-a9cf-7b7aca89329c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:15.209917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4121222d-742f-43cf-a9cf-7b7aca89329c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:15.210405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4121222d-742f-43cf-a9cf-7b7aca89329c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:15.210841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4121222d-742f-43cf-a9cf-7b7aca89329c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:15.211570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4121222d-742f-43cf-a9cf-7b7aca89329c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:15.212024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4121222d-742f-43cf-a9cf-7b7aca89329c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:15.212446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4121222d-742f-43cf-a9cf-7b7aca89329c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:15.353063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4121222d-742f-43cf-a9cf-7b7aca89329c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:15.362674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4121222d-742f-43cf-a9cf-7b7aca89329c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164840 Aug 24 06:37:15.363260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1157/2306] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:15 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:15.568615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:15.569416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:15.575811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:15.576292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:15.576767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:15.577467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:15.577911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:15.578327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:15.723533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:15.725847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:15.733830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:15.737576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:15.737576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-da9e1eae-9776-4751-a4f9-0d5bc186cf70 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.172215 Aug 24 06:37:15.737576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1150/2307] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:16.005307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-02bf47e8-2947-4c83-aa5c-e561497d3667 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:16.005922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-02bf47e8-2947-4c83-aa5c-e561497d3667 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:16.012402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02bf47e8-2947-4c83-aa5c-e561497d3667 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:16.012976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02bf47e8-2947-4c83-aa5c-e561497d3667 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:16.013454 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02bf47e8-2947-4c83-aa5c-e561497d3667 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:16.014216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02bf47e8-2947-4c83-aa5c-e561497d3667 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:16.014738 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02bf47e8-2947-4c83-aa5c-e561497d3667 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:16.015195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02bf47e8-2947-4c83-aa5c-e561497d3667 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:16.089853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-02bf47e8-2947-4c83-aa5c-e561497d3667 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:16.099339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-02bf47e8-2947-4c83-aa5c-e561497d3667 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.098367 Aug 24 06:37:16.099940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1158/2308] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:15 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:16.387711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7cfaa4fe-c6d8-47ac-b1cc-4dde9b6f4408 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:16.388406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7cfaa4fe-c6d8-47ac-b1cc-4dde9b6f4408 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:16.395379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cfaa4fe-c6d8-47ac-b1cc-4dde9b6f4408 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:16.395899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cfaa4fe-c6d8-47ac-b1cc-4dde9b6f4408 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:16.396363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cfaa4fe-c6d8-47ac-b1cc-4dde9b6f4408 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:16.397119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cfaa4fe-c6d8-47ac-b1cc-4dde9b6f4408 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:16.397601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cfaa4fe-c6d8-47ac-b1cc-4dde9b6f4408 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:16.398168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cfaa4fe-c6d8-47ac-b1cc-4dde9b6f4408 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:16.540396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7cfaa4fe-c6d8-47ac-b1cc-4dde9b6f4408 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:16.549743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7cfaa4fe-c6d8-47ac-b1cc-4dde9b6f4408 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.166114 Aug 24 06:37:16.550405 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1151/2309] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:16 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:16.774810 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:16.775683 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:16.782494 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:16.783542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:16.783982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:16.784714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:16.785169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:16.785588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:16.938645 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:16.949267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:16.950866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:16.952079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-55da68bd-e6e2-4622-99dc-e3626911006a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.181296 Aug 24 06:37:16.952685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1159/2310] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:16 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:17.129500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-737256ef-700e-49ca-ba13-2b7317a21d7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:17.130237 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-737256ef-700e-49ca-ba13-2b7317a21d7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:17.137749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-737256ef-700e-49ca-ba13-2b7317a21d7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:17.138511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-737256ef-700e-49ca-ba13-2b7317a21d7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:17.139300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-737256ef-700e-49ca-ba13-2b7317a21d7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:17.140559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-737256ef-700e-49ca-ba13-2b7317a21d7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:17.141354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-737256ef-700e-49ca-ba13-2b7317a21d7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:17.142583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-737256ef-700e-49ca-ba13-2b7317a21d7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:17.230921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-737256ef-700e-49ca-ba13-2b7317a21d7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:17.240390 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-737256ef-700e-49ca-ba13-2b7317a21d7c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.114824 Aug 24 06:37:17.241077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1152/2311] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:17 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:17.572081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-661b1c26-167f-416e-9c79-90c80889efb4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:17.572734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-661b1c26-167f-416e-9c79-90c80889efb4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:17.579296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b1c26-167f-416e-9c79-90c80889efb4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:17.579809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b1c26-167f-416e-9c79-90c80889efb4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:17.580241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b1c26-167f-416e-9c79-90c80889efb4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:17.580983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b1c26-167f-416e-9c79-90c80889efb4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:17.581437 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b1c26-167f-416e-9c79-90c80889efb4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:17.582507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b1c26-167f-416e-9c79-90c80889efb4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:17.734839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-661b1c26-167f-416e-9c79-90c80889efb4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:17.745539 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-661b1c26-167f-416e-9c79-90c80889efb4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.177336 Aug 24 06:37:17.746129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1160/2312] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:17 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:17.976690 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:17.977506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:17.979886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=76 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:17.987108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:17.987946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:17.988791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:17.990025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:17.990811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:17.991543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:18.266047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-592a4d89-887b-49c7-b50a-45c08dcc51fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:18.267205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-592a4d89-887b-49c7-b50a-45c08dcc51fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:18.277854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592a4d89-887b-49c7-b50a-45c08dcc51fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:18.278546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592a4d89-887b-49c7-b50a-45c08dcc51fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:18.279363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592a4d89-887b-49c7-b50a-45c08dcc51fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:18.280640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592a4d89-887b-49c7-b50a-45c08dcc51fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:18.281467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592a4d89-887b-49c7-b50a-45c08dcc51fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:18.282237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-592a4d89-887b-49c7-b50a-45c08dcc51fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:18.380706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:18.387737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-592a4d89-887b-49c7-b50a-45c08dcc51fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:18.395611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:18.398375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:18.400398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-33b623b3-e710-4baf-93cd-40fd70d624b0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.427712 Aug 24 06:37:18.401362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1153/2313] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:18.402940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-592a4d89-887b-49c7-b50a-45c08dcc51fb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.143919 Aug 24 06:37:18.404076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1161/2314] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:18.768057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5891e7be-3e7b-4f22-a110-f97eda525187 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:18.768721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5891e7be-3e7b-4f22-a110-f97eda525187 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:18.775135 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5891e7be-3e7b-4f22-a110-f97eda525187 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:18.775614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5891e7be-3e7b-4f22-a110-f97eda525187 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:18.776039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5891e7be-3e7b-4f22-a110-f97eda525187 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:18.776766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5891e7be-3e7b-4f22-a110-f97eda525187 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:18.777216 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5891e7be-3e7b-4f22-a110-f97eda525187 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:18.777629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5891e7be-3e7b-4f22-a110-f97eda525187 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:18.915713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5891e7be-3e7b-4f22-a110-f97eda525187 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:18.924561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5891e7be-3e7b-4f22-a110-f97eda525187 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.160829 Aug 24 06:37:18.925148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1154/2315] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:18 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:19.425865 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:19.426579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:19.427664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a0f617ab-f616-4c5c-8197-a484ee5bc8ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:19.428466 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a0f617ab-f616-4c5c-8197-a484ee5bc8ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:19.434015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:19.434773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:19.435209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:19.435942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:19.436161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0f617ab-f616-4c5c-8197-a484ee5bc8ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:19.436391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:19.436697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0f617ab-f616-4c5c-8197-a484ee5bc8ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:19.436914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:19.437155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0f617ab-f616-4c5c-8197-a484ee5bc8ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:19.437869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0f617ab-f616-4c5c-8197-a484ee5bc8ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:19.438362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0f617ab-f616-4c5c-8197-a484ee5bc8ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:19.438784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a0f617ab-f616-4c5c-8197-a484ee5bc8ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:19.454908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:19.512775 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a0f617ab-f616-4c5c-8197-a484ee5bc8ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:19.522263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a0f617ab-f616-4c5c-8197-a484ee5bc8ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.099308 Aug 24 06:37:19.522867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1155/2316] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:19 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:19.596204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:19.605932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:19.607457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:19.608676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-78f2712b-e3e0-4a8f-b996-b5782202c9e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.187554 Aug 24 06:37:19.609250 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1162/2317] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:19.948546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a955f15a-8da8-493b-a194-0b135454a676 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:19.949305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a955f15a-8da8-493b-a194-0b135454a676 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:19.956367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a955f15a-8da8-493b-a194-0b135454a676 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:19.956945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a955f15a-8da8-493b-a194-0b135454a676 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:19.957382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a955f15a-8da8-493b-a194-0b135454a676 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:19.958096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a955f15a-8da8-493b-a194-0b135454a676 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:19.958556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a955f15a-8da8-493b-a194-0b135454a676 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:19.958982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a955f15a-8da8-493b-a194-0b135454a676 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:20.124339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a955f15a-8da8-493b-a194-0b135454a676 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:20.133226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a955f15a-8da8-493b-a194-0b135454a676 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.190122 Aug 24 06:37:20.138466 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1156/2318] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:19 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:20.546395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-13898530-0487-4476-8873-29f0a2b9366a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:20.549890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-13898530-0487-4476-8873-29f0a2b9366a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:20.554070 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13898530-0487-4476-8873-29f0a2b9366a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:20.554549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13898530-0487-4476-8873-29f0a2b9366a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:20.554986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13898530-0487-4476-8873-29f0a2b9366a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:20.555683 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13898530-0487-4476-8873-29f0a2b9366a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:20.556133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13898530-0487-4476-8873-29f0a2b9366a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:20.556870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-13898530-0487-4476-8873-29f0a2b9366a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:20.624741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-13898530-0487-4476-8873-29f0a2b9366a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:20.634282 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:20.635897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:20.638375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-13898530-0487-4476-8873-29f0a2b9366a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.095511 Aug 24 06:37:20.639389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1163/2319] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:20.641549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:20.642037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:20.642473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:20.643332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:20.643704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:20.644124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:20.786868 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:20.795860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:20.797486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:20.799138 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8eb77a66-dd15-4b67-b70f-7257c54a99e0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.168808 Aug 24 06:37:20.799714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1157/2320] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:20 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:21.155672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-57c10f03-1b5a-4fe2-b219-2fbbe5fe89d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:21.156242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-57c10f03-1b5a-4fe2-b219-2fbbe5fe89d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:21.162983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57c10f03-1b5a-4fe2-b219-2fbbe5fe89d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:21.163461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57c10f03-1b5a-4fe2-b219-2fbbe5fe89d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:21.163889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57c10f03-1b5a-4fe2-b219-2fbbe5fe89d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:21.164613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57c10f03-1b5a-4fe2-b219-2fbbe5fe89d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:21.165057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57c10f03-1b5a-4fe2-b219-2fbbe5fe89d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:21.165545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57c10f03-1b5a-4fe2-b219-2fbbe5fe89d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:21.360462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-57c10f03-1b5a-4fe2-b219-2fbbe5fe89d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:21.369294 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-57c10f03-1b5a-4fe2-b219-2fbbe5fe89d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.217628 Aug 24 06:37:21.369939 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1164/2321] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:21 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:21.671742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d9367852-ccfa-4d85-819e-c19a5598ee8a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:21.672541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d9367852-ccfa-4d85-819e-c19a5598ee8a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:21.679831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9367852-ccfa-4d85-819e-c19a5598ee8a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:21.680320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9367852-ccfa-4d85-819e-c19a5598ee8a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:21.680781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9367852-ccfa-4d85-819e-c19a5598ee8a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:21.681481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9367852-ccfa-4d85-819e-c19a5598ee8a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:21.681928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9367852-ccfa-4d85-819e-c19a5598ee8a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:21.682384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d9367852-ccfa-4d85-819e-c19a5598ee8a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:21.751447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d9367852-ccfa-4d85-819e-c19a5598ee8a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:21.759968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d9367852-ccfa-4d85-819e-c19a5598ee8a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.092345 Aug 24 06:37:21.760572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1158/2322] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:21 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:21.835153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:21.836083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:21.842726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:21.848162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:21.848162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:21.848162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:21.848162 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:21.848745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:21.997184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:22.017805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:22.020831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:22.022979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fd695a5d-664b-4134-9050-df794305bdd3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.191961 Aug 24 06:37:22.023988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1165/2323] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:22.391684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2d314d33-61df-4145-96de-c865ec5b860b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:22.392742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2d314d33-61df-4145-96de-c865ec5b860b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:22.398962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d314d33-61df-4145-96de-c865ec5b860b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:22.399440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d314d33-61df-4145-96de-c865ec5b860b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:22.399867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d314d33-61df-4145-96de-c865ec5b860b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:22.400593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d314d33-61df-4145-96de-c865ec5b860b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:22.401043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d314d33-61df-4145-96de-c865ec5b860b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:22.401454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2d314d33-61df-4145-96de-c865ec5b860b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:22.538658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2d314d33-61df-4145-96de-c865ec5b860b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:22.548998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2d314d33-61df-4145-96de-c865ec5b860b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.161268 Aug 24 06:37:22.549721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1159/2324] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:22 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:22.781512 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b8ca8158-8be3-4bc5-a2c4-9c76e8913a71 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:22.782289 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b8ca8158-8be3-4bc5-a2c4-9c76e8913a71 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:22.789506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ca8158-8be3-4bc5-a2c4-9c76e8913a71 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:22.789991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ca8158-8be3-4bc5-a2c4-9c76e8913a71 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:22.790447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ca8158-8be3-4bc5-a2c4-9c76e8913a71 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:22.791153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ca8158-8be3-4bc5-a2c4-9c76e8913a71 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:22.791603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ca8158-8be3-4bc5-a2c4-9c76e8913a71 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:22.792022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ca8158-8be3-4bc5-a2c4-9c76e8913a71 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:22.864082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b8ca8158-8be3-4bc5-a2c4-9c76e8913a71 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:22.872766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b8ca8158-8be3-4bc5-a2c4-9c76e8913a71 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.095503 Aug 24 06:37:22.873346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1166/2325] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:23.062335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:23.062950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:23.069769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:23.070261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:23.070694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:23.071407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:23.071858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:23.072306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:23.213694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:23.223107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:23.224661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:23.225865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5b6f01ab-55ce-4f92-8942-a13e35eedab8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.168015 Aug 24 06:37:23.226428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1160/2326] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:23.573890 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c89dde1d-e5d1-4314-b1f9-dda291c31dba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:23.574509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c89dde1d-e5d1-4314-b1f9-dda291c31dba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:23.581829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c89dde1d-e5d1-4314-b1f9-dda291c31dba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:23.582322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c89dde1d-e5d1-4314-b1f9-dda291c31dba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:23.582761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c89dde1d-e5d1-4314-b1f9-dda291c31dba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:23.583491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c89dde1d-e5d1-4314-b1f9-dda291c31dba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:23.583959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c89dde1d-e5d1-4314-b1f9-dda291c31dba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:23.584386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c89dde1d-e5d1-4314-b1f9-dda291c31dba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:23.734726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c89dde1d-e5d1-4314-b1f9-dda291c31dba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:23.744078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c89dde1d-e5d1-4314-b1f9-dda291c31dba tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.174173 Aug 24 06:37:23.744712 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1167/2327] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:23 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:23.894786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3140db53-ca7e-497c-aa07-1bc4d9921cfb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:23.895493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3140db53-ca7e-497c-aa07-1bc4d9921cfb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:23.902026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3140db53-ca7e-497c-aa07-1bc4d9921cfb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:23.902583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3140db53-ca7e-497c-aa07-1bc4d9921cfb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:23.903052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3140db53-ca7e-497c-aa07-1bc4d9921cfb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:23.903785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3140db53-ca7e-497c-aa07-1bc4d9921cfb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:23.904271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3140db53-ca7e-497c-aa07-1bc4d9921cfb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:23.904763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3140db53-ca7e-497c-aa07-1bc4d9921cfb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:23.974214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3140db53-ca7e-497c-aa07-1bc4d9921cfb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:23.983366 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3140db53-ca7e-497c-aa07-1bc4d9921cfb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093283 Aug 24 06:37:23.984010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1161/2328] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:23 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:24.254179 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:24.255303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:24.267380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:24.268235 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:24.269080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:24.270321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:24.271156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:24.271920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:24.413559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:24.422642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:24.424704 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:24.425880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0638e302-7264-4b4b-a31b-5200c5f63c52 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.179690 Aug 24 06:37:24.426452 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1168/2329] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:24.766218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-051cc26c-351e-44e2-bae0-69c4d7c724ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:24.766883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-051cc26c-351e-44e2-bae0-69c4d7c724ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:24.773387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-051cc26c-351e-44e2-bae0-69c4d7c724ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:24.773867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-051cc26c-351e-44e2-bae0-69c4d7c724ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:24.774304 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-051cc26c-351e-44e2-bae0-69c4d7c724ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:24.774992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-051cc26c-351e-44e2-bae0-69c4d7c724ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:24.775437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-051cc26c-351e-44e2-bae0-69c4d7c724ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:24.775856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-051cc26c-351e-44e2-bae0-69c4d7c724ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:24.909519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-051cc26c-351e-44e2-bae0-69c4d7c724ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:24.917901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-051cc26c-351e-44e2-bae0-69c4d7c724ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.155774 Aug 24 06:37:24.918469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1162/2330] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:24 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:25.005418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-943f3c09-7412-4df7-8147-4f7296711124 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:25.005948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-943f3c09-7412-4df7-8147-4f7296711124 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:25.007894 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=76 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:25.012742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-943f3c09-7412-4df7-8147-4f7296711124 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:25.013236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-943f3c09-7412-4df7-8147-4f7296711124 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:25.013677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-943f3c09-7412-4df7-8147-4f7296711124 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:25.014375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-943f3c09-7412-4df7-8147-4f7296711124 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:25.014833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-943f3c09-7412-4df7-8147-4f7296711124 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:25.015263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-943f3c09-7412-4df7-8147-4f7296711124 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:25.079994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-943f3c09-7412-4df7-8147-4f7296711124 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:25.088474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-943f3c09-7412-4df7-8147-4f7296711124 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087033 Aug 24 06:37:25.089077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1169/2331] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:25.450408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:25.451014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:25.457667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:25.458147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:25.458577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:25.459262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:25.459728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:25.460135 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:25.593636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:25.602935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:25.604441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:25.605636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3d1d0c10-7ffb-435f-b3c9-e4b81c8c2991 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159385 Aug 24 06:37:25.606199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1163/2332] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:25.941882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b06ebee7-acc4-4020-97a3-317fb7c88c85 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:25.942558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b06ebee7-acc4-4020-97a3-317fb7c88c85 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:25.949689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b06ebee7-acc4-4020-97a3-317fb7c88c85 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:25.950182 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b06ebee7-acc4-4020-97a3-317fb7c88c85 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:25.950625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b06ebee7-acc4-4020-97a3-317fb7c88c85 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:25.951372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b06ebee7-acc4-4020-97a3-317fb7c88c85 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:25.951831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b06ebee7-acc4-4020-97a3-317fb7c88c85 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:25.952256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b06ebee7-acc4-4020-97a3-317fb7c88c85 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:26.103520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b06ebee7-acc4-4020-97a3-317fb7c88c85 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:26.109741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bf63ac7a-8947-48ef-8316-c234de721282 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:26.110363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bf63ac7a-8947-48ef-8316-c234de721282 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:26.115941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b06ebee7-acc4-4020-97a3-317fb7c88c85 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.179329 Aug 24 06:37:26.124557 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1170/2333] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:25 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:26.124919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf63ac7a-8947-48ef-8316-c234de721282 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:26.124919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf63ac7a-8947-48ef-8316-c234de721282 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:26.124919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf63ac7a-8947-48ef-8316-c234de721282 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:26.124919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf63ac7a-8947-48ef-8316-c234de721282 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:26.125652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf63ac7a-8947-48ef-8316-c234de721282 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:26.125652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bf63ac7a-8947-48ef-8316-c234de721282 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:26.199594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bf63ac7a-8947-48ef-8316-c234de721282 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:26.208621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bf63ac7a-8947-48ef-8316-c234de721282 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.102618 Aug 24 06:37:26.209213 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1164/2334] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:26.629197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:26.629913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:26.636794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:26.637353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:26.637827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:26.638583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:26.639074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:26.639661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:26.782919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:26.792358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:26.794170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:26.795410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fd3365a1-e424-4e1c-9397-348a501d84fe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.171079 Aug 24 06:37:26.796028 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1171/2335] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:27.145893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bd0e01f7-d13a-4aa2-8f25-3e7fa4966c3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:27.146698 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bd0e01f7-d13a-4aa2-8f25-3e7fa4966c3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:27.153832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd0e01f7-d13a-4aa2-8f25-3e7fa4966c3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:27.154308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd0e01f7-d13a-4aa2-8f25-3e7fa4966c3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:27.154732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd0e01f7-d13a-4aa2-8f25-3e7fa4966c3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:27.155436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd0e01f7-d13a-4aa2-8f25-3e7fa4966c3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:27.155881 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd0e01f7-d13a-4aa2-8f25-3e7fa4966c3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:27.156300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd0e01f7-d13a-4aa2-8f25-3e7fa4966c3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:27.231973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7bd6d300-9326-42a4-bd63-9f434245bf5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:27.232949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7bd6d300-9326-42a4-bd63-9f434245bf5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:27.241421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bd6d300-9326-42a4-bd63-9f434245bf5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:27.242015 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bd6d300-9326-42a4-bd63-9f434245bf5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:27.242547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bd6d300-9326-42a4-bd63-9f434245bf5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:27.243824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bd6d300-9326-42a4-bd63-9f434245bf5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:27.244056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bd6d300-9326-42a4-bd63-9f434245bf5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:27.246593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7bd6d300-9326-42a4-bd63-9f434245bf5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:27.325908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bd0e01f7-d13a-4aa2-8f25-3e7fa4966c3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:27.341972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bd0e01f7-d13a-4aa2-8f25-3e7fa4966c3c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.200157 Aug 24 06:37:27.343052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1165/2336] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:27 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:27.347483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7bd6d300-9326-42a4-bd63-9f434245bf5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:27.357395 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7bd6d300-9326-42a4-bd63-9f434245bf5f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.129526 Aug 24 06:37:27.358138 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1172/2337] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:27.819987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:27.820614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:27.827423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:27.828049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:27.828659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:27.829584 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:27.830225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:27.830741 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:27.967476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:27.977297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:27.979425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:27.980797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-096ae9b4-c5ff-413d-b245-0e5563fcf8a1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.164824 Aug 24 06:37:27.981442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1166/2338] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:28.367798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a4ab10d7-199c-497e-8fa9-703fb37af204 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:28.368448 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a4ab10d7-199c-497e-8fa9-703fb37af204 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:28.375367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a4ab10d7-199c-497e-8fa9-703fb37af204 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:28.375853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a4ab10d7-199c-497e-8fa9-703fb37af204 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:28.376917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a4ab10d7-199c-497e-8fa9-703fb37af204 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:28.377630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a4ab10d7-199c-497e-8fa9-703fb37af204 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:28.378083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a4ab10d7-199c-497e-8fa9-703fb37af204 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:28.378510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a4ab10d7-199c-497e-8fa9-703fb37af204 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:28.383925 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9014c240-ece5-460b-b5f0-1897531329d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:28.385037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9014c240-ece5-460b-b5f0-1897531329d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:28.397031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9014c240-ece5-460b-b5f0-1897531329d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:28.397903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9014c240-ece5-460b-b5f0-1897531329d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:28.398687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9014c240-ece5-460b-b5f0-1897531329d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:28.399947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9014c240-ece5-460b-b5f0-1897531329d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:28.400767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9014c240-ece5-460b-b5f0-1897531329d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:28.401513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9014c240-ece5-460b-b5f0-1897531329d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:28.431172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:28.504722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9014c240-ece5-460b-b5f0-1897531329d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:28.518884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9014c240-ece5-460b-b5f0-1897531329d1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.142338 Aug 24 06:37:28.519954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1167/2339] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:28 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:28.540103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a4ab10d7-199c-497e-8fa9-703fb37af204 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:28.548867 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a4ab10d7-199c-497e-8fa9-703fb37af204 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.184907 Aug 24 06:37:28.549449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1173/2340] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:28 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:29.005002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:29.005522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:29.011861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:29.012515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:29.013020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:29.013836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:29.014398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:29.014857 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:29.158037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:29.167384 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:29.168935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:29.170153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b16d65af-053c-4358-a6d0-d1795ea8a872 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.169369 Aug 24 06:37:29.170718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1168/2341] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:28 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:29.552761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4130b34e-0e12-42c5-b121-fb04984a26dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:29.553887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4130b34e-0e12-42c5-b121-fb04984a26dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:29.565399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4130b34e-0e12-42c5-b121-fb04984a26dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:29.566239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4130b34e-0e12-42c5-b121-fb04984a26dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:29.566951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4130b34e-0e12-42c5-b121-fb04984a26dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:29.568169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4130b34e-0e12-42c5-b121-fb04984a26dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:29.569066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4130b34e-0e12-42c5-b121-fb04984a26dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:29.569805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4130b34e-0e12-42c5-b121-fb04984a26dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:29.571295 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1f9bb4da-1586-419e-894f-44a381ae3640 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:29.571911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1f9bb4da-1586-419e-894f-44a381ae3640 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:29.579545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4da-1586-419e-894f-44a381ae3640 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:29.580046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4da-1586-419e-894f-44a381ae3640 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:29.580478 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4da-1586-419e-894f-44a381ae3640 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:29.581359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4da-1586-419e-894f-44a381ae3640 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:29.581807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4da-1586-419e-894f-44a381ae3640 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:29.582234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f9bb4da-1586-419e-894f-44a381ae3640 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:29.666590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4130b34e-0e12-42c5-b121-fb04984a26dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:29.681518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4130b34e-0e12-42c5-b121-fb04984a26dc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.135978 Aug 24 06:37:29.682739 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1174/2342] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:29.742968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1f9bb4da-1586-419e-894f-44a381ae3640 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:29.751516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1f9bb4da-1586-419e-894f-44a381ae3640 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.184781 Aug 24 06:37:29.752159 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1169/2343] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:29 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:30.193790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:30.194402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:30.201485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:30.201969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:30.202400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:30.203097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:30.203543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:30.204053 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:30.350868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:30.361128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:30.362749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:30.364095 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-28a88195-da75-4709-80dc-fbda92a11b38 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.174408 Aug 24 06:37:30.364698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1175/2344] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:30.702787 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-453d8521-2810-4437-a564-3988c8309bd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:30.703498 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-453d8521-2810-4437-a564-3988c8309bd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:30.710874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-453d8521-2810-4437-a564-3988c8309bd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:30.712134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-453d8521-2810-4437-a564-3988c8309bd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:30.712134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-453d8521-2810-4437-a564-3988c8309bd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:30.712540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-453d8521-2810-4437-a564-3988c8309bd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:30.712978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-453d8521-2810-4437-a564-3988c8309bd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:30.713409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-453d8521-2810-4437-a564-3988c8309bd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:30.777917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9057bce8-d187-4e56-89c2-4a679b8bb35a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:30.779114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9057bce8-d187-4e56-89c2-4a679b8bb35a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:30.791662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9057bce8-d187-4e56-89c2-4a679b8bb35a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:30.792588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9057bce8-d187-4e56-89c2-4a679b8bb35a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:30.793372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9057bce8-d187-4e56-89c2-4a679b8bb35a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:30.794655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9057bce8-d187-4e56-89c2-4a679b8bb35a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:30.795485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9057bce8-d187-4e56-89c2-4a679b8bb35a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:30.796295 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9057bce8-d187-4e56-89c2-4a679b8bb35a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:30.803413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-453d8521-2810-4437-a564-3988c8309bd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:30.815264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-453d8521-2810-4437-a564-3988c8309bd1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.116337 Aug 24 06:37:30.816381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1170/2345] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:30.945357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9057bce8-d187-4e56-89c2-4a679b8bb35a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:30.954379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9057bce8-d187-4e56-89c2-4a679b8bb35a tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.183616 Aug 24 06:37:30.954896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1176/2346] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:30 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:31.387912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:31.388542 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:31.395028 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:31.395509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:31.395932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:31.396659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:31.397106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:31.397524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:31.535085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:31.544527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:31.546018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:31.547212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-30e8319e-55ae-49f4-8298-d88b50c7b73e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163410 Aug 24 06:37:31.548445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1171/2347] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:31.838731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bcaf7d83-aceb-4b48-b021-8b858bf99443 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:31.839317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bcaf7d83-aceb-4b48-b021-8b858bf99443 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:31.847307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bcaf7d83-aceb-4b48-b021-8b858bf99443 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:31.847936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bcaf7d83-aceb-4b48-b021-8b858bf99443 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:31.848488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bcaf7d83-aceb-4b48-b021-8b858bf99443 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:31.849231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bcaf7d83-aceb-4b48-b021-8b858bf99443 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:31.849687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bcaf7d83-aceb-4b48-b021-8b858bf99443 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:31.850109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bcaf7d83-aceb-4b48-b021-8b858bf99443 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:31.919155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bcaf7d83-aceb-4b48-b021-8b858bf99443 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:31.928529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bcaf7d83-aceb-4b48-b021-8b858bf99443 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.094010 Aug 24 06:37:31.929144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1177/2348] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:31 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:31.975865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a9474e01-d319-472a-8648-43fd12dac9e5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:31.976511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a9474e01-d319-472a-8648-43fd12dac9e5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:31.983607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9474e01-d319-472a-8648-43fd12dac9e5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:31.984123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9474e01-d319-472a-8648-43fd12dac9e5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:31.984586 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9474e01-d319-472a-8648-43fd12dac9e5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:31.985822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9474e01-d319-472a-8648-43fd12dac9e5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:31.986272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9474e01-d319-472a-8648-43fd12dac9e5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:31.986713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a9474e01-d319-472a-8648-43fd12dac9e5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:32.131277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a9474e01-d319-472a-8648-43fd12dac9e5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:32.140013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a9474e01-d319-472a-8648-43fd12dac9e5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.168198 Aug 24 06:37:32.140632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1172/2349] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:31 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:32.586099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:32.586700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:32.593333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:32.593827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:32.594268 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:32.595618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:32.596075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:32.596529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:32.748658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:32.763621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:32.767199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:32.769428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-214af1b9-9ee4-4a81-9f5f-34951e2e6db1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.187118 Aug 24 06:37:32.770460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1178/2350] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:32.961261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ff05ecdc-dc6d-4a86-a2e1-ff10348a3619 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:32.962109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ff05ecdc-dc6d-4a86-a2e1-ff10348a3619 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:32.970057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff05ecdc-dc6d-4a86-a2e1-ff10348a3619 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:32.970591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff05ecdc-dc6d-4a86-a2e1-ff10348a3619 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:32.971066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff05ecdc-dc6d-4a86-a2e1-ff10348a3619 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:32.972023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff05ecdc-dc6d-4a86-a2e1-ff10348a3619 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:32.972650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff05ecdc-dc6d-4a86-a2e1-ff10348a3619 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:32.973126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ff05ecdc-dc6d-4a86-a2e1-ff10348a3619 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:33.052109 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ff05ecdc-dc6d-4a86-a2e1-ff10348a3619 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:33.061382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ff05ecdc-dc6d-4a86-a2e1-ff10348a3619 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.104041 Aug 24 06:37:33.061981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1173/2351] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:33.161976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-dcd5835c-4aee-4ee8-9267-6529a1a2c489 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:33.162738 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-dcd5835c-4aee-4ee8-9267-6529a1a2c489 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:33.169887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcd5835c-4aee-4ee8-9267-6529a1a2c489 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:33.170374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcd5835c-4aee-4ee8-9267-6529a1a2c489 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:33.170803 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcd5835c-4aee-4ee8-9267-6529a1a2c489 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:33.171492 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcd5835c-4aee-4ee8-9267-6529a1a2c489 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:33.171936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcd5835c-4aee-4ee8-9267-6529a1a2c489 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:33.172349 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dcd5835c-4aee-4ee8-9267-6529a1a2c489 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:33.176023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:33.324466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-dcd5835c-4aee-4ee8-9267-6529a1a2c489 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:33.334409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-dcd5835c-4aee-4ee8-9267-6529a1a2c489 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.176405 Aug 24 06:37:33.335083 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1179/2352] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:33 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:33.798846 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:33.799975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:33.810546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:33.811377 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:33.812136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:33.813394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:33.814211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:33.814937 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:33.975607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:33.984883 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:33.986496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:33.987806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a40b07ec-6747-4e6e-bcde-0095f748ec2b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.197085 Aug 24 06:37:33.988378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1174/2353] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:34.082240 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8a82c75b-58dc-4746-98f6-9e91d035da23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:34.082975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8a82c75b-58dc-4746-98f6-9e91d035da23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:34.089626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8a82c75b-58dc-4746-98f6-9e91d035da23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:34.090120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8a82c75b-58dc-4746-98f6-9e91d035da23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:34.090559 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8a82c75b-58dc-4746-98f6-9e91d035da23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:34.091270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8a82c75b-58dc-4746-98f6-9e91d035da23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:34.091723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8a82c75b-58dc-4746-98f6-9e91d035da23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:34.092146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8a82c75b-58dc-4746-98f6-9e91d035da23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:34.159822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8a82c75b-58dc-4746-98f6-9e91d035da23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:34.174830 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8a82c75b-58dc-4746-98f6-9e91d035da23 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.096622 Aug 24 06:37:34.175916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1180/2354] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:34 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:34.355952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-31c5be89-8b3d-441c-a750-f39b128e0fd9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:34.356661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-31c5be89-8b3d-441c-a750-f39b128e0fd9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:34.363628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31c5be89-8b3d-441c-a750-f39b128e0fd9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:34.364119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31c5be89-8b3d-441c-a750-f39b128e0fd9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:34.364596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31c5be89-8b3d-441c-a750-f39b128e0fd9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:34.365325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31c5be89-8b3d-441c-a750-f39b128e0fd9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:34.365784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31c5be89-8b3d-441c-a750-f39b128e0fd9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:34.366208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-31c5be89-8b3d-441c-a750-f39b128e0fd9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:34.511773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-31c5be89-8b3d-441c-a750-f39b128e0fd9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:34.520546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-31c5be89-8b3d-441c-a750-f39b128e0fd9 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.168520 Aug 24 06:37:34.521431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1175/2355] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:34 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:35.012537 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:35.013145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:35.020787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:35.021309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:35.021753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:35.022476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:35.022935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:35.023363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:35.196420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:35.208536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-095035d1-8019-4171-8cd6-a209b65d6865 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:35.209317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-095035d1-8019-4171-8cd6-a209b65d6865 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:35.214201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:35.216609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-095035d1-8019-4171-8cd6-a209b65d6865 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:35.217106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-095035d1-8019-4171-8cd6-a209b65d6865 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:35.217327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:35.217561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-095035d1-8019-4171-8cd6-a209b65d6865 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:35.218930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-095035d1-8019-4171-8cd6-a209b65d6865 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:35.219360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9e30e0e2-434d-44ad-84dd-6d0cd207366a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.210695 Aug 24 06:37:35.219521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-095035d1-8019-4171-8cd6-a209b65d6865 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:35.219809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-095035d1-8019-4171-8cd6-a209b65d6865 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:35.220389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1181/2356] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:35.292084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-095035d1-8019-4171-8cd6-a209b65d6865 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:35.301010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-095035d1-8019-4171-8cd6-a209b65d6865 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.097342 Aug 24 06:37:35.301597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1176/2357] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:35.542702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-07dcd07f-1625-4901-a67d-e3884e0e5ff6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:35.543219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-07dcd07f-1625-4901-a67d-e3884e0e5ff6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:35.551635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dcd07f-1625-4901-a67d-e3884e0e5ff6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:35.552403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dcd07f-1625-4901-a67d-e3884e0e5ff6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:35.553062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dcd07f-1625-4901-a67d-e3884e0e5ff6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:35.554119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dcd07f-1625-4901-a67d-e3884e0e5ff6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:35.554947 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dcd07f-1625-4901-a67d-e3884e0e5ff6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:35.555585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07dcd07f-1625-4901-a67d-e3884e0e5ff6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:35.727799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-07dcd07f-1625-4901-a67d-e3884e0e5ff6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:35.738096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-07dcd07f-1625-4901-a67d-e3884e0e5ff6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.199250 Aug 24 06:37:35.738686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1182/2358] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:35 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:36.243830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:36.244484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:36.252024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:36.252533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:36.252967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:36.253666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:36.254111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:36.254535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:36.327715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c9ea98de-6757-4e8d-b09e-6b6285f8f357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:36.329526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c9ea98de-6757-4e8d-b09e-6b6285f8f357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:36.341177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c9ea98de-6757-4e8d-b09e-6b6285f8f357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:36.342036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c9ea98de-6757-4e8d-b09e-6b6285f8f357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:36.342785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c9ea98de-6757-4e8d-b09e-6b6285f8f357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:36.344004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c9ea98de-6757-4e8d-b09e-6b6285f8f357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:36.344833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c9ea98de-6757-4e8d-b09e-6b6285f8f357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:36.345550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c9ea98de-6757-4e8d-b09e-6b6285f8f357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:36.397975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:36.407188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:36.408760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:36.409956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5686bcc8-fe99-47ce-8ea7-888734843640 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.170061 Aug 24 06:37:36.410531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1177/2359] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:36.440074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c9ea98de-6757-4e8d-b09e-6b6285f8f357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:36.448658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c9ea98de-6757-4e8d-b09e-6b6285f8f357 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.128239 Aug 24 06:37:36.449241 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1183/2360] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:36 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:36.760013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c57ce566-d82e-4d2c-87b0-5ccf8787dc4b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:36.760734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c57ce566-d82e-4d2c-87b0-5ccf8787dc4b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:36.768678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c57ce566-d82e-4d2c-87b0-5ccf8787dc4b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:36.769218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c57ce566-d82e-4d2c-87b0-5ccf8787dc4b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:36.769699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c57ce566-d82e-4d2c-87b0-5ccf8787dc4b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:36.770467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c57ce566-d82e-4d2c-87b0-5ccf8787dc4b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:36.770977 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c57ce566-d82e-4d2c-87b0-5ccf8787dc4b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:36.771512 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c57ce566-d82e-4d2c-87b0-5ccf8787dc4b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:36.921093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c57ce566-d82e-4d2c-87b0-5ccf8787dc4b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:36.930688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c57ce566-d82e-4d2c-87b0-5ccf8787dc4b tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.174667 Aug 24 06:37:36.931300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1178/2361] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:36 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:37.437562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:37.438941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:37.450398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:37.451251 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:37.452012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:37.453277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:37.454071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:37.454811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:37.486328 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f57e0e62-96cc-46dc-8fe1-195708bb6e98 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:37.487389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f57e0e62-96cc-46dc-8fe1-195708bb6e98 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:37.498156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f57e0e62-96cc-46dc-8fe1-195708bb6e98 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:37.498931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f57e0e62-96cc-46dc-8fe1-195708bb6e98 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:37.499630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f57e0e62-96cc-46dc-8fe1-195708bb6e98 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:37.500807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f57e0e62-96cc-46dc-8fe1-195708bb6e98 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:37.501628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f57e0e62-96cc-46dc-8fe1-195708bb6e98 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:37.502254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f57e0e62-96cc-46dc-8fe1-195708bb6e98 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:37.590088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f57e0e62-96cc-46dc-8fe1-195708bb6e98 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:37.601530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f57e0e62-96cc-46dc-8fe1-195708bb6e98 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.122393 Aug 24 06:37:37.602134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1179/2362] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:37.647777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:37.658146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:37.666080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:37.666080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-77cfb287-40e4-49b5-8f57-7855b108493d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.230811 Aug 24 06:37:37.666080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1184/2363] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:37.955843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-57de2702-216a-4e08-8f21-238aafe1d025 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:37.956723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-57de2702-216a-4e08-8f21-238aafe1d025 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:37.963040 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57de2702-216a-4e08-8f21-238aafe1d025 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:37.963524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57de2702-216a-4e08-8f21-238aafe1d025 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:37.963952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57de2702-216a-4e08-8f21-238aafe1d025 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:37.964699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57de2702-216a-4e08-8f21-238aafe1d025 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:37.965144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57de2702-216a-4e08-8f21-238aafe1d025 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:37.965563 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-57de2702-216a-4e08-8f21-238aafe1d025 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:38.118055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-57de2702-216a-4e08-8f21-238aafe1d025 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:38.127008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-57de2702-216a-4e08-8f21-238aafe1d025 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.176876 Aug 24 06:37:38.127754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1180/2364] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:37 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:38.630282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-84f16be3-c65d-4f41-8f08-f487f339f2e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:38.631007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-84f16be3-c65d-4f41-8f08-f487f339f2e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:38.638190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-84f16be3-c65d-4f41-8f08-f487f339f2e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:38.638684 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-84f16be3-c65d-4f41-8f08-f487f339f2e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:38.639123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-84f16be3-c65d-4f41-8f08-f487f339f2e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:38.639822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-84f16be3-c65d-4f41-8f08-f487f339f2e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:38.640274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-84f16be3-c65d-4f41-8f08-f487f339f2e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:38.640734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-84f16be3-c65d-4f41-8f08-f487f339f2e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:38.699537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:38.700243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:38.707239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-84f16be3-c65d-4f41-8f08-f487f339f2e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:38.711119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:38.712032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:38.712826 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:38.714424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:38.714999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:38.715703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:38.718447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-84f16be3-c65d-4f41-8f08-f487f339f2e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.092465 Aug 24 06:37:38.722631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1185/2365] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:38 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:38.870831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:38.880995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:38.882452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:38.883666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4a8c24ba-3120-4adf-8c71-5cbd57ed6131 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.188129 Aug 24 06:37:38.884244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1181/2366] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:39.152536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-bf74be02-f594-4396-bba1-55bbe0e930e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:39.153406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-bf74be02-f594-4396-bba1-55bbe0e930e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:39.163822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf74be02-f594-4396-bba1-55bbe0e930e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:39.164665 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf74be02-f594-4396-bba1-55bbe0e930e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:39.165374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf74be02-f594-4396-bba1-55bbe0e930e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:39.166585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf74be02-f594-4396-bba1-55bbe0e930e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:39.167381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf74be02-f594-4396-bba1-55bbe0e930e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:39.168142 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-bf74be02-f594-4396-bba1-55bbe0e930e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:39.333967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-bf74be02-f594-4396-bba1-55bbe0e930e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:39.343092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-bf74be02-f594-4396-bba1-55bbe0e930e3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.197606 Aug 24 06:37:39.343733 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1186/2367] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:39 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:39.743410 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d0b1ce67-6d28-4b46-a2e9-66c7244f4232 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:39.744087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d0b1ce67-6d28-4b46-a2e9-66c7244f4232 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:39.750900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1ce67-6d28-4b46-a2e9-66c7244f4232 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:39.751379 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1ce67-6d28-4b46-a2e9-66c7244f4232 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:39.751810 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1ce67-6d28-4b46-a2e9-66c7244f4232 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:39.752553 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1ce67-6d28-4b46-a2e9-66c7244f4232 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:39.753000 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1ce67-6d28-4b46-a2e9-66c7244f4232 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:39.753414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d0b1ce67-6d28-4b46-a2e9-66c7244f4232 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:39.823442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d0b1ce67-6d28-4b46-a2e9-66c7244f4232 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:39.832920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d0b1ce67-6d28-4b46-a2e9-66c7244f4232 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093342 Aug 24 06:37:39.833508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1182/2368] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:39 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:39.908700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:39.909614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:39.916236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:39.916766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:39.917200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:39.917915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:39.918373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:39.918794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:40.078200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:40.093753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:40.096128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:40.097977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-80f2aa68-2169-406e-91ed-4cc195119980 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.193178 Aug 24 06:37:40.098843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1187/2369] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:39 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:40.365669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-807dd516-afb9-41e7-a2a3-2a5eda0fcb00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:40.366218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-807dd516-afb9-41e7-a2a3-2a5eda0fcb00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:40.372751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-807dd516-afb9-41e7-a2a3-2a5eda0fcb00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:40.373244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-807dd516-afb9-41e7-a2a3-2a5eda0fcb00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:40.373677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-807dd516-afb9-41e7-a2a3-2a5eda0fcb00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:40.374387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-807dd516-afb9-41e7-a2a3-2a5eda0fcb00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:40.374865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-807dd516-afb9-41e7-a2a3-2a5eda0fcb00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:40.375285 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-807dd516-afb9-41e7-a2a3-2a5eda0fcb00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:40.517063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-807dd516-afb9-41e7-a2a3-2a5eda0fcb00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:40.526142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-807dd516-afb9-41e7-a2a3-2a5eda0fcb00 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164607 Aug 24 06:37:40.526740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1183/2370] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:40 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:40.854417 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0a38db56-8f94-437f-8a96-815c37a33fad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:40.855062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0a38db56-8f94-437f-8a96-815c37a33fad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:40.862151 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a38db56-8f94-437f-8a96-815c37a33fad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:40.862637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a38db56-8f94-437f-8a96-815c37a33fad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:40.863073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a38db56-8f94-437f-8a96-815c37a33fad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:40.863787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a38db56-8f94-437f-8a96-815c37a33fad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:40.864237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a38db56-8f94-437f-8a96-815c37a33fad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:40.864701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0a38db56-8f94-437f-8a96-815c37a33fad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:40.933958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0a38db56-8f94-437f-8a96-815c37a33fad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:40.943857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0a38db56-8f94-437f-8a96-815c37a33fad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093364 Aug 24 06:37:40.944445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1188/2371] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:40 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:41.123128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:41.123794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:41.131596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:41.132085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:41.132534 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:41.133383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:41.133946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:41.134224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:41.136819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:41.276473 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:41.289373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:41.290991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:41.292222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-018ead79-d1ec-49fe-b5af-1d4d6c74ec41 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.173215 Aug 24 06:37:41.292850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1184/2372] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:41 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:41.548674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2e7e646e-1d84-4401-bf88-58168e435ac4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:41.549288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2e7e646e-1d84-4401-bf88-58168e435ac4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:41.555730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e7e646e-1d84-4401-bf88-58168e435ac4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:41.556222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e7e646e-1d84-4401-bf88-58168e435ac4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:41.556683 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e7e646e-1d84-4401-bf88-58168e435ac4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:41.557396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e7e646e-1d84-4401-bf88-58168e435ac4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:41.557844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e7e646e-1d84-4401-bf88-58168e435ac4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:41.558272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e7e646e-1d84-4401-bf88-58168e435ac4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:41.698875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2e7e646e-1d84-4401-bf88-58168e435ac4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:41.712875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2e7e646e-1d84-4401-bf88-58168e435ac4 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.168010 Aug 24 06:37:41.713471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1189/2373] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:41 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:41.967449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8ac84f46-a63a-456d-9085-4536b494f177 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:41.968523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8ac84f46-a63a-456d-9085-4536b494f177 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:41.975670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac84f46-a63a-456d-9085-4536b494f177 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:41.976154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac84f46-a63a-456d-9085-4536b494f177 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:41.976696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac84f46-a63a-456d-9085-4536b494f177 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:41.977394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac84f46-a63a-456d-9085-4536b494f177 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:41.977843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac84f46-a63a-456d-9085-4536b494f177 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:41.978253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ac84f46-a63a-456d-9085-4536b494f177 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:42.046475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8ac84f46-a63a-456d-9085-4536b494f177 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:42.055012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8ac84f46-a63a-456d-9085-4536b494f177 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093711 Aug 24 06:37:42.055597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1185/2374] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:41 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:42.315768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:42.316379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:42.323114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:42.323597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:42.324030 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:42.324756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:42.325207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:42.325629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:42.455079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:42.464423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:42.466123 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:42.467145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a6c28fda-ae5b-4d75-a7f3-19ced2e71d6b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155451 Aug 24 06:37:42.467703 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1190/2375] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:42.734281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-db773305-d775-46d5-af03-5ef46f090a88 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:42.734940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-db773305-d775-46d5-af03-5ef46f090a88 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:42.742168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db773305-d775-46d5-af03-5ef46f090a88 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:42.742655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db773305-d775-46d5-af03-5ef46f090a88 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:42.743091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db773305-d775-46d5-af03-5ef46f090a88 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:42.743798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db773305-d775-46d5-af03-5ef46f090a88 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:42.744250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db773305-d775-46d5-af03-5ef46f090a88 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:42.744718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-db773305-d775-46d5-af03-5ef46f090a88 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:42.880660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-db773305-d775-46d5-af03-5ef46f090a88 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:42.889070 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-db773305-d775-46d5-af03-5ef46f090a88 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.158618 Aug 24 06:37:42.889653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1186/2376] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:42 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:43.076850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6e335d46-30e9-4a0e-a52a-afd0908eed44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:43.077343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6e335d46-30e9-4a0e-a52a-afd0908eed44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:43.084440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e335d46-30e9-4a0e-a52a-afd0908eed44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:43.084958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e335d46-30e9-4a0e-a52a-afd0908eed44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:43.085384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e335d46-30e9-4a0e-a52a-afd0908eed44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:43.086074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e335d46-30e9-4a0e-a52a-afd0908eed44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:43.086516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e335d46-30e9-4a0e-a52a-afd0908eed44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:43.086931 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e335d46-30e9-4a0e-a52a-afd0908eed44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:43.150405 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6e335d46-30e9-4a0e-a52a-afd0908eed44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:43.159970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6e335d46-30e9-4a0e-a52a-afd0908eed44 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.087095 Aug 24 06:37:43.160583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1191/2377] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:43 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:43.491141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:43.491867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:43.498822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:43.499345 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:43.499813 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:43.501141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:43.501629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:43.502086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:43.638315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:43.647851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:43.649374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:43.650566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-253b3fd7-887c-4b9c-8b52-1316f9090d8b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163573 Aug 24 06:37:43.651129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1187/2378] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:43.912061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-38bd3beb-b287-49ab-bfc9-fcf22ee44e33 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:43.913149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-38bd3beb-b287-49ab-bfc9-fcf22ee44e33 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:43.921465 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38bd3beb-b287-49ab-bfc9-fcf22ee44e33 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:43.925966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38bd3beb-b287-49ab-bfc9-fcf22ee44e33 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:43.925966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38bd3beb-b287-49ab-bfc9-fcf22ee44e33 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:43.925966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38bd3beb-b287-49ab-bfc9-fcf22ee44e33 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:43.925966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38bd3beb-b287-49ab-bfc9-fcf22ee44e33 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:43.926984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-38bd3beb-b287-49ab-bfc9-fcf22ee44e33 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:44.171577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-38bd3beb-b287-49ab-bfc9-fcf22ee44e33 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:44.182785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-38bd3beb-b287-49ab-bfc9-fcf22ee44e33 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.275331 Aug 24 06:37:44.183876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1192/2379] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:43 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:44.185938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fad11e7a-a6f5-4426-8c48-8767ac2f36ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:44.187038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fad11e7a-a6f5-4426-8c48-8767ac2f36ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:44.199171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fad11e7a-a6f5-4426-8c48-8767ac2f36ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:44.200063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fad11e7a-a6f5-4426-8c48-8767ac2f36ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:44.200879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fad11e7a-a6f5-4426-8c48-8767ac2f36ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:44.202092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fad11e7a-a6f5-4426-8c48-8767ac2f36ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:44.202913 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fad11e7a-a6f5-4426-8c48-8767ac2f36ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:44.204143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fad11e7a-a6f5-4426-8c48-8767ac2f36ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:44.286613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fad11e7a-a6f5-4426-8c48-8767ac2f36ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:44.296739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fad11e7a-a6f5-4426-8c48-8767ac2f36ce tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.118371 Aug 24 06:37:44.298236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1188/2380] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:44 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:44.692585 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:44.693275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:44.699868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:44.700352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:44.700816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:44.701515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:44.701969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:44.702397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:44.839758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:44.849945 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:44.851467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:44.852713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-946939fa-a25c-4604-9724-3396132607ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.165318 Aug 24 06:37:44.853296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1193/2381] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:44 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:45.209133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2e367b67-1d13-4ffd-902e-0ad89495b430 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:45.209800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2e367b67-1d13-4ffd-902e-0ad89495b430 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:45.216755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e367b67-1d13-4ffd-902e-0ad89495b430 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:45.217294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e367b67-1d13-4ffd-902e-0ad89495b430 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:45.217760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e367b67-1d13-4ffd-902e-0ad89495b430 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:45.218492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e367b67-1d13-4ffd-902e-0ad89495b430 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:45.218987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e367b67-1d13-4ffd-902e-0ad89495b430 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:45.219458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2e367b67-1d13-4ffd-902e-0ad89495b430 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:45.320459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-19e98a1a-1ef1-42ce-aba2-d51a3e459cb7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:45.321531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-19e98a1a-1ef1-42ce-aba2-d51a3e459cb7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:45.330423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e98a1a-1ef1-42ce-aba2-d51a3e459cb7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:45.331045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e98a1a-1ef1-42ce-aba2-d51a3e459cb7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:45.331603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e98a1a-1ef1-42ce-aba2-d51a3e459cb7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:45.332535 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e98a1a-1ef1-42ce-aba2-d51a3e459cb7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:45.333150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e98a1a-1ef1-42ce-aba2-d51a3e459cb7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:45.333707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-19e98a1a-1ef1-42ce-aba2-d51a3e459cb7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:45.371617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2e367b67-1d13-4ffd-902e-0ad89495b430 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:45.387438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2e367b67-1d13-4ffd-902e-0ad89495b430 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.181796 Aug 24 06:37:45.388462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1189/2382] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:45 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:45.409021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-19e98a1a-1ef1-42ce-aba2-d51a3e459cb7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:45.417975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-19e98a1a-1ef1-42ce-aba2-d51a3e459cb7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.101449 Aug 24 06:37:45.418561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1194/2383] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:45 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:45.876998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:45.877604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:45.883745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:45.884221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:45.884687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:45.885386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:45.885832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:45.886260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:46.025439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:46.041943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:46.044924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:46.047134 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-33435aa9-1f18-4169-9518-8a87f5810fd6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.173957 Aug 24 06:37:46.048489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1190/2384] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:46.421840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6c468bf9-37c7-4299-8526-d5a3ef58ff0c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:46.423323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6c468bf9-37c7-4299-8526-d5a3ef58ff0c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:46.430022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c468bf9-37c7-4299-8526-d5a3ef58ff0c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:46.430501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c468bf9-37c7-4299-8526-d5a3ef58ff0c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:46.430930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c468bf9-37c7-4299-8526-d5a3ef58ff0c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:46.431651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c468bf9-37c7-4299-8526-d5a3ef58ff0c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:46.432093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c468bf9-37c7-4299-8526-d5a3ef58ff0c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:46.432527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6c468bf9-37c7-4299-8526-d5a3ef58ff0c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:46.451450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7946604a-94ac-4a99-acd5-f83a9875cd30 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:46.452321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7946604a-94ac-4a99-acd5-f83a9875cd30 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:46.459189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7946604a-94ac-4a99-acd5-f83a9875cd30 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:46.459665 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7946604a-94ac-4a99-acd5-f83a9875cd30 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:46.460089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7946604a-94ac-4a99-acd5-f83a9875cd30 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:46.460849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7946604a-94ac-4a99-acd5-f83a9875cd30 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:46.461823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7946604a-94ac-4a99-acd5-f83a9875cd30 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:46.461823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7946604a-94ac-4a99-acd5-f83a9875cd30 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:46.537659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7946604a-94ac-4a99-acd5-f83a9875cd30 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:46.547027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7946604a-94ac-4a99-acd5-f83a9875cd30 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.099392 Aug 24 06:37:46.548203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1191/2385] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:46 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:46.581222 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6c468bf9-37c7-4299-8526-d5a3ef58ff0c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:46.585204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:46.598770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6c468bf9-37c7-4299-8526-d5a3ef58ff0c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.180429 Aug 24 06:37:46.599820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1195/2386] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:46 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:47.072018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:47.072788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:47.079388 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:47.079925 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:47.080403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:47.081236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:47.081737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:47.082200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:47.237964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:47.250322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:47.251924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:47.253273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-93660bd1-9533-4fcf-a172-7c9534ec7ac0 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.185260 Aug 24 06:37:47.253935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1192/2387] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:47.569715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8e0ee55b-61a0-40db-b5d2-3ef218b61b47 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:47.570355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8e0ee55b-61a0-40db-b5d2-3ef218b61b47 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:47.576836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e0ee55b-61a0-40db-b5d2-3ef218b61b47 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:47.577369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e0ee55b-61a0-40db-b5d2-3ef218b61b47 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:47.577846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e0ee55b-61a0-40db-b5d2-3ef218b61b47 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:47.579100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e0ee55b-61a0-40db-b5d2-3ef218b61b47 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:47.579592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e0ee55b-61a0-40db-b5d2-3ef218b61b47 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:47.580154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e0ee55b-61a0-40db-b5d2-3ef218b61b47 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:47.634981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7e06ca85-0969-4834-9211-b143412093a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:47.636168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7e06ca85-0969-4834-9211-b143412093a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:47.645661 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e06ca85-0969-4834-9211-b143412093a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:47.646385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e06ca85-0969-4834-9211-b143412093a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:47.646980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e06ca85-0969-4834-9211-b143412093a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:47.647917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e06ca85-0969-4834-9211-b143412093a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:47.648544 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e06ca85-0969-4834-9211-b143412093a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:47.649112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e06ca85-0969-4834-9211-b143412093a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:47.649975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8e0ee55b-61a0-40db-b5d2-3ef218b61b47 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:47.666425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8e0ee55b-61a0-40db-b5d2-3ef218b61b47 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.100196 Aug 24 06:37:47.667486 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1196/2388] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:47 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:47.797556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7e06ca85-0969-4834-9211-b143412093a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:47.809567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7e06ca85-0969-4834-9211-b143412093a2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.178530 Aug 24 06:37:47.810153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1193/2389] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:47 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:48.277649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:48.278266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:48.285621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:48.286150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:48.286595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:48.287337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:48.287804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:48.288245 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:48.447779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:48.457823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:48.459584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:48.461001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-03668d59-1ae8-42a3-8c6c-afeac71e5954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.187537 Aug 24 06:37:48.465133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1197/2390] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:48.699378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7100e81f-12c2-430b-809b-5e1f56650bdd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:48.700049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7100e81f-12c2-430b-809b-5e1f56650bdd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:48.702728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=82 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:48.709765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7100e81f-12c2-430b-809b-5e1f56650bdd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:48.714702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7100e81f-12c2-430b-809b-5e1f56650bdd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:48.714702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7100e81f-12c2-430b-809b-5e1f56650bdd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:48.714702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7100e81f-12c2-430b-809b-5e1f56650bdd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:48.714702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7100e81f-12c2-430b-809b-5e1f56650bdd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:48.715896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7100e81f-12c2-430b-809b-5e1f56650bdd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:48.782016 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7100e81f-12c2-430b-809b-5e1f56650bdd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:48.791066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7100e81f-12c2-430b-809b-5e1f56650bdd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.095526 Aug 24 06:37:48.791701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1194/2391] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:48 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:48.834772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-30197883-54ad-44ee-a667-3892801c0285 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:48.835584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-30197883-54ad-44ee-a667-3892801c0285 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:48.842415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30197883-54ad-44ee-a667-3892801c0285 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:48.843198 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30197883-54ad-44ee-a667-3892801c0285 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:48.843587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30197883-54ad-44ee-a667-3892801c0285 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:48.844985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30197883-54ad-44ee-a667-3892801c0285 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:48.845544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30197883-54ad-44ee-a667-3892801c0285 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:48.846049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-30197883-54ad-44ee-a667-3892801c0285 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:48.988461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-30197883-54ad-44ee-a667-3892801c0285 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:48.997667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-30197883-54ad-44ee-a667-3892801c0285 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.166880 Aug 24 06:37:48.998261 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1198/2392] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:48 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:49.485681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:49.486406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:49.493175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:49.493795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:49.494569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:49.495395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:49.495893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:49.496356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:49.638751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:49.648526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:49.650204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:49.651369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-707a89f0-3fe2-422b-844c-506afb7d42d6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.169979 Aug 24 06:37:49.651940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1195/2393] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:49 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:49.814080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-08b04336-5334-4fb0-8012-16dd9e6400c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:49.814681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-08b04336-5334-4fb0-8012-16dd9e6400c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:49.821517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b04336-5334-4fb0-8012-16dd9e6400c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:49.822128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b04336-5334-4fb0-8012-16dd9e6400c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:49.822642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b04336-5334-4fb0-8012-16dd9e6400c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:49.823450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b04336-5334-4fb0-8012-16dd9e6400c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:49.824998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b04336-5334-4fb0-8012-16dd9e6400c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:49.824998 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-08b04336-5334-4fb0-8012-16dd9e6400c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:49.903201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-08b04336-5334-4fb0-8012-16dd9e6400c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:49.911773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-08b04336-5334-4fb0-8012-16dd9e6400c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.102524 Aug 24 06:37:49.912348 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1199/2394] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:49 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:50.034917 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bcf9ad2b-39ff-4019-bcb5-210d73153bd0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:50.035551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bcf9ad2b-39ff-4019-bcb5-210d73153bd0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:50.042318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcf9ad2b-39ff-4019-bcb5-210d73153bd0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:50.042793 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcf9ad2b-39ff-4019-bcb5-210d73153bd0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:50.043233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcf9ad2b-39ff-4019-bcb5-210d73153bd0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:50.044035 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcf9ad2b-39ff-4019-bcb5-210d73153bd0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:50.044527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcf9ad2b-39ff-4019-bcb5-210d73153bd0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:50.044950 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bcf9ad2b-39ff-4019-bcb5-210d73153bd0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:50.189151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bcf9ad2b-39ff-4019-bcb5-210d73153bd0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:50.197750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bcf9ad2b-39ff-4019-bcb5-210d73153bd0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.166898 Aug 24 06:37:50.198332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1196/2395] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:50 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:50.676181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:50.676829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:50.683099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:50.683582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:50.684006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:50.684989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:50.685436 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:50.685850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:50.837499 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:50.846738 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:50.848237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:50.849433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a203328f-90b1-4eb6-aee3-09cac802ea7f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.178089 Aug 24 06:37:50.849991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1200/2396] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:50.933517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ef4e57ce-050c-4329-9942-753d193af4a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:50.934038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ef4e57ce-050c-4329-9942-753d193af4a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:50.941170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4e57ce-050c-4329-9942-753d193af4a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:50.941653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4e57ce-050c-4329-9942-753d193af4a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:50.942085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4e57ce-050c-4329-9942-753d193af4a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:50.942775 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4e57ce-050c-4329-9942-753d193af4a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:50.943222 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4e57ce-050c-4329-9942-753d193af4a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:50.943642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4e57ce-050c-4329-9942-753d193af4a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:51.010481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ef4e57ce-050c-4329-9942-753d193af4a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:51.019309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ef4e57ce-050c-4329-9942-753d193af4a4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089700 Aug 24 06:37:51.019882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1197/2397] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:50 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:51.220154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7e5cea63-4dc2-401d-b558-ab6c04bf786d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:51.220748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7e5cea63-4dc2-401d-b558-ab6c04bf786d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:51.227352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e5cea63-4dc2-401d-b558-ab6c04bf786d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:51.227840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e5cea63-4dc2-401d-b558-ab6c04bf786d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:51.228276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e5cea63-4dc2-401d-b558-ab6c04bf786d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:51.229010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e5cea63-4dc2-401d-b558-ab6c04bf786d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:51.229471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e5cea63-4dc2-401d-b558-ab6c04bf786d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:51.229895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7e5cea63-4dc2-401d-b558-ab6c04bf786d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:51.377414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7e5cea63-4dc2-401d-b558-ab6c04bf786d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:51.386284 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7e5cea63-4dc2-401d-b558-ab6c04bf786d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.170520 Aug 24 06:37:51.386845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1201/2398] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:51 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:51.873068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:51.873680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:51.881855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:51.882335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:51.882769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:51.883468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:51.884038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:51.884692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:52.036009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:52.040584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-206dd8ff-7fe0-46f6-836b-1c78d3176e34 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:52.043714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-206dd8ff-7fe0-46f6-836b-1c78d3176e34 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:52.049406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:52.050805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-206dd8ff-7fe0-46f6-836b-1c78d3176e34 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:52.050953 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:52.051287 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-206dd8ff-7fe0-46f6-836b-1c78d3176e34 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:52.051715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-206dd8ff-7fe0-46f6-836b-1c78d3176e34 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:52.052111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-20837613-e65c-4976-9fc7-80fee409f990 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.183105 Aug 24 06:37:52.052414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-206dd8ff-7fe0-46f6-836b-1c78d3176e34 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:52.052706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1198/2399] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:51 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:52.052936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-206dd8ff-7fe0-46f6-836b-1c78d3176e34 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:52.053297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-206dd8ff-7fe0-46f6-836b-1c78d3176e34 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:52.116865 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-206dd8ff-7fe0-46f6-836b-1c78d3176e34 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:52.125538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-206dd8ff-7fe0-46f6-836b-1c78d3176e34 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088828 Aug 24 06:37:52.126122 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1202/2400] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:52 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:52.407934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-58eaee47-58e5-4cfa-9b14-9471cf0329b0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:52.408446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-58eaee47-58e5-4cfa-9b14-9471cf0329b0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:52.414614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58eaee47-58e5-4cfa-9b14-9471cf0329b0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:52.415115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58eaee47-58e5-4cfa-9b14-9471cf0329b0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:52.415536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58eaee47-58e5-4cfa-9b14-9471cf0329b0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:52.416221 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58eaee47-58e5-4cfa-9b14-9471cf0329b0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:52.416699 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58eaee47-58e5-4cfa-9b14-9471cf0329b0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:52.417114 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-58eaee47-58e5-4cfa-9b14-9471cf0329b0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:52.553628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-58eaee47-58e5-4cfa-9b14-9471cf0329b0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:52.563022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-58eaee47-58e5-4cfa-9b14-9471cf0329b0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.158987 Aug 24 06:37:52.563609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1199/2401] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:52 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:53.075883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:53.075883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:53.083218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:53.083777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:53.084248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:53.085167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:53.085716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:53.086174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:53.148161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-55ec82b6-c1e4-4382-9ef4-1acfc5572144 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:53.149192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-55ec82b6-c1e4-4382-9ef4-1acfc5572144 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:53.159866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55ec82b6-c1e4-4382-9ef4-1acfc5572144 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:53.160341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55ec82b6-c1e4-4382-9ef4-1acfc5572144 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:53.160795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55ec82b6-c1e4-4382-9ef4-1acfc5572144 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:53.161493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55ec82b6-c1e4-4382-9ef4-1acfc5572144 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:53.161939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55ec82b6-c1e4-4382-9ef4-1acfc5572144 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:53.162351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55ec82b6-c1e4-4382-9ef4-1acfc5572144 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:53.230373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-55ec82b6-c1e4-4382-9ef4-1acfc5572144 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:53.232760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:53.236564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:53.240030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-55ec82b6-c1e4-4382-9ef4-1acfc5572144 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.097051 Aug 24 06:37:53.240635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1200/2402] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:53 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:53.246467 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:53.247962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:53.249176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a7f36444-93c8-4f8f-82b0-a409baf632cf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.177907 Aug 24 06:37:53.249731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1203/2403] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:53.584920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9ed3bd76-85b3-441e-a5e6-bcc017e71b36 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:53.585536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9ed3bd76-85b3-441e-a5e6-bcc017e71b36 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:53.592031 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed3bd76-85b3-441e-a5e6-bcc017e71b36 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:53.592538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed3bd76-85b3-441e-a5e6-bcc017e71b36 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:53.592973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed3bd76-85b3-441e-a5e6-bcc017e71b36 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:53.593703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed3bd76-85b3-441e-a5e6-bcc017e71b36 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:53.594213 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed3bd76-85b3-441e-a5e6-bcc017e71b36 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:53.594629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9ed3bd76-85b3-441e-a5e6-bcc017e71b36 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:53.735072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9ed3bd76-85b3-441e-a5e6-bcc017e71b36 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:53.743796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9ed3bd76-85b3-441e-a5e6-bcc017e71b36 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.163172 Aug 24 06:37:53.744375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1201/2404] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:53 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:54.261868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4429992e-b49a-42f9-8f63-5d249c03514c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:54.262541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4429992e-b49a-42f9-8f63-5d249c03514c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:54.269860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4429992e-b49a-42f9-8f63-5d249c03514c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:54.270344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4429992e-b49a-42f9-8f63-5d249c03514c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:54.270784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4429992e-b49a-42f9-8f63-5d249c03514c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:54.271492 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4429992e-b49a-42f9-8f63-5d249c03514c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:54.271946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4429992e-b49a-42f9-8f63-5d249c03514c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:54.272373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4429992e-b49a-42f9-8f63-5d249c03514c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:54.282229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:54.283105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:54.290203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:54.290706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:54.291118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:54.291811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:54.292259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:54.292712 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:54.358740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4429992e-b49a-42f9-8f63-5d249c03514c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:54.368215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4429992e-b49a-42f9-8f63-5d249c03514c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.110215 Aug 24 06:37:54.368842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1204/2405] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:54 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:54.448131 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:54.457954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:54.459463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:54.460668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ed3cd4f0-65c5-47a2-a575-5b3c3926ab0d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.183177 Aug 24 06:37:54.461249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1202/2406] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:54 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:54.766274 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c0626720-3f95-4fbf-9f6d-74bd1df5c342 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:54.767004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c0626720-3f95-4fbf-9f6d-74bd1df5c342 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:54.773759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0626720-3f95-4fbf-9f6d-74bd1df5c342 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:54.774255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0626720-3f95-4fbf-9f6d-74bd1df5c342 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:54.774701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0626720-3f95-4fbf-9f6d-74bd1df5c342 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:54.775446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0626720-3f95-4fbf-9f6d-74bd1df5c342 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:54.775910 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0626720-3f95-4fbf-9f6d-74bd1df5c342 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:54.776354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c0626720-3f95-4fbf-9f6d-74bd1df5c342 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:54.949396 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c0626720-3f95-4fbf-9f6d-74bd1df5c342 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:54.964913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c0626720-3f95-4fbf-9f6d-74bd1df5c342 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.202368 Aug 24 06:37:54.965897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1205/2407] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:54 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:55.390123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1add6d9d-2e95-44cf-b72e-ca8430786779 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:55.390886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1add6d9d-2e95-44cf-b72e-ca8430786779 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:55.398440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1add6d9d-2e95-44cf-b72e-ca8430786779 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:55.398934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1add6d9d-2e95-44cf-b72e-ca8430786779 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:55.399371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1add6d9d-2e95-44cf-b72e-ca8430786779 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:55.400141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1add6d9d-2e95-44cf-b72e-ca8430786779 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:55.400631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1add6d9d-2e95-44cf-b72e-ca8430786779 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:55.401097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1add6d9d-2e95-44cf-b72e-ca8430786779 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:55.483482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1add6d9d-2e95-44cf-b72e-ca8430786779 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:55.486196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:55.487197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:55.490177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=74 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:55.493195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1add6d9d-2e95-44cf-b72e-ca8430786779 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.107098 Aug 24 06:37:55.493871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1203/2408] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:55 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:55.496315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:55.496963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:55.497489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:55.498440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:55.498986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:55.499505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:55.641592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:55.650732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:55.652244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:55.653462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0e0ad6c9-3c83-4599-b803-b391b4bc40b9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.172825 Aug 24 06:37:55.654029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1206/2409] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:55.987683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-da52677f-aee4-4a5e-8eb5-64d9aeb6f0fd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:55.988401 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-da52677f-aee4-4a5e-8eb5-64d9aeb6f0fd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:55.994828 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da52677f-aee4-4a5e-8eb5-64d9aeb6f0fd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:55.995352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da52677f-aee4-4a5e-8eb5-64d9aeb6f0fd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:55.995819 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da52677f-aee4-4a5e-8eb5-64d9aeb6f0fd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:55.996580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da52677f-aee4-4a5e-8eb5-64d9aeb6f0fd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:55.997070 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da52677f-aee4-4a5e-8eb5-64d9aeb6f0fd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:55.997523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-da52677f-aee4-4a5e-8eb5-64d9aeb6f0fd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:56.138112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-da52677f-aee4-4a5e-8eb5-64d9aeb6f0fd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:56.147249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-da52677f-aee4-4a5e-8eb5-64d9aeb6f0fd tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.163959 Aug 24 06:37:56.147892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1204/2410] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:55 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:56.514741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fdf1b6ac-2d31-45e2-9279-4ed7a5fe341a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:56.515427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fdf1b6ac-2d31-45e2-9279-4ed7a5fe341a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:56.523102 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdf1b6ac-2d31-45e2-9279-4ed7a5fe341a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:56.523593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdf1b6ac-2d31-45e2-9279-4ed7a5fe341a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:56.524031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdf1b6ac-2d31-45e2-9279-4ed7a5fe341a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:56.524771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdf1b6ac-2d31-45e2-9279-4ed7a5fe341a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:56.525233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdf1b6ac-2d31-45e2-9279-4ed7a5fe341a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:56.525661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fdf1b6ac-2d31-45e2-9279-4ed7a5fe341a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:56.604449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fdf1b6ac-2d31-45e2-9279-4ed7a5fe341a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:56.613749 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fdf1b6ac-2d31-45e2-9279-4ed7a5fe341a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.103063 Aug 24 06:37:56.614394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1207/2411] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:56 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:56.678104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:56.679077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:56.687045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:56.688359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:56.688980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:56.689760 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:56.690264 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:56.690731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:56.836618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:56.852229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:56.855104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:56.857308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-635d3e54-3b05-4f8e-bd70-35b8d94b5c8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.182986 Aug 24 06:37:56.858278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1205/2412] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:37:57.169973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-07cabb2f-b928-4123-a2ef-d3625d038ea5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:57.170692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-07cabb2f-b928-4123-a2ef-d3625d038ea5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:57.177483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07cabb2f-b928-4123-a2ef-d3625d038ea5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:57.178017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07cabb2f-b928-4123-a2ef-d3625d038ea5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:57.178462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07cabb2f-b928-4123-a2ef-d3625d038ea5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:57.179174 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07cabb2f-b928-4123-a2ef-d3625d038ea5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:57.179636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07cabb2f-b928-4123-a2ef-d3625d038ea5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:57.180108 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-07cabb2f-b928-4123-a2ef-d3625d038ea5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:57.325895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-07cabb2f-b928-4123-a2ef-d3625d038ea5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:57.334962 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-07cabb2f-b928-4123-a2ef-d3625d038ea5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.169143 Aug 24 06:37:57.335542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1208/2413] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:57 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:57.636715 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d1cf7b52-1c52-4a42-8b40-9d0ac0efdf54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:57.637249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d1cf7b52-1c52-4a42-8b40-9d0ac0efdf54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:57.643552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1cf7b52-1c52-4a42-8b40-9d0ac0efdf54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:57.644049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1cf7b52-1c52-4a42-8b40-9d0ac0efdf54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:57.644484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1cf7b52-1c52-4a42-8b40-9d0ac0efdf54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:57.645289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1cf7b52-1c52-4a42-8b40-9d0ac0efdf54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:57.645742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1cf7b52-1c52-4a42-8b40-9d0ac0efdf54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:57.646166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d1cf7b52-1c52-4a42-8b40-9d0ac0efdf54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:57.716354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d1cf7b52-1c52-4a42-8b40-9d0ac0efdf54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:57.727043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d1cf7b52-1c52-4a42-8b40-9d0ac0efdf54 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.095167 Aug 24 06:37:57.727719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1206/2414] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:57 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:57.881175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:57.881804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:57.889364 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:57.889770 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:57.890201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:57.890891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:57.891336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:57.891761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:58.026868 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:58.037636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:58.041389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:58.041389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b0ed84bd-dd3e-46c4-b8ea-4f569554545c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.162436 Aug 24 06:37:58.041389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1209/2415] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:57 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:58.369431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b3e002ef-f611-4b8b-8c45-08c415a7662c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:58.370039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b3e002ef-f611-4b8b-8c45-08c415a7662c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:58.376247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3e002ef-f611-4b8b-8c45-08c415a7662c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:58.376763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3e002ef-f611-4b8b-8c45-08c415a7662c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:58.377194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3e002ef-f611-4b8b-8c45-08c415a7662c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:58.377896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3e002ef-f611-4b8b-8c45-08c415a7662c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:58.378347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3e002ef-f611-4b8b-8c45-08c415a7662c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:58.378765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b3e002ef-f611-4b8b-8c45-08c415a7662c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:58.510523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b3e002ef-f611-4b8b-8c45-08c415a7662c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:58.518856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b3e002ef-f611-4b8b-8c45-08c415a7662c tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.153303 Aug 24 06:37:58.519427 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1207/2416] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:58 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:58.760713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-33ae0981-2023-4d8f-9a85-4f433fa722ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:58.761418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-33ae0981-2023-4d8f-9a85-4f433fa722ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:58.768168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33ae0981-2023-4d8f-9a85-4f433fa722ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:58.768683 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33ae0981-2023-4d8f-9a85-4f433fa722ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:58.769112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33ae0981-2023-4d8f-9a85-4f433fa722ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:58.769800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33ae0981-2023-4d8f-9a85-4f433fa722ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:58.770242 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33ae0981-2023-4d8f-9a85-4f433fa722ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:58.770883 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-33ae0981-2023-4d8f-9a85-4f433fa722ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:58.834590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-33ae0981-2023-4d8f-9a85-4f433fa722ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:58.844424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-33ae0981-2023-4d8f-9a85-4f433fa722ae tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086915 Aug 24 06:37:58.845072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1210/2417] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:58 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:59.063560 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:59.064154 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:59.070842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:59.071322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:59.071753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:59.072446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:59.072933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:59.073350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:59.212133 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:59.221745 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:59.223266 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:59.224429 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8abfffba-45cc-4b91-aa37-a7c4654fa582 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.165179 Aug 24 06:37:59.225018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1208/2418] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:37:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:37:59.539876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c1223ca6-0fae-4481-9736-b7e405da44d7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:59.540529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c1223ca6-0fae-4481-9736-b7e405da44d7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:59.547105 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223ca6-0fae-4481-9736-b7e405da44d7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:59.547581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223ca6-0fae-4481-9736-b7e405da44d7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:59.548007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223ca6-0fae-4481-9736-b7e405da44d7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:59.548737 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223ca6-0fae-4481-9736-b7e405da44d7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:59.549177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223ca6-0fae-4481-9736-b7e405da44d7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:59.549592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c1223ca6-0fae-4481-9736-b7e405da44d7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:59.684632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c1223ca6-0fae-4481-9736-b7e405da44d7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:59.693357 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c1223ca6-0fae-4481-9736-b7e405da44d7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.157289 Aug 24 06:37:59.693933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1211/2419] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:59 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:59.865676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-177a3efa-bf0c-4ef9-ac53-9577def42ae5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:37:59.866231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-177a3efa-bf0c-4ef9-ac53-9577def42ae5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:37:59.875973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-177a3efa-bf0c-4ef9-ac53-9577def42ae5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:59.876469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-177a3efa-bf0c-4ef9-ac53-9577def42ae5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:59.876931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-177a3efa-bf0c-4ef9-ac53-9577def42ae5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:59.877636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-177a3efa-bf0c-4ef9-ac53-9577def42ae5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:37:59.878091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-177a3efa-bf0c-4ef9-ac53-9577def42ae5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:37:59.878516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-177a3efa-bf0c-4ef9-ac53-9577def42ae5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:37:59.943754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-177a3efa-bf0c-4ef9-ac53-9577def42ae5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:37:59.955061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-177a3efa-bf0c-4ef9-ac53-9577def42ae5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093431 Aug 24 06:37:59.959943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1209/2420] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:37:59 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:00.248129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:00.248767 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:00.255697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:00.256185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:00.256652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:00.257353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:00.257802 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:00.258220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:00.276113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:00.396377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:00.405445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:00.407004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:00.408170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2bed7aac-59b1-4c29-9220-e75b026ed7c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.164009 Aug 24 06:38:00.408764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1212/2421] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:00 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:00.714491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cd0a75c5-e8fe-4253-a6c2-a5081063adb7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:00.715118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cd0a75c5-e8fe-4253-a6c2-a5081063adb7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:00.722363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cd0a75c5-e8fe-4253-a6c2-a5081063adb7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:00.722851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cd0a75c5-e8fe-4253-a6c2-a5081063adb7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:00.723362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cd0a75c5-e8fe-4253-a6c2-a5081063adb7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:00.724069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cd0a75c5-e8fe-4253-a6c2-a5081063adb7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:00.724552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cd0a75c5-e8fe-4253-a6c2-a5081063adb7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:00.724978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cd0a75c5-e8fe-4253-a6c2-a5081063adb7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:00.865227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cd0a75c5-e8fe-4253-a6c2-a5081063adb7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:00.874246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cd0a75c5-e8fe-4253-a6c2-a5081063adb7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.163658 Aug 24 06:38:00.874948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1210/2422] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:00 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:00.979091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e4ea4ae3-abb4-4a61-8449-fd6ecfdd01b8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:00.979977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e4ea4ae3-abb4-4a61-8449-fd6ecfdd01b8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:00.988389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ae3-abb4-4a61-8449-fd6ecfdd01b8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:00.988905 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ae3-abb4-4a61-8449-fd6ecfdd01b8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:00.989337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ae3-abb4-4a61-8449-fd6ecfdd01b8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:00.990044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ae3-abb4-4a61-8449-fd6ecfdd01b8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:00.990493 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ae3-abb4-4a61-8449-fd6ecfdd01b8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:00.990916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e4ea4ae3-abb4-4a61-8449-fd6ecfdd01b8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:01.057381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e4ea4ae3-abb4-4a61-8449-fd6ecfdd01b8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:01.067077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e4ea4ae3-abb4-4a61-8449-fd6ecfdd01b8 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.092465 Aug 24 06:38:01.067668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1213/2423] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:00 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:01.431947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:01.432567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:01.439993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:01.440474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:01.440941 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:01.441641 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:01.442089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:01.442514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:01.607667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:01.617652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:01.619201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:01.620369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e547bd5d-98e4-4b18-9b45-d0d53a152514 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.192502 Aug 24 06:38:01.621004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1211/2424] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:38:01.897000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1fd720e4-7927-4f90-92d6-04e9c827269d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:01.897614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1fd720e4-7927-4f90-92d6-04e9c827269d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:01.904101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1fd720e4-7927-4f90-92d6-04e9c827269d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:01.904621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1fd720e4-7927-4f90-92d6-04e9c827269d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:01.905058 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1fd720e4-7927-4f90-92d6-04e9c827269d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:01.905879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1fd720e4-7927-4f90-92d6-04e9c827269d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:01.906244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1fd720e4-7927-4f90-92d6-04e9c827269d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:01.906694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1fd720e4-7927-4f90-92d6-04e9c827269d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:02.061016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1fd720e4-7927-4f90-92d6-04e9c827269d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:02.070812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1fd720e4-7927-4f90-92d6-04e9c827269d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.177979 Aug 24 06:38:02.071414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1214/2425] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:01 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:02.089535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6a21ed11-67c8-4884-8f05-55d61c94988c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:02.090572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6a21ed11-67c8-4884-8f05-55d61c94988c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:02.098042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a21ed11-67c8-4884-8f05-55d61c94988c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:02.098532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a21ed11-67c8-4884-8f05-55d61c94988c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:02.098964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a21ed11-67c8-4884-8f05-55d61c94988c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:02.099695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a21ed11-67c8-4884-8f05-55d61c94988c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:02.100145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a21ed11-67c8-4884-8f05-55d61c94988c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:02.100591 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6a21ed11-67c8-4884-8f05-55d61c94988c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:02.169537 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6a21ed11-67c8-4884-8f05-55d61c94988c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:02.179273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6a21ed11-67c8-4884-8f05-55d61c94988c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.094003 Aug 24 06:38:02.179839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1212/2426] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:02 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:02.644139 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:02.644691 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:02.651091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:02.651568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:02.651991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:02.652724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:02.653171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:02.653583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:02.805002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:02.817823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:02.819367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:02.820672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f3df425b-204a-4cfb-81f3-399d96bf05ce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.181144 Aug 24 06:38:02.826596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1215/2427] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:38:03.103800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f915ee4c-faed-4d60-a7bd-b1c0dd8f5551 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:03.104788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f915ee4c-faed-4d60-a7bd-b1c0dd8f5551 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:03.110888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f915ee4c-faed-4d60-a7bd-b1c0dd8f5551 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:03.111368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f915ee4c-faed-4d60-a7bd-b1c0dd8f5551 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:03.111798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f915ee4c-faed-4d60-a7bd-b1c0dd8f5551 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:03.112560 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f915ee4c-faed-4d60-a7bd-b1c0dd8f5551 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:03.113024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f915ee4c-faed-4d60-a7bd-b1c0dd8f5551 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:03.113448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f915ee4c-faed-4d60-a7bd-b1c0dd8f5551 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:03.206263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-67218995-e994-4bb2-89c8-faea85895341 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:03.207403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-67218995-e994-4bb2-89c8-faea85895341 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:03.218539 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67218995-e994-4bb2-89c8-faea85895341 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:03.219397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67218995-e994-4bb2-89c8-faea85895341 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:03.220157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67218995-e994-4bb2-89c8-faea85895341 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:03.221421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67218995-e994-4bb2-89c8-faea85895341 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:03.222209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67218995-e994-4bb2-89c8-faea85895341 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:03.222954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67218995-e994-4bb2-89c8-faea85895341 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:03.277550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f915ee4c-faed-4d60-a7bd-b1c0dd8f5551 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:03.287343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f915ee4c-faed-4d60-a7bd-b1c0dd8f5551 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.187507 Aug 24 06:38:03.288139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1213/2428] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:03 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:03.315427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-67218995-e994-4bb2-89c8-faea85895341 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:03.330677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-67218995-e994-4bb2-89c8-faea85895341 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.131917 Aug 24 06:38:03.331700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1216/2429] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:03 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:03.861861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:03.862464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:03.869017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:03.869504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:03.869925 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:03.870622 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:03.871065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:03.871666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:04.023927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:04.033500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:04.035262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:04.036566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-79abf10e-5320-422f-bf45-108e5e823f76 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.178705 Aug 24 06:38:04.037185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1214/2430] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:38:04.311104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c2f5c898-283b-4e50-a907-7742dba0f6d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:04.311720 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c2f5c898-283b-4e50-a907-7742dba0f6d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:04.319409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2f5c898-283b-4e50-a907-7742dba0f6d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:04.319942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2f5c898-283b-4e50-a907-7742dba0f6d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:04.320419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2f5c898-283b-4e50-a907-7742dba0f6d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:04.321215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2f5c898-283b-4e50-a907-7742dba0f6d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:04.321760 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2f5c898-283b-4e50-a907-7742dba0f6d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:04.322282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c2f5c898-283b-4e50-a907-7742dba0f6d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:04.355489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3af7b296-5e25-4b61-8bc4-3fec59b6f3e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:04.356457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3af7b296-5e25-4b61-8bc4-3fec59b6f3e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:04.365300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3af7b296-5e25-4b61-8bc4-3fec59b6f3e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:04.365882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3af7b296-5e25-4b61-8bc4-3fec59b6f3e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:04.366671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3af7b296-5e25-4b61-8bc4-3fec59b6f3e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:04.367593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3af7b296-5e25-4b61-8bc4-3fec59b6f3e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:04.368128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3af7b296-5e25-4b61-8bc4-3fec59b6f3e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:04.368629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3af7b296-5e25-4b61-8bc4-3fec59b6f3e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:04.465102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3af7b296-5e25-4b61-8bc4-3fec59b6f3e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:04.475665 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3af7b296-5e25-4b61-8bc4-3fec59b6f3e2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.126679 Aug 24 06:38:04.476370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1215/2431] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:04 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:04.727018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c2f5c898-283b-4e50-a907-7742dba0f6d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:04.736629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c2f5c898-283b-4e50-a907-7742dba0f6d3 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.429663 Aug 24 06:38:04.737216 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1217/2432] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:04 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:05.060074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:05.060588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:05.067296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:05.067791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:05.068211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:05.069108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:05.069551 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:05.069964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:05.224188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:05.234156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:05.235678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:05.236909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4af3f209-d3e5-4e24-8993-f1bedea52244 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.181217 Aug 24 06:38:05.237494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1216/2433] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:05.508596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-dc826ffd-d48b-4343-a2ec-8490c6e28a27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:05.509285 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-dc826ffd-d48b-4343-a2ec-8490c6e28a27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:05.516100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc826ffd-d48b-4343-a2ec-8490c6e28a27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:05.516614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc826ffd-d48b-4343-a2ec-8490c6e28a27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:05.517047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc826ffd-d48b-4343-a2ec-8490c6e28a27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:05.517734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc826ffd-d48b-4343-a2ec-8490c6e28a27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:05.518180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc826ffd-d48b-4343-a2ec-8490c6e28a27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:05.518597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dc826ffd-d48b-4343-a2ec-8490c6e28a27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:05.597665 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-dc826ffd-d48b-4343-a2ec-8490c6e28a27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:05.606616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-dc826ffd-d48b-4343-a2ec-8490c6e28a27 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.101819 Aug 24 06:38:05.607217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1218/2434] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:05 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:05.758203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-020cad21-1703-4e1f-9a79-0d192a2f05f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:05.758948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-020cad21-1703-4e1f-9a79-0d192a2f05f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:05.766152 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-020cad21-1703-4e1f-9a79-0d192a2f05f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:05.766639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-020cad21-1703-4e1f-9a79-0d192a2f05f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:05.767073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-020cad21-1703-4e1f-9a79-0d192a2f05f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:05.767777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-020cad21-1703-4e1f-9a79-0d192a2f05f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:05.768238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-020cad21-1703-4e1f-9a79-0d192a2f05f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:05.768691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-020cad21-1703-4e1f-9a79-0d192a2f05f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:05.785020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:05.912244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-020cad21-1703-4e1f-9a79-0d192a2f05f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:05.920907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-020cad21-1703-4e1f-9a79-0d192a2f05f5 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.166692 Aug 24 06:38:05.921533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1217/2435] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:05 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:06.261117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:06.261727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:06.268948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:06.269453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:06.269945 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:06.270660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:06.271133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:06.271562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:06.412325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:06.422168 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:06.423680 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:06.426211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0d4f3124-169c-4942-a8d0-449aeb17b21b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.167969 Aug 24 06:38:06.426211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1219/2436] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:06.628120 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c070b36a-839d-45ba-80bc-773f44800b90 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:06.628686 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c070b36a-839d-45ba-80bc-773f44800b90 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:06.634912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c070b36a-839d-45ba-80bc-773f44800b90 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:06.635403 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c070b36a-839d-45ba-80bc-773f44800b90 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:06.635833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c070b36a-839d-45ba-80bc-773f44800b90 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:06.636566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c070b36a-839d-45ba-80bc-773f44800b90 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:06.637024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c070b36a-839d-45ba-80bc-773f44800b90 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:06.637503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c070b36a-839d-45ba-80bc-773f44800b90 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:06.701273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c070b36a-839d-45ba-80bc-773f44800b90 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:06.710027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c070b36a-839d-45ba-80bc-773f44800b90 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.086466 Aug 24 06:38:06.710628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1218/2437] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:06 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:06.957131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b2f6b09d-b342-42e5-af25-edebeadb2714 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:06.957763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b2f6b09d-b342-42e5-af25-edebeadb2714 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:06.964866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2f6b09d-b342-42e5-af25-edebeadb2714 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:06.965409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2f6b09d-b342-42e5-af25-edebeadb2714 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:06.965889 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2f6b09d-b342-42e5-af25-edebeadb2714 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:06.966638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2f6b09d-b342-42e5-af25-edebeadb2714 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:06.967152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2f6b09d-b342-42e5-af25-edebeadb2714 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:06.967618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b2f6b09d-b342-42e5-af25-edebeadb2714 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:07.106256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b2f6b09d-b342-42e5-af25-edebeadb2714 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:07.115383 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b2f6b09d-b342-42e5-af25-edebeadb2714 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.162704 Aug 24 06:38:07.115971 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1220/2438] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:06 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:07.449929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:07.450535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:07.457414 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:07.457898 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:07.458335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:07.459030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:07.459511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:07.459933 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:07.609341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:07.619457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:07.621077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:07.622294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c46918f8-8d68-4f00-a58f-51ef107cfde8 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.176630 Aug 24 06:38:07.622868 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1219/2439] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:07 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:07.732722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e15a5c26-bcca-413a-b662-f45d58ab9241 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:07.733345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e15a5c26-bcca-413a-b662-f45d58ab9241 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:07.740662 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e15a5c26-bcca-413a-b662-f45d58ab9241 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:07.741159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e15a5c26-bcca-413a-b662-f45d58ab9241 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:07.741700 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e15a5c26-bcca-413a-b662-f45d58ab9241 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:07.742374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e15a5c26-bcca-413a-b662-f45d58ab9241 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:07.742823 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e15a5c26-bcca-413a-b662-f45d58ab9241 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:07.743244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e15a5c26-bcca-413a-b662-f45d58ab9241 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:07.808233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e15a5c26-bcca-413a-b662-f45d58ab9241 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:07.817376 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e15a5c26-bcca-413a-b662-f45d58ab9241 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.089558 Aug 24 06:38:07.817974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1221/2440] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:07 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:08.147174 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2737b1e5-22fd-4617-8231-f7ef85d14ff0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:08.147684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2737b1e5-22fd-4617-8231-f7ef85d14ff0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:08.154335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2737b1e5-22fd-4617-8231-f7ef85d14ff0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:08.154968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2737b1e5-22fd-4617-8231-f7ef85d14ff0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:08.155595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2737b1e5-22fd-4617-8231-f7ef85d14ff0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:08.156704 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2737b1e5-22fd-4617-8231-f7ef85d14ff0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:08.157327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2737b1e5-22fd-4617-8231-f7ef85d14ff0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:08.157797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2737b1e5-22fd-4617-8231-f7ef85d14ff0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:08.304728 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2737b1e5-22fd-4617-8231-f7ef85d14ff0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:08.319523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2737b1e5-22fd-4617-8231-f7ef85d14ff0 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.175867 Aug 24 06:38:08.320633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1220/2441] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:08 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:08.645634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:08.646339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:08.652987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:08.653476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:08.653908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:08.654613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:08.655061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:08.655491 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:08.798332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:08.807506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:08.809035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:08.810462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-df9d8d4a-3ec1-4896-8d11-fefc690495af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.168905 Aug 24 06:38:08.811026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1222/2442] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:08.838657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0a361a8a-b6e0-4133-8e5f-810de8fb1b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:08.839240 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0a361a8a-b6e0-4133-8e5f-810de8fb1b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:08.845897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a361a8a-b6e0-4133-8e5f-810de8fb1b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:08.846381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a361a8a-b6e0-4133-8e5f-810de8fb1b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:08.846811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a361a8a-b6e0-4133-8e5f-810de8fb1b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:08.847508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a361a8a-b6e0-4133-8e5f-810de8fb1b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:08.847952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a361a8a-b6e0-4133-8e5f-810de8fb1b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:08.848376 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0a361a8a-b6e0-4133-8e5f-810de8fb1b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:08.914214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0a361a8a-b6e0-4133-8e5f-810de8fb1b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:08.923012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0a361a8a-b6e0-4133-8e5f-810de8fb1b64 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088420 Aug 24 06:38:08.923603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1221/2443] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:08 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:09.354172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7b56a79a-8e84-462f-8816-8fa2e2994537 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:09.354826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7b56a79a-8e84-462f-8816-8fa2e2994537 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:09.361875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7b56a79a-8e84-462f-8816-8fa2e2994537 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:09.362354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7b56a79a-8e84-462f-8816-8fa2e2994537 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:09.362783 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7b56a79a-8e84-462f-8816-8fa2e2994537 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:09.363483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7b56a79a-8e84-462f-8816-8fa2e2994537 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:09.363925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7b56a79a-8e84-462f-8816-8fa2e2994537 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:09.364339 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7b56a79a-8e84-462f-8816-8fa2e2994537 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:09.508121 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7b56a79a-8e84-462f-8816-8fa2e2994537 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:09.516778 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7b56a79a-8e84-462f-8816-8fa2e2994537 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.166368 Aug 24 06:38:09.517361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1223/2444] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:09 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:09.834757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:09.835357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:09.842064 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:09.842833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:09.843029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:09.843782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:09.844337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:09.844794 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:09.943963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8e75bf84-cb90-43a2-8f93-9a98807d5be5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:09.944916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8e75bf84-cb90-43a2-8f93-9a98807d5be5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:09.951982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e75bf84-cb90-43a2-8f93-9a98807d5be5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:09.953043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e75bf84-cb90-43a2-8f93-9a98807d5be5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:09.953482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e75bf84-cb90-43a2-8f93-9a98807d5be5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:09.954201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e75bf84-cb90-43a2-8f93-9a98807d5be5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:09.954658 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e75bf84-cb90-43a2-8f93-9a98807d5be5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:09.955080 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8e75bf84-cb90-43a2-8f93-9a98807d5be5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:10.010508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:10.020663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:10.022252 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:10.023476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-94e3e70f-1966-4709-897a-e23557359abb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.192670 Aug 24 06:38:10.024047 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1222/2445] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:10.026224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8e75bf84-cb90-43a2-8f93-9a98807d5be5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:10.035431 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8e75bf84-cb90-43a2-8f93-9a98807d5be5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.095310 Aug 24 06:38:10.036648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1224/2446] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:09 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:10.553021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c9534c55-0466-46ef-ad9b-e8b36c93dfd6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:10.553746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c9534c55-0466-46ef-ad9b-e8b36c93dfd6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:10.561369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9534c55-0466-46ef-ad9b-e8b36c93dfd6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:10.561863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9534c55-0466-46ef-ad9b-e8b36c93dfd6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:10.562368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9534c55-0466-46ef-ad9b-e8b36c93dfd6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:10.563112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9534c55-0466-46ef-ad9b-e8b36c93dfd6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:10.563568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9534c55-0466-46ef-ad9b-e8b36c93dfd6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:10.564010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c9534c55-0466-46ef-ad9b-e8b36c93dfd6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:10.712125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c9534c55-0466-46ef-ad9b-e8b36c93dfd6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:10.721234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c9534c55-0466-46ef-ad9b-e8b36c93dfd6 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.172200 Aug 24 06:38:10.721820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1223/2447] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:10 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:11.047551 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:11.048247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:11.057740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:11.058361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:11.058857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:11.059159 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3fcc3798-4eb4-4c00-9de6-a0fd894e3d09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:11.060188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:11.060423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:11.060658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3fcc3798-4eb4-4c00-9de6-a0fd894e3d09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:11.061009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:11.069319 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fcc3798-4eb4-4c00-9de6-a0fd894e3d09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:11.070158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fcc3798-4eb4-4c00-9de6-a0fd894e3d09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:11.070711 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fcc3798-4eb4-4c00-9de6-a0fd894e3d09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:11.071571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fcc3798-4eb4-4c00-9de6-a0fd894e3d09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:11.072096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fcc3798-4eb4-4c00-9de6-a0fd894e3d09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:11.073005 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3fcc3798-4eb4-4c00-9de6-a0fd894e3d09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:11.148015 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3fcc3798-4eb4-4c00-9de6-a0fd894e3d09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:11.163701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3fcc3798-4eb4-4c00-9de6-a0fd894e3d09 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.109401 Aug 24 06:38:11.164168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1224/2448] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:11 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:11.223051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:11.235820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:11.237388 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:11.238583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d45813dc-7ecb-4466-adb8-c23fd831966c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.195686 Aug 24 06:38:11.239152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1225/2449] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:11.757407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-66efdeb4-c557-42fb-bf77-7adcc302aa22 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:11.758030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-66efdeb4-c557-42fb-bf77-7adcc302aa22 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:11.765286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66efdeb4-c557-42fb-bf77-7adcc302aa22 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:11.765773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66efdeb4-c557-42fb-bf77-7adcc302aa22 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:11.766249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66efdeb4-c557-42fb-bf77-7adcc302aa22 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:11.766983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66efdeb4-c557-42fb-bf77-7adcc302aa22 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:11.767434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66efdeb4-c557-42fb-bf77-7adcc302aa22 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:11.767869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-66efdeb4-c557-42fb-bf77-7adcc302aa22 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:11.919726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-66efdeb4-c557-42fb-bf77-7adcc302aa22 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:11.929652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-66efdeb4-c557-42fb-bf77-7adcc302aa22 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.176425 Aug 24 06:38:11.930398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1225/2450] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:11 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:12.198250 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-02ed2731-d9e9-4215-bfa7-b0572dcfa7de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:12.199012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-02ed2731-d9e9-4215-bfa7-b0572dcfa7de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:12.205896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02ed2731-d9e9-4215-bfa7-b0572dcfa7de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:12.206439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02ed2731-d9e9-4215-bfa7-b0572dcfa7de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:12.206914 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02ed2731-d9e9-4215-bfa7-b0572dcfa7de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:12.207707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02ed2731-d9e9-4215-bfa7-b0572dcfa7de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:12.208247 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02ed2731-d9e9-4215-bfa7-b0572dcfa7de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:12.208746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-02ed2731-d9e9-4215-bfa7-b0572dcfa7de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:12.246659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:38:12.247565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:38:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:38:12.262378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:12.262982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:12.269861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:12.270355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:12.270786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:12.271491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:12.271936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:12.272357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:12.289290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-02ed2731-d9e9-4215-bfa7-b0572dcfa7de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:12.299266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-02ed2731-d9e9-4215-bfa7-b0572dcfa7de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.104845 Aug 24 06:38:12.299865 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1226/2451] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:12 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:12.426294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:12.436773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:12.438303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:12.439494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f212d4d7-13a1-488c-8cb2-99954b8ca92c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.181573 Aug 24 06:38:12.440070 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1226/2452] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:12.953350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-412a0149-fa76-419b-8281-68f57d859e7e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:12.953972 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-412a0149-fa76-419b-8281-68f57d859e7e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:12.960287 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-412a0149-fa76-419b-8281-68f57d859e7e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:12.960732 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-412a0149-fa76-419b-8281-68f57d859e7e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:12.961164 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-412a0149-fa76-419b-8281-68f57d859e7e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:12.961858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-412a0149-fa76-419b-8281-68f57d859e7e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:12.962302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-412a0149-fa76-419b-8281-68f57d859e7e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:12.962722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-412a0149-fa76-419b-8281-68f57d859e7e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:13.105365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-412a0149-fa76-419b-8281-68f57d859e7e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:13.113860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-412a0149-fa76-419b-8281-68f57d859e7e tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164700 Aug 24 06:38:13.114476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1227/2453] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:12 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:13.321666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8a975b20-11bf-4ade-9716-14d7d6de4977 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:13.322299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8a975b20-11bf-4ade-9716-14d7d6de4977 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:13.329895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a975b20-11bf-4ade-9716-14d7d6de4977 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:13.330404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a975b20-11bf-4ade-9716-14d7d6de4977 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:13.330839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a975b20-11bf-4ade-9716-14d7d6de4977 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:13.331543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a975b20-11bf-4ade-9716-14d7d6de4977 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:13.332024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a975b20-11bf-4ade-9716-14d7d6de4977 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:13.332449 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8a975b20-11bf-4ade-9716-14d7d6de4977 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:13.404121 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8a975b20-11bf-4ade-9716-14d7d6de4977 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:13.418993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8a975b20-11bf-4ade-9716-14d7d6de4977 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.101631 Aug 24 06:38:13.419952 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1227/2454] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:13 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:13.464723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:13.465424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:13.472091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:13.472614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:13.473060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:13.473772 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:13.474224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:13.474646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:13.630517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:13.646671 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:13.649682 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:13.651611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1badc989-1ef5-4cc4-9226-4b8422778ea4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.191107 Aug 24 06:38:13.652544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1228/2455] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:13 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:14.135300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f5b2477b-eaf2-4f68-8edb-1206d02c9739 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:14.135967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f5b2477b-eaf2-4f68-8edb-1206d02c9739 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:14.142493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5b2477b-eaf2-4f68-8edb-1206d02c9739 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:14.142974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5b2477b-eaf2-4f68-8edb-1206d02c9739 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:14.143406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5b2477b-eaf2-4f68-8edb-1206d02c9739 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:14.144097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5b2477b-eaf2-4f68-8edb-1206d02c9739 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:14.144586 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5b2477b-eaf2-4f68-8edb-1206d02c9739 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:14.145003 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f5b2477b-eaf2-4f68-8edb-1206d02c9739 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:14.312085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f5b2477b-eaf2-4f68-8edb-1206d02c9739 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:14.321184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f5b2477b-eaf2-4f68-8edb-1206d02c9739 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.189838 Aug 24 06:38:14.321767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1228/2456] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:14 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:14.453333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-eb138c85-ecbe-4458-b358-004af704b6c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:14.454121 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-eb138c85-ecbe-4458-b358-004af704b6c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:14.461518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb138c85-ecbe-4458-b358-004af704b6c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:14.462211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb138c85-ecbe-4458-b358-004af704b6c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:14.462765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb138c85-ecbe-4458-b358-004af704b6c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:14.463617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb138c85-ecbe-4458-b358-004af704b6c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:14.464180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb138c85-ecbe-4458-b358-004af704b6c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:14.464855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eb138c85-ecbe-4458-b358-004af704b6c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:14.469627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:14.532833 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-eb138c85-ecbe-4458-b358-004af704b6c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:14.541880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-eb138c85-ecbe-4458-b358-004af704b6c4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.092541 Aug 24 06:38:14.542464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1229/2457] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:14 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:14.688207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:14.696045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:14.697196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:14.697764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:14.698343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:14.699296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:14.699888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:14.700399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:14.841141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:14.850322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:14.851842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:14.853052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-604d53e2-4b9e-420e-b3e4-2d73ac2260dc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.169742 Aug 24 06:38:14.853652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1229/2458] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:14 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:38:15.344011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-88377db5-398d-4af0-a682-9e0001c20441 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:15.344698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-88377db5-398d-4af0-a682-9e0001c20441 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:15.351365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88377db5-398d-4af0-a682-9e0001c20441 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:15.351855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88377db5-398d-4af0-a682-9e0001c20441 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:15.352292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88377db5-398d-4af0-a682-9e0001c20441 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:15.353022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88377db5-398d-4af0-a682-9e0001c20441 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:15.353477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88377db5-398d-4af0-a682-9e0001c20441 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:15.353904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88377db5-398d-4af0-a682-9e0001c20441 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:15.492898 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-88377db5-398d-4af0-a682-9e0001c20441 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:15.502471 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-88377db5-398d-4af0-a682-9e0001c20441 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.162606 Aug 24 06:38:15.503052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1230/2459] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:15 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:15.575851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-254bbcd6-6073-4c26-9cf0-dc57d24460c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:15.576462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-254bbcd6-6073-4c26-9cf0-dc57d24460c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:15.582825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254bbcd6-6073-4c26-9cf0-dc57d24460c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:15.583370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254bbcd6-6073-4c26-9cf0-dc57d24460c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:15.583844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254bbcd6-6073-4c26-9cf0-dc57d24460c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:15.584657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254bbcd6-6073-4c26-9cf0-dc57d24460c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:15.585224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254bbcd6-6073-4c26-9cf0-dc57d24460c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:15.585692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-254bbcd6-6073-4c26-9cf0-dc57d24460c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:15.657976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-254bbcd6-6073-4c26-9cf0-dc57d24460c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:15.673147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-254bbcd6-6073-4c26-9cf0-dc57d24460c2 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.100773 Aug 24 06:38:15.674155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1230/2460] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:15 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:15.878096 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:15.878623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:15.885350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:15.885839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:15.886277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:15.886985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:15.887438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:15.887861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:16.032482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:16.041894 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:16.043418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:16.044637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4e0152f6-afe5-4426-b165-ed25b3515b0c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.171472 Aug 24 06:38:16.045214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1231/2461] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:16.523982 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a8142b8b-fdc7-45c1-bee4-9bf96accbd79 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:16.524629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a8142b8b-fdc7-45c1-bee4-9bf96accbd79 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:16.532408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8142b8b-fdc7-45c1-bee4-9bf96accbd79 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:16.532929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8142b8b-fdc7-45c1-bee4-9bf96accbd79 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:16.534750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8142b8b-fdc7-45c1-bee4-9bf96accbd79 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:16.534750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8142b8b-fdc7-45c1-bee4-9bf96accbd79 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:16.534750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8142b8b-fdc7-45c1-bee4-9bf96accbd79 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:16.535208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a8142b8b-fdc7-45c1-bee4-9bf96accbd79 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:16.683087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a8142b8b-fdc7-45c1-bee4-9bf96accbd79 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:16.693324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a8142b8b-fdc7-45c1-bee4-9bf96accbd79 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.173224 Aug 24 06:38:16.694045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1231/2462] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:16 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:16.712542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ad87eb25-ed3c-4014-8db6-53623082133a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:16.713272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ad87eb25-ed3c-4014-8db6-53623082133a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:16.721948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad87eb25-ed3c-4014-8db6-53623082133a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:16.722440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad87eb25-ed3c-4014-8db6-53623082133a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:16.722895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad87eb25-ed3c-4014-8db6-53623082133a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:16.723740 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad87eb25-ed3c-4014-8db6-53623082133a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:16.724185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad87eb25-ed3c-4014-8db6-53623082133a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:16.724668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ad87eb25-ed3c-4014-8db6-53623082133a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:16.799986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ad87eb25-ed3c-4014-8db6-53623082133a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:16.810735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ad87eb25-ed3c-4014-8db6-53623082133a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.108284 Aug 24 06:38:16.811498 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1232/2463] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:16 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:17.067882 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:17.068524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:17.074975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:17.075459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:17.075893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:17.076635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:17.077129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:17.077552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:17.225321 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:17.238938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:17.243687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:17.243687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-eb71b1c1-d6e5-4586-a59a-213d540c33bd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.178413 Aug 24 06:38:17.243687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1232/2464] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:17.716141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f32c565c-8f25-4f2a-947f-17b399df9d45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:17.716989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f32c565c-8f25-4f2a-947f-17b399df9d45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:17.723979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32c565c-8f25-4f2a-947f-17b399df9d45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:17.724472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32c565c-8f25-4f2a-947f-17b399df9d45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:17.724933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32c565c-8f25-4f2a-947f-17b399df9d45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:17.725635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32c565c-8f25-4f2a-947f-17b399df9d45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:17.726085 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32c565c-8f25-4f2a-947f-17b399df9d45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:17.726505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f32c565c-8f25-4f2a-947f-17b399df9d45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:17.834454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2f361a64-4678-43ba-b2d3-965e60a02bed tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:17.835190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2f361a64-4678-43ba-b2d3-965e60a02bed tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:17.843153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f361a64-4678-43ba-b2d3-965e60a02bed tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:17.843628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f361a64-4678-43ba-b2d3-965e60a02bed tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:17.844089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f361a64-4678-43ba-b2d3-965e60a02bed tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:17.844815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f361a64-4678-43ba-b2d3-965e60a02bed tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:17.845260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f361a64-4678-43ba-b2d3-965e60a02bed tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:17.845687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2f361a64-4678-43ba-b2d3-965e60a02bed tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:17.877097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f32c565c-8f25-4f2a-947f-17b399df9d45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:17.885794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f32c565c-8f25-4f2a-947f-17b399df9d45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.173480 Aug 24 06:38:17.886392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1233/2465] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:17 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:17.914481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2f361a64-4678-43ba-b2d3-965e60a02bed tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:17.922974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2f361a64-4678-43ba-b2d3-965e60a02bed tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093524 Aug 24 06:38:17.923563 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1233/2466] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:17 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:18.266600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:18.267355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:18.274316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:18.274865 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:18.275336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:18.276078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:18.276603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:18.277125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:18.428335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:18.438473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:18.441382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:18.441382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-57940190-d1d8-43b0-a5b5-81e4172edc5b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.179308 Aug 24 06:38:18.441795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1234/2467] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:18.908685 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-913fcb5e-1a6e-4864-8dc4-0f88b64586af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:18.909625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-913fcb5e-1a6e-4864-8dc4-0f88b64586af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:18.912160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=80 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:18.917392 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-913fcb5e-1a6e-4864-8dc4-0f88b64586af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:18.917944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-913fcb5e-1a6e-4864-8dc4-0f88b64586af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:18.918492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-913fcb5e-1a6e-4864-8dc4-0f88b64586af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:18.919196 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-913fcb5e-1a6e-4864-8dc4-0f88b64586af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:18.919645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-913fcb5e-1a6e-4864-8dc4-0f88b64586af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:18.920065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-913fcb5e-1a6e-4864-8dc4-0f88b64586af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:18.923396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:18.957489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-249bb46a-0987-4de1-92da-4129774bb8b4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:18.958523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-249bb46a-0987-4de1-92da-4129774bb8b4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:18.966191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-249bb46a-0987-4de1-92da-4129774bb8b4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:18.966901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-249bb46a-0987-4de1-92da-4129774bb8b4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:18.967643 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-249bb46a-0987-4de1-92da-4129774bb8b4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:18.968625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-249bb46a-0987-4de1-92da-4129774bb8b4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:18.969131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-249bb46a-0987-4de1-92da-4129774bb8b4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:18.969696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-249bb46a-0987-4de1-92da-4129774bb8b4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:19.050745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-249bb46a-0987-4de1-92da-4129774bb8b4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:19.062109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-249bb46a-0987-4de1-92da-4129774bb8b4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.110996 Aug 24 06:38:19.063071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1235/2468] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:18 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:19.084115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-913fcb5e-1a6e-4864-8dc4-0f88b64586af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:19.092995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-913fcb5e-1a6e-4864-8dc4-0f88b64586af tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.189025 Aug 24 06:38:19.093650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1234/2469] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:18 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:19.464369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:19.465002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:19.472165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:19.472821 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:19.473317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:19.474063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:19.474574 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:19.475089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:19.630456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:19.641027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:19.642934 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:19.644277 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-67a3e7a3-5e46-4413-a5bb-ce358e18da6c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.183888 Aug 24 06:38:19.645019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1236/2470] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:20.089460 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-27881e2d-6a37-4c1a-8bdd-2613e6295955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:20.090072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-27881e2d-6a37-4c1a-8bdd-2613e6295955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:20.097352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27881e2d-6a37-4c1a-8bdd-2613e6295955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:20.097833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27881e2d-6a37-4c1a-8bdd-2613e6295955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:20.098261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27881e2d-6a37-4c1a-8bdd-2613e6295955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:20.099008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27881e2d-6a37-4c1a-8bdd-2613e6295955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:20.099456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27881e2d-6a37-4c1a-8bdd-2613e6295955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:20.099869 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27881e2d-6a37-4c1a-8bdd-2613e6295955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:20.119811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9ef8cb96-867a-4b9f-8970-75dc2b715a31 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:20.120955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9ef8cb96-867a-4b9f-8970-75dc2b715a31 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:20.130187 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ef8cb96-867a-4b9f-8970-75dc2b715a31 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:20.130716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ef8cb96-867a-4b9f-8970-75dc2b715a31 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:20.131200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ef8cb96-867a-4b9f-8970-75dc2b715a31 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:20.131933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ef8cb96-867a-4b9f-8970-75dc2b715a31 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:20.132392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ef8cb96-867a-4b9f-8970-75dc2b715a31 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:20.132909 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9ef8cb96-867a-4b9f-8970-75dc2b715a31 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:20.180232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-27881e2d-6a37-4c1a-8bdd-2613e6295955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:20.192978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-27881e2d-6a37-4c1a-8bdd-2613e6295955 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.108042 Aug 24 06:38:20.194215 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1235/2471] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:20 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:20.272196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9ef8cb96-867a-4b9f-8970-75dc2b715a31 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:20.281027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9ef8cb96-867a-4b9f-8970-75dc2b715a31 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.168362 Aug 24 06:38:20.281616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1237/2472] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:20 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:20.667859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:20.668513 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:20.675271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:20.675755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:20.676185 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:20.676946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:20.677396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:20.677820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:20.862706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:20.872746 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:20.874352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:20.875580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-27d202d4-a488-4db5-b1d5-a3772d96fa9b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.211740 Aug 24 06:38:20.876163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1236/2473] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:20 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:21.221309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7065c57b-e298-4274-894f-64ec82bde91a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:21.222002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7065c57b-e298-4274-894f-64ec82bde91a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:21.228798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7065c57b-e298-4274-894f-64ec82bde91a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:21.229307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7065c57b-e298-4274-894f-64ec82bde91a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:21.229735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7065c57b-e298-4274-894f-64ec82bde91a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:21.230452 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7065c57b-e298-4274-894f-64ec82bde91a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:21.230910 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7065c57b-e298-4274-894f-64ec82bde91a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:21.231341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7065c57b-e298-4274-894f-64ec82bde91a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:21.299290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7065c57b-e298-4274-894f-64ec82bde91a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:21.306858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9f5624a5-fc52-4aef-a28b-26a55c404f9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:21.307876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9f5624a5-fc52-4aef-a28b-26a55c404f9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:21.314125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7065c57b-e298-4274-894f-64ec82bde91a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.096266 Aug 24 06:38:21.314818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1238/2474] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:21 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:21.319589 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5624a5-fc52-4aef-a28b-26a55c404f9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:21.320489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5624a5-fc52-4aef-a28b-26a55c404f9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:21.321351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5624a5-fc52-4aef-a28b-26a55c404f9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:21.322653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5624a5-fc52-4aef-a28b-26a55c404f9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:21.323801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5624a5-fc52-4aef-a28b-26a55c404f9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:21.324636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f5624a5-fc52-4aef-a28b-26a55c404f9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:21.473974 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9f5624a5-fc52-4aef-a28b-26a55c404f9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:21.483017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9f5624a5-fc52-4aef-a28b-26a55c404f9d tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.182897 Aug 24 06:38:21.483601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1237/2475] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:21 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:21.903249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:21.904328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:21.916420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:21.917318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:21.918037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:21.919347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:21.920184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:21.921702 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:22.087191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:22.097625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:22.099264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:22.100673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9d04c005-7851-492f-a26e-1088f13a99a3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.205045 Aug 24 06:38:22.101340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1239/2476] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:22.345605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1d8c2023-53f1-4762-b3ed-cf9b4a1f8a20 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:22.346274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1d8c2023-53f1-4762-b3ed-cf9b4a1f8a20 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:22.353530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d8c2023-53f1-4762-b3ed-cf9b4a1f8a20 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:22.354016 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d8c2023-53f1-4762-b3ed-cf9b4a1f8a20 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:22.354446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d8c2023-53f1-4762-b3ed-cf9b4a1f8a20 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:22.355143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d8c2023-53f1-4762-b3ed-cf9b4a1f8a20 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:22.355593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d8c2023-53f1-4762-b3ed-cf9b4a1f8a20 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:22.356014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1d8c2023-53f1-4762-b3ed-cf9b4a1f8a20 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:22.420219 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1d8c2023-53f1-4762-b3ed-cf9b4a1f8a20 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:22.429603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1d8c2023-53f1-4762-b3ed-cf9b4a1f8a20 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.088111 Aug 24 06:38:22.430325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1238/2477] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:22 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:22.504619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-83250f60-8d3b-4a68-b187-6d5422497356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:22.505601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-83250f60-8d3b-4a68-b187-6d5422497356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:22.512819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83250f60-8d3b-4a68-b187-6d5422497356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:22.513446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83250f60-8d3b-4a68-b187-6d5422497356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:22.513985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83250f60-8d3b-4a68-b187-6d5422497356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:22.514845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83250f60-8d3b-4a68-b187-6d5422497356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:22.515417 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83250f60-8d3b-4a68-b187-6d5422497356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:22.515937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-83250f60-8d3b-4a68-b187-6d5422497356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:22.656820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-83250f60-8d3b-4a68-b187-6d5422497356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:22.665381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-83250f60-8d3b-4a68-b187-6d5422497356 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164820 Aug 24 06:38:22.665955 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1240/2478] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:22 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:23.124800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:23.125406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:23.131714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:23.132313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:23.132840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:23.133672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:23.134163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:23.134622 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:23.274780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:23.285086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:23.286940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:23.288170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8e4c9824-ff7b-4fc8-ad75-f67f0ccc1ed3 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.167551 Aug 24 06:38:23.288835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1239/2479] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:23.456519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-65726ae5-76ac-41e0-8f23-3b0d663d6e83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:23.457637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-65726ae5-76ac-41e0-8f23-3b0d663d6e83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:23.468815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65726ae5-76ac-41e0-8f23-3b0d663d6e83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:23.469686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65726ae5-76ac-41e0-8f23-3b0d663d6e83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:23.470481 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65726ae5-76ac-41e0-8f23-3b0d663d6e83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:23.471719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65726ae5-76ac-41e0-8f23-3b0d663d6e83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:23.472514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65726ae5-76ac-41e0-8f23-3b0d663d6e83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:23.473237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65726ae5-76ac-41e0-8f23-3b0d663d6e83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:23.541488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-65726ae5-76ac-41e0-8f23-3b0d663d6e83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:23.550828 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-65726ae5-76ac-41e0-8f23-3b0d663d6e83 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.101737 Aug 24 06:38:23.551496 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1241/2480] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:23 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:23.687465 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2fb633d8-e623-4a59-b472-b31bc3b51b86 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:23.688181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2fb633d8-e623-4a59-b472-b31bc3b51b86 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:23.695171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fb633d8-e623-4a59-b472-b31bc3b51b86 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:23.695650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fb633d8-e623-4a59-b472-b31bc3b51b86 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:23.696074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fb633d8-e623-4a59-b472-b31bc3b51b86 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:23.696809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fb633d8-e623-4a59-b472-b31bc3b51b86 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:23.697257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fb633d8-e623-4a59-b472-b31bc3b51b86 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:23.697672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2fb633d8-e623-4a59-b472-b31bc3b51b86 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:23.838995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2fb633d8-e623-4a59-b472-b31bc3b51b86 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:23.848244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2fb633d8-e623-4a59-b472-b31bc3b51b86 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.164816 Aug 24 06:38:23.848864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1240/2481] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:23 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:24.313191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:24.313800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:24.320368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:24.320904 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:24.321366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:24.322084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:24.322538 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:24.322987 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:24.472697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:24.485857 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:24.487753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:24.489494 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3c336e82-29a3-43ec-a4a5-ae3b8d1d4954 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.181333 Aug 24 06:38:24.490398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1242/2482] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:24.572234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-353aed59-03f3-4c01-b306-22e891e2a38b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:24.572783 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-353aed59-03f3-4c01-b306-22e891e2a38b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:24.579080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-353aed59-03f3-4c01-b306-22e891e2a38b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:24.579563 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-353aed59-03f3-4c01-b306-22e891e2a38b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:24.579991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-353aed59-03f3-4c01-b306-22e891e2a38b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:24.580719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-353aed59-03f3-4c01-b306-22e891e2a38b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:24.581165 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-353aed59-03f3-4c01-b306-22e891e2a38b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:24.581575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-353aed59-03f3-4c01-b306-22e891e2a38b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:24.651186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-353aed59-03f3-4c01-b306-22e891e2a38b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:24.659789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-353aed59-03f3-4c01-b306-22e891e2a38b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.091479 Aug 24 06:38:24.660371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1241/2483] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:24 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:24.870446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-72c373e0-8b91-4c88-a08c-f32e0c6970d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:24.871026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-72c373e0-8b91-4c88-a08c-f32e0c6970d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:24.877648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72c373e0-8b91-4c88-a08c-f32e0c6970d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:24.878125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72c373e0-8b91-4c88-a08c-f32e0c6970d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:24.878555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72c373e0-8b91-4c88-a08c-f32e0c6970d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:24.879252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72c373e0-8b91-4c88-a08c-f32e0c6970d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:24.879694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72c373e0-8b91-4c88-a08c-f32e0c6970d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:24.880106 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72c373e0-8b91-4c88-a08c-f32e0c6970d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:25.029484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-72c373e0-8b91-4c88-a08c-f32e0c6970d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:25.040171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-72c373e0-8b91-4c88-a08c-f32e0c6970d2 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.173580 Aug 24 06:38:25.040785 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1243/2484] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:24 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:25.519929 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:25.520585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:25.527590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:25.528107 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:25.528576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:25.529283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:25.530244 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:25.530663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:25.670455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:25.679739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:25.681269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:25.682469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b9a18453-ef77-40b7-8060-dc85fa345884 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.166739 Aug 24 06:38:25.690137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1242/2485] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:25.690518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b38b0e49-d1a9-4cc0-b8cc-5d373da0fa31 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:25.690518 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b38b0e49-d1a9-4cc0-b8cc-5d373da0fa31 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:25.692989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=76 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:25.699321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b38b0e49-d1a9-4cc0-b8cc-5d373da0fa31 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:25.700132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b38b0e49-d1a9-4cc0-b8cc-5d373da0fa31 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:25.700902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b38b0e49-d1a9-4cc0-b8cc-5d373da0fa31 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:25.702824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b38b0e49-d1a9-4cc0-b8cc-5d373da0fa31 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:25.703634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b38b0e49-d1a9-4cc0-b8cc-5d373da0fa31 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:25.704376 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b38b0e49-d1a9-4cc0-b8cc-5d373da0fa31 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:25.794079 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b38b0e49-d1a9-4cc0-b8cc-5d373da0fa31 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:25.802880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b38b0e49-d1a9-4cc0-b8cc-5d373da0fa31 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.124312 Aug 24 06:38:25.803462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1244/2486] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:25 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:26.063037 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8ffda5e0-6024-45da-a494-6dfa8537ac45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:26.063781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8ffda5e0-6024-45da-a494-6dfa8537ac45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:26.070538 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffda5e0-6024-45da-a494-6dfa8537ac45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:26.071081 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffda5e0-6024-45da-a494-6dfa8537ac45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:26.071557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffda5e0-6024-45da-a494-6dfa8537ac45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:26.072298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffda5e0-6024-45da-a494-6dfa8537ac45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:26.072866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffda5e0-6024-45da-a494-6dfa8537ac45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:26.073365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8ffda5e0-6024-45da-a494-6dfa8537ac45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:26.212627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8ffda5e0-6024-45da-a494-6dfa8537ac45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:26.221406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8ffda5e0-6024-45da-a494-6dfa8537ac45 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.162543 Aug 24 06:38:26.222066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1243/2487] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:26 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:26.712400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:26.713400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:26.720692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:26.721175 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:26.721601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:26.722297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:26.722741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:26.723154 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:26.837936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cb348fdc-729e-4160-90c9-e891fb79769b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:26.838880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cb348fdc-729e-4160-90c9-e891fb79769b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:26.846793 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb348fdc-729e-4160-90c9-e891fb79769b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:26.847355 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb348fdc-729e-4160-90c9-e891fb79769b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:26.848002 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb348fdc-729e-4160-90c9-e891fb79769b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:26.849045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb348fdc-729e-4160-90c9-e891fb79769b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:26.849564 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb348fdc-729e-4160-90c9-e891fb79769b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:26.850058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cb348fdc-729e-4160-90c9-e891fb79769b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:26.874779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:26.877109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:26.885503 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:26.892731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:26.892731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3b547def-5abf-41f6-ac38-1e8ac325ef75 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.180642 Aug 24 06:38:26.892731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1245/2488] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:26.922175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cb348fdc-729e-4160-90c9-e891fb79769b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:26.930858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cb348fdc-729e-4160-90c9-e891fb79769b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.097450 Aug 24 06:38:26.931450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1244/2489] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:26 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:27.257532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2283a1bc-5ae6-4d4c-a7fe-4c34f1c4dd38 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:27.258156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2283a1bc-5ae6-4d4c-a7fe-4c34f1c4dd38 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:27.265119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2283a1bc-5ae6-4d4c-a7fe-4c34f1c4dd38 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:27.265604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2283a1bc-5ae6-4d4c-a7fe-4c34f1c4dd38 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:27.266049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2283a1bc-5ae6-4d4c-a7fe-4c34f1c4dd38 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:27.266826 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2283a1bc-5ae6-4d4c-a7fe-4c34f1c4dd38 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:27.267236 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2283a1bc-5ae6-4d4c-a7fe-4c34f1c4dd38 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:27.267657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2283a1bc-5ae6-4d4c-a7fe-4c34f1c4dd38 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:27.413113 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2283a1bc-5ae6-4d4c-a7fe-4c34f1c4dd38 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:27.422086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2283a1bc-5ae6-4d4c-a7fe-4c34f1c4dd38 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.168709 Aug 24 06:38:27.422669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1246/2490] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:27 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:27.927737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:27.928419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:27.935455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:27.935983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:27.936454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:27.937224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:27.937724 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:27.938186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:27.952523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0403aefb-79f2-4a2d-b2f6-1e879d9a61b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:27.953379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0403aefb-79f2-4a2d-b2f6-1e879d9a61b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:27.960237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0403aefb-79f2-4a2d-b2f6-1e879d9a61b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:27.960648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0403aefb-79f2-4a2d-b2f6-1e879d9a61b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:27.961092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0403aefb-79f2-4a2d-b2f6-1e879d9a61b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:27.961801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0403aefb-79f2-4a2d-b2f6-1e879d9a61b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:27.962255 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0403aefb-79f2-4a2d-b2f6-1e879d9a61b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:27.962675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0403aefb-79f2-4a2d-b2f6-1e879d9a61b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:28.061479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0403aefb-79f2-4a2d-b2f6-1e879d9a61b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:28.077509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0403aefb-79f2-4a2d-b2f6-1e879d9a61b5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.128073 Aug 24 06:38:28.078541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1247/2491] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:27 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:28.115482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:28.125492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:28.127105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:28.128337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c0a27435-27a6-4e75-b472-f950956bd4c1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.204707 Aug 24 06:38:28.129044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1245/2492] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:27 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:28.443633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4aa9a0dc-018b-4f46-aa18-5dc04b8aefeb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:28.444243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4aa9a0dc-018b-4f46-aa18-5dc04b8aefeb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:28.451103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4aa9a0dc-018b-4f46-aa18-5dc04b8aefeb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:28.451734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4aa9a0dc-018b-4f46-aa18-5dc04b8aefeb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:28.452213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4aa9a0dc-018b-4f46-aa18-5dc04b8aefeb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:28.453005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4aa9a0dc-018b-4f46-aa18-5dc04b8aefeb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:28.453526 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4aa9a0dc-018b-4f46-aa18-5dc04b8aefeb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:28.454001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4aa9a0dc-018b-4f46-aa18-5dc04b8aefeb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:28.599936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4aa9a0dc-018b-4f46-aa18-5dc04b8aefeb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:28.609679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4aa9a0dc-018b-4f46-aa18-5dc04b8aefeb tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.169864 Aug 24 06:38:28.613161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1248/2493] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:28 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:29.111063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1c5071f3-d4a8-4d76-9922-bc6eb319ffa7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:29.111680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1c5071f3-d4a8-4d76-9922-bc6eb319ffa7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:29.118312 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c5071f3-d4a8-4d76-9922-bc6eb319ffa7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:29.118791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c5071f3-d4a8-4d76-9922-bc6eb319ffa7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:29.119223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c5071f3-d4a8-4d76-9922-bc6eb319ffa7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:29.119915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c5071f3-d4a8-4d76-9922-bc6eb319ffa7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:29.120365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c5071f3-d4a8-4d76-9922-bc6eb319ffa7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:29.120821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c5071f3-d4a8-4d76-9922-bc6eb319ffa7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:29.156479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:29.157630 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:29.169262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:29.170622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:29.171564 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:29.172878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:29.173961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:29.174817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:29.188631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1c5071f3-d4a8-4d76-9922-bc6eb319ffa7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:29.201898 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1c5071f3-d4a8-4d76-9922-bc6eb319ffa7 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.095174 Aug 24 06:38:29.202494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1246/2494] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:29 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:29.333621 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:29.343706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:29.345368 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:29.346579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b71bbbfa-8e24-4597-9581-609af3beaced tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.197487 Aug 24 06:38:29.347199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1249/2495] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:29 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:29.631497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cc81fa46-25fb-4a8e-8d4a-bb9fa082b6ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:29.632139 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cc81fa46-25fb-4a8e-8d4a-bb9fa082b6ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:29.638605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cc81fa46-25fb-4a8e-8d4a-bb9fa082b6ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:29.639610 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cc81fa46-25fb-4a8e-8d4a-bb9fa082b6ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:29.640041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cc81fa46-25fb-4a8e-8d4a-bb9fa082b6ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:29.640796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cc81fa46-25fb-4a8e-8d4a-bb9fa082b6ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:29.641246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cc81fa46-25fb-4a8e-8d4a-bb9fa082b6ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:29.641664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cc81fa46-25fb-4a8e-8d4a-bb9fa082b6ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:29.796847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-cc81fa46-25fb-4a8e-8d4a-bb9fa082b6ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:29.805438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cc81fa46-25fb-4a8e-8d4a-bb9fa082b6ac tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.177814 Aug 24 06:38:29.806096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1247/2496] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:29 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:30.234160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b29d7106-459b-49b3-9760-b27ac94c3024 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:30.234761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b29d7106-459b-49b3-9760-b27ac94c3024 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:30.241582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b29d7106-459b-49b3-9760-b27ac94c3024 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:30.242074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b29d7106-459b-49b3-9760-b27ac94c3024 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:30.242507 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b29d7106-459b-49b3-9760-b27ac94c3024 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:30.243217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b29d7106-459b-49b3-9760-b27ac94c3024 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:30.243674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b29d7106-459b-49b3-9760-b27ac94c3024 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:30.244090 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b29d7106-459b-49b3-9760-b27ac94c3024 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:30.315081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b29d7106-459b-49b3-9760-b27ac94c3024 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:30.323622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b29d7106-459b-49b3-9760-b27ac94c3024 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.093659 Aug 24 06:38:30.324217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1250/2497] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:30 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:30.370765 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:30.371480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:30.378581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:30.379058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:30.379481 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:30.380171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:30.380649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:30.381066 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:30.515489 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:30.524934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:30.526458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:30.527647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ef4864b8-753e-4907-90fb-2dcba7596d20 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.160849 Aug 24 06:38:30.528263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1248/2498] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:30.827851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e96e1fd2-c594-476f-8d56-73a2117a13db tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:30.828416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e96e1fd2-c594-476f-8d56-73a2117a13db tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:30.835094 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96e1fd2-c594-476f-8d56-73a2117a13db tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:30.835581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96e1fd2-c594-476f-8d56-73a2117a13db tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:30.836012 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96e1fd2-c594-476f-8d56-73a2117a13db tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:30.836750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96e1fd2-c594-476f-8d56-73a2117a13db tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:30.837200 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96e1fd2-c594-476f-8d56-73a2117a13db tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:30.837616 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e96e1fd2-c594-476f-8d56-73a2117a13db tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:30.991158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e96e1fd2-c594-476f-8d56-73a2117a13db tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:30.999942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e96e1fd2-c594-476f-8d56-73a2117a13db tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.176211 Aug 24 06:38:31.000547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1251/2499] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:30 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:31.346261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-34fb6528-21c3-4720-9980-d91b3f7ed2e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:31.346877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-34fb6528-21c3-4720-9980-d91b3f7ed2e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:31.353281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-34fb6528-21c3-4720-9980-d91b3f7ed2e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:31.353771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-34fb6528-21c3-4720-9980-d91b3f7ed2e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:31.354205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-34fb6528-21c3-4720-9980-d91b3f7ed2e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:31.354909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-34fb6528-21c3-4720-9980-d91b3f7ed2e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:31.355363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-34fb6528-21c3-4720-9980-d91b3f7ed2e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:31.355830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-34fb6528-21c3-4720-9980-d91b3f7ed2e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:31.426172 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-34fb6528-21c3-4720-9980-d91b3f7ed2e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:31.436852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-34fb6528-21c3-4720-9980-d91b3f7ed2e6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.095269 Aug 24 06:38:31.437441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1249/2500] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:31 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:31.551864 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:31.552469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:31.559832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:31.560317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:31.561280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:31.561988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:31.562440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:31.562858 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:31.709970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:31.725645 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:31.728512 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:31.730709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7c34bfb4-033e-46db-8bc5-81b0a5aa7acf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.182806 Aug 24 06:38:31.731715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1252/2501] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:38:32.022138 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f9a7cc71-7908-40da-88fc-88fb4ec3b148 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:32.022751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f9a7cc71-7908-40da-88fc-88fb4ec3b148 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:32.029333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9a7cc71-7908-40da-88fc-88fb4ec3b148 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:32.029827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9a7cc71-7908-40da-88fc-88fb4ec3b148 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:32.030275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9a7cc71-7908-40da-88fc-88fb4ec3b148 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:32.030997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9a7cc71-7908-40da-88fc-88fb4ec3b148 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:32.031454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9a7cc71-7908-40da-88fc-88fb4ec3b148 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:32.031878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f9a7cc71-7908-40da-88fc-88fb4ec3b148 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:32.180057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f9a7cc71-7908-40da-88fc-88fb4ec3b148 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:32.182459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:32.190769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f9a7cc71-7908-40da-88fc-88fb4ec3b148 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.172633 Aug 24 06:38:32.191363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1250/2502] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:32 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:32.472669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-88ea7a4b-0b04-45ca-a5f7-d15dc912d620 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:32.473266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-88ea7a4b-0b04-45ca-a5f7-d15dc912d620 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:32.479673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88ea7a4b-0b04-45ca-a5f7-d15dc912d620 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:32.480156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88ea7a4b-0b04-45ca-a5f7-d15dc912d620 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:32.480626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88ea7a4b-0b04-45ca-a5f7-d15dc912d620 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:32.481648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88ea7a4b-0b04-45ca-a5f7-d15dc912d620 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:32.482119 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88ea7a4b-0b04-45ca-a5f7-d15dc912d620 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:32.483098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-88ea7a4b-0b04-45ca-a5f7-d15dc912d620 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:32.558701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-88ea7a4b-0b04-45ca-a5f7-d15dc912d620 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:32.568604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-88ea7a4b-0b04-45ca-a5f7-d15dc912d620 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.099768 Aug 24 06:38:32.569214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1253/2503] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:32 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:32.769411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:32.770284 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:32.776590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:32.777083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:32.777517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:32.778218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:32.778669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:32.779085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:32.930186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:32.940485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:32.942024 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:32.943210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3a4f3360-5906-4ad6-b1e8-a9b6484b2c5d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.178181 Aug 24 06:38:32.943773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1251/2504] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:33.212215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b9a76827-85ca-47cd-9303-7179ab1b53b8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:33.212902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b9a76827-85ca-47cd-9303-7179ab1b53b8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:33.219719 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9a76827-85ca-47cd-9303-7179ab1b53b8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:33.220206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9a76827-85ca-47cd-9303-7179ab1b53b8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:33.220676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9a76827-85ca-47cd-9303-7179ab1b53b8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:33.221371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9a76827-85ca-47cd-9303-7179ab1b53b8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:33.221822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9a76827-85ca-47cd-9303-7179ab1b53b8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:33.222243 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b9a76827-85ca-47cd-9303-7179ab1b53b8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:33.362565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b9a76827-85ca-47cd-9303-7179ab1b53b8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:33.371099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b9a76827-85ca-47cd-9303-7179ab1b53b8 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.162709 Aug 24 06:38:33.371679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1254/2505] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:33 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:33.591141 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1f227a18-e4d8-44f3-8de6-17ddd18e8a60 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:33.591667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1f227a18-e4d8-44f3-8de6-17ddd18e8a60 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:33.599062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f227a18-e4d8-44f3-8de6-17ddd18e8a60 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:33.599548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f227a18-e4d8-44f3-8de6-17ddd18e8a60 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:33.599992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f227a18-e4d8-44f3-8de6-17ddd18e8a60 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:33.600754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f227a18-e4d8-44f3-8de6-17ddd18e8a60 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:33.601211 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f227a18-e4d8-44f3-8de6-17ddd18e8a60 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:33.601633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1f227a18-e4d8-44f3-8de6-17ddd18e8a60 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:33.668123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1f227a18-e4d8-44f3-8de6-17ddd18e8a60 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:33.677197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1f227a18-e4d8-44f3-8de6-17ddd18e8a60 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.090194 Aug 24 06:38:33.677791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1252/2506] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:33 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:33.967836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:33.968553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:33.975534 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:33.976063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:33.976570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:33.977316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:33.977894 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:33.978369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:34.120969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:34.130951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:34.132459 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:34.133679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-94d4540a-299f-4a43-b154-94336c213720 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.170155 Aug 24 06:38:34.134272 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1255/2507] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:33 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:34.392846 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a336a76a-f6ba-4508-8d5b-f346ddbc77ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:34.393454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a336a76a-f6ba-4508-8d5b-f346ddbc77ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:34.400255 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a336a76a-f6ba-4508-8d5b-f346ddbc77ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:34.400766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a336a76a-f6ba-4508-8d5b-f346ddbc77ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:34.401194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a336a76a-f6ba-4508-8d5b-f346ddbc77ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:34.401878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a336a76a-f6ba-4508-8d5b-f346ddbc77ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:34.402322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a336a76a-f6ba-4508-8d5b-f346ddbc77ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:34.402734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a336a76a-f6ba-4508-8d5b-f346ddbc77ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:34.549394 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a336a76a-f6ba-4508-8d5b-f346ddbc77ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:34.557897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a336a76a-f6ba-4508-8d5b-f346ddbc77ea tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.169294 Aug 24 06:38:34.558477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1253/2508] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:34 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:34.699488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-594b1eeb-ce91-4f57-9ac4-a3dbd2248f6a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:34.700121 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-594b1eeb-ce91-4f57-9ac4-a3dbd2248f6a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:34.706561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-594b1eeb-ce91-4f57-9ac4-a3dbd2248f6a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:34.707055 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-594b1eeb-ce91-4f57-9ac4-a3dbd2248f6a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:34.707484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-594b1eeb-ce91-4f57-9ac4-a3dbd2248f6a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:34.708280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-594b1eeb-ce91-4f57-9ac4-a3dbd2248f6a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:34.708891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-594b1eeb-ce91-4f57-9ac4-a3dbd2248f6a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:34.709323 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-594b1eeb-ce91-4f57-9ac4-a3dbd2248f6a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:34.783553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-594b1eeb-ce91-4f57-9ac4-a3dbd2248f6a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:34.799854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-594b1eeb-ce91-4f57-9ac4-a3dbd2248f6a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.104005 Aug 24 06:38:34.800929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1256/2509] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:34 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:35.172744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:35.173359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:35.179763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:35.180251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:35.180714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:35.181413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:35.181862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:35.182281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:35.356827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:35.372272 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:35.375601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:35.378116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c6cbe839-2154-4057-bc2f-f7e39c3d3731 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.209280 Aug 24 06:38:35.379078 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1254/2510] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:35 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:35.580314 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-10364a28-2208-4823-a409-6a1d8e468ef7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:35.581058 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-10364a28-2208-4823-a409-6a1d8e468ef7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] [instance: 6f57e168-0ea9-4010-ac53-24c1da2474d7] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:35.587940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10364a28-2208-4823-a409-6a1d8e468ef7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:35.588427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10364a28-2208-4823-a409-6a1d8e468ef7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:35.588897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10364a28-2208-4823-a409-6a1d8e468ef7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:35.589636 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10364a28-2208-4823-a409-6a1d8e468ef7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:35.590087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10364a28-2208-4823-a409-6a1d8e468ef7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:35.590510 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10364a28-2208-4823-a409-6a1d8e468ef7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:35.731490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-10364a28-2208-4823-a409-6a1d8e468ef7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cb18bdb6d404cd5b303ce0a29212e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7315c7714a7f40ed852dde74d497d231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:35.741372 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-10364a28-2208-4823-a409-6a1d8e468ef7 tempest-VolumesSnapshotTestJSON-506271099 tempest-VolumesSnapshotTestJSON-506271099-project] 10.222.0.62 "GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7" status: 200 len: 1559 microversion: 2.1 time: 0.165448 Aug 24 06:38:35.742134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1257/2511] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:35 2022] GET /compute/v2.1/servers/6f57e168-0ea9-4010-ac53-24c1da2474d7 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:35.824856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-62c43e7f-9bab-49dd-af8a-5810797c9a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:35.826062 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-62c43e7f-9bab-49dd-af8a-5810797c9a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:35.835709 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c43e7f-9bab-49dd-af8a-5810797c9a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:35.836359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c43e7f-9bab-49dd-af8a-5810797c9a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:35.837171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c43e7f-9bab-49dd-af8a-5810797c9a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:35.838479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c43e7f-9bab-49dd-af8a-5810797c9a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:35.839233 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c43e7f-9bab-49dd-af8a-5810797c9a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:35.839889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62c43e7f-9bab-49dd-af8a-5810797c9a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:35.938108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-62c43e7f-9bab-49dd-af8a-5810797c9a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:35.949666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-62c43e7f-9bab-49dd-af8a-5810797c9a52 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 200 len: 1372 microversion: 2.1 time: 0.130246 Aug 24 06:38:35.950504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1255/2512] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:35 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 1372 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:35.976462 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-444b4d69-40ff-41f7-a0cf-ea9051a7cd70 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '.version_select at 0x7fcddc07a4c0>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:36.093086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-444b4d69-40ff-41f7-a0cf-ea9051a7cd70 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017395839" status: 202 len: 0 microversion: 2.1 time: 0.122501 Aug 24 06:38:36.093574 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1258/2513] 10.222.0.62 () {58 vars in 1221 bytes} [Wed Aug 24 06:38:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1017395839 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:38:36.416069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:36.417971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:36.431546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:36.432042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:36.432462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:36.433220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:36.433679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:36.434104 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:36.684097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:36.695048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:36.696587 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:36.697987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-630b3e3f-4a35-4154-857e-6c44eaeeff83 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.288580 Aug 24 06:38:36.699126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1256/2514] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:36 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:37.331706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7f32799e-53c8-4211-8f1b-1123a49f59ef tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Action: 'create', calling method: .version_select at 0x7fcdcff80550>, body: {"keypair": {"name": "tempest-keypair-473834849", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgJvdQqs+aZh/JGh/kEqkvDcSetVsNKNT0OJA3wP2HzF46PynB0e8aXJknJ8Y6HscHzoz922ee6mFpkmsu+St9dN3XCAplTpk4wfOPvSL/whY+aFlyyXyrDHexw0KYHTQ=="}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:38:37.353813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-7f32799e-53c8-4211-8f1b-1123a49f59ef tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'key_pairs'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:38:37.359391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-7f32799e-53c8-4211-8f1b-1123a49f59ef tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for user 6abfd0a28f9e482badae7018f1b7f9a1 and project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'key_pairs'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:38:37.476895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7f32799e-53c8-4211-8f1b-1123a49f59ef tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151335 Aug 24 06:38:37.477622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1259/2515] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 24 06:38:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:38:37.729802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:37.730590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:37.739910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:37.740451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:37.740921 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:37.741627 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:37.742076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:37.742493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:37.888250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:37.899710 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:37.902232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:37.903872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ca73bc90-071d-436b-a503-b7379c872047 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.181668 Aug 24 06:38:37.905503 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1257/2516] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:37 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:38.928318 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:38.929260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:38.937381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:38.937937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:38.939822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:38.939822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:38.939822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:38.940387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:39.114695 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:39.126412 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:39.128581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:39.134708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-817b11d4-5fbf-44ff-8223-e8b090e6eb24 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.206155 Aug 24 06:38:39.134708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1260/2517] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:38 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:39.488874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:38:39.489798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:38:40.170533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:40.171659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:40.181149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:40.181789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:40.182335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:40.183317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:40.183922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:40.184852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:40.364949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:40.374867 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:40.376518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:40.377772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-72fd2ca0-0169-49ab-832e-2dadc7367d1f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.212561 Aug 24 06:38:40.378383 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1258/2518] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:40 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:40.637071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1510864509", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51fe0999-9ccc-4b64-9b23-f80a9285df9a"}], "security_groups": [{"name": "tempest-securitygroup--164709710"}], "key_name": "tempest-keypair-473834849", "user_data": "}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:38:40.764221 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] validate_networks() for [('51fe0999-9ccc-4b64-9b23-f80a9285df9a', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:38:41.261829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:38:41.262325 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:38:41.262804 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:38:41.263880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:38:41.264203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:38:41.273659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:41.274064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:41.274503 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:41.275233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:41.275685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:41.276110 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:41.295592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:38:41.300560 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for user 6abfd0a28f9e482badae7018f1b7f9a1 and project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:38:41.314570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:38:41.316949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:38:41.407863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:41.408555 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:41.415310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:41.415798 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:41.416229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:41.416960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:41.417411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:41.417829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:41.461981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4f69aea6-afca-433f-9adb-fa258f95161f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.829311 Aug 24 06:38:41.464331 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1261/2519] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:38:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:38:41.481115 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c84894b1-ad97-417d-b58a-40f141da680c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:41.481995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c84894b1-ad97-417d-b58a-40f141da680c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:41.567722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c84894b1-ad97-417d-b58a-40f141da680c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:41.578598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c84894b1-ad97-417d-b58a-40f141da680c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1241 microversion: 2.1 time: 0.102301 Aug 24 06:38:41.579644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1262/2520] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:41 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1241 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:41.594148 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:41.603519 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:41.605205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:41.607577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3487d09b-fee8-44eb-a8cb-ec5029830bb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.205247 Aug 24 06:38:41.608138 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1259/2521] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:41 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:38:42.611036 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f3e1eaee-e689-446b-bffc-7b53e956c8de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:42.611845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f3e1eaee-e689-446b-bffc-7b53e956c8de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:42.619624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3e1eaee-e689-446b-bffc-7b53e956c8de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:42.620115 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3e1eaee-e689-446b-bffc-7b53e956c8de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:42.623896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3e1eaee-e689-446b-bffc-7b53e956c8de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:42.623896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3e1eaee-e689-446b-bffc-7b53e956c8de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:42.623896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3e1eaee-e689-446b-bffc-7b53e956c8de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:42.623896 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f3e1eaee-e689-446b-bffc-7b53e956c8de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:42.635050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:42.636369 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:42.648238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:42.649116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:42.649886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:42.651108 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:42.651927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:42.652696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:42.706856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f3e1eaee-e689-446b-bffc-7b53e956c8de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:42.720666 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f3e1eaee-e689-446b-bffc-7b53e956c8de tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1245 microversion: 2.1 time: 0.113476 Aug 24 06:38:42.721805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1263/2522] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:42 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:42.850940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:42.862251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:42.863875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:42.865607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e93a96b1-8315-4825-af58-2cedb87b0321 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.237537 Aug 24 06:38:42.866969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1260/2523] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:42 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:43.749303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fbd94190-d3dd-456a-8795-affc5386313a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:43.750299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fbd94190-d3dd-456a-8795-affc5386313a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:43.758715 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbd94190-d3dd-456a-8795-affc5386313a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:43.759549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbd94190-d3dd-456a-8795-affc5386313a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:43.760041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbd94190-d3dd-456a-8795-affc5386313a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:43.761002 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbd94190-d3dd-456a-8795-affc5386313a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:43.761552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbd94190-d3dd-456a-8795-affc5386313a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:43.762041 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fbd94190-d3dd-456a-8795-affc5386313a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:43.859129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fbd94190-d3dd-456a-8795-affc5386313a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:43.876188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fbd94190-d3dd-456a-8795-affc5386313a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1293 microversion: 2.1 time: 0.135475 Aug 24 06:38:43.877116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1264/2524] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:43 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1293 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:43.893247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:43.894658 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:43.906487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:43.908820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:43.908820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:43.910340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:43.911737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:43.911939 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:44.172750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:44.186500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:44.189004 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:44.190232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-37f8805f-abf4-4072-9c7a-5051e6676828 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.303436 Aug 24 06:38:44.191386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1261/2525] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:43 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:38:44.898822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b5521d73-051e-4ced-9123-96426efa8421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:44.899640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b5521d73-051e-4ced-9123-96426efa8421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:44.906430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5521d73-051e-4ced-9123-96426efa8421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:44.906923 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5521d73-051e-4ced-9123-96426efa8421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:44.907345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5521d73-051e-4ced-9123-96426efa8421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:44.908069 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5521d73-051e-4ced-9123-96426efa8421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:44.908563 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5521d73-051e-4ced-9123-96426efa8421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:44.908978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b5521d73-051e-4ced-9123-96426efa8421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:45.128579 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b5521d73-051e-4ced-9123-96426efa8421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:45.148342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b5521d73-051e-4ced-9123-96426efa8421 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1366 microversion: 2.1 time: 0.253605 Aug 24 06:38:45.149420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1265/2526] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:44 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:45.229666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:45.230744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:45.243192 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:45.244100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:45.250142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:45.250142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:45.250142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:45.250142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:45.505563 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:45.516194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:45.517742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:45.518946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-334da001-4358-444d-b8a2-b0791e15db05 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.299773 Aug 24 06:38:45.519520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1262/2527] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:46.108101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-6c3d6702-0e1a-431a-9e64-a6f3a5a44121 req-1ccaf8e6-6827-4916-96df-f96ff12b308c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec8ec04b-3c19-4874-a301-4de2acda1c85", "tag": "fc64794e-bc96-44d1-87da-ffda0bff00eb"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:38:46.117986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-6c3d6702-0e1a-431a-9e64-a6f3a5a44121 req-1ccaf8e6-6827-4916-96df-f96ff12b308c service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:46.118455 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-6c3d6702-0e1a-431a-9e64-a6f3a5a44121 req-1ccaf8e6-6827-4916-96df-f96ff12b308c service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:46.118919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-6c3d6702-0e1a-431a-9e64-a6f3a5a44121 req-1ccaf8e6-6827-4916-96df-f96ff12b308c service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:46.121954 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=100 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:46.139086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-6c3d6702-0e1a-431a-9e64-a6f3a5a44121 req-1ccaf8e6-6827-4916-96df-f96ff12b308c service nova] Creating event network-changed:fc64794e-bc96-44d1-87da-ffda0bff00eb for instance ec8ec04b-3c19-4874-a301-4de2acda1c85 on hv-cinder-85426 Aug 24 06:38:46.145086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR oslo.messaging._drivers.impl_rabbit [req-6c3d6702-0e1a-431a-9e64-a6f3a5a44121 req-1ccaf8e6-6827-4916-96df-f96ff12b308c service nova] [6a6fc95c-c399-42da-94e1-2f53132ea67c] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:38:46.183662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f4d44a73-0db7-4313-bb9d-e65b0db65a77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:46.184861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f4d44a73-0db7-4313-bb9d-e65b0db65a77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:46.191886 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f4d44a73-0db7-4313-bb9d-e65b0db65a77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:46.192434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f4d44a73-0db7-4313-bb9d-e65b0db65a77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:46.192928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f4d44a73-0db7-4313-bb9d-e65b0db65a77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:46.193729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f4d44a73-0db7-4313-bb9d-e65b0db65a77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:46.194186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f4d44a73-0db7-4313-bb9d-e65b0db65a77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:46.194609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f4d44a73-0db7-4313-bb9d-e65b0db65a77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:46.434068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f4d44a73-0db7-4313-bb9d-e65b0db65a77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:46.443499 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f4d44a73-0db7-4313-bb9d-e65b0db65a77 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1366 microversion: 2.1 time: 0.263948 Aug 24 06:38:46.444446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1263/2528] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:46 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:46.544245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:46.545630 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:46.552337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:46.552865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:46.553308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:46.554042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:46.554501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:46.554922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:46.728611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:46.738750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:46.742763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:46.742763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8772fb01-7ebd-4055-9d84-c9d4e8071445 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.201958 Aug 24 06:38:46.742763 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1264/2529] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:46 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:38:47.152269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [req-6c3d6702-0e1a-431a-9e64-a6f3a5a44121 req-1ccaf8e6-6827-4916-96df-f96ff12b308c service nova] [6a6fc95c-c399-42da-94e1-2f53132ea67c] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 37186. Aug 24 06:38:47.157333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-6c3d6702-0e1a-431a-9e64-a6f3a5a44121 req-1ccaf8e6-6827-4916-96df-f96ff12b308c service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.128154 Aug 24 06:38:47.158076 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1266/2530] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:38:47.464967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3e2886e5-bccf-42f5-b675-ca281f50f8e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:47.465594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3e2886e5-bccf-42f5-b675-ca281f50f8e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:47.472232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e2886e5-bccf-42f5-b675-ca281f50f8e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:47.472761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e2886e5-bccf-42f5-b675-ca281f50f8e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:47.473200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e2886e5-bccf-42f5-b675-ca281f50f8e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:47.473890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e2886e5-bccf-42f5-b675-ca281f50f8e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:47.474340 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e2886e5-bccf-42f5-b675-ca281f50f8e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:47.474761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3e2886e5-bccf-42f5-b675-ca281f50f8e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:47.620604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3e2886e5-bccf-42f5-b675-ca281f50f8e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:47.631198 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3e2886e5-bccf-42f5-b675-ca281f50f8e1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1366 microversion: 2.1 time: 0.170099 Aug 24 06:38:47.631823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1265/2531] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:47 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:38:47.766522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:47.767220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:47.774620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:47.775114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:47.775550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:47.776264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:47.776746 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:47.777190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:47.948514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:47.957942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:47.959522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:47.960758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-54db3bfa-9d49-48ff-8352-300385ca0e13 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.198987 Aug 24 06:38:47.961329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1267/2532] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:47 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:38:48.652831 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f27ecebb-6280-4499-8ab2-a92ae9d92c07 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:48.653476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f27ecebb-6280-4499-8ab2-a92ae9d92c07 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:48.660836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f27ecebb-6280-4499-8ab2-a92ae9d92c07 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:48.661225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f27ecebb-6280-4499-8ab2-a92ae9d92c07 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:48.661649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f27ecebb-6280-4499-8ab2-a92ae9d92c07 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:48.662343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f27ecebb-6280-4499-8ab2-a92ae9d92c07 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:48.662788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f27ecebb-6280-4499-8ab2-a92ae9d92c07 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:48.663202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f27ecebb-6280-4499-8ab2-a92ae9d92c07 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:48.796563 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f27ecebb-6280-4499-8ab2-a92ae9d92c07 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:48.804329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f27ecebb-6280-4499-8ab2-a92ae9d92c07 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1366 microversion: 2.1 time: 0.155354 Aug 24 06:38:48.804945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1266/2533] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:48 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:49.003640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:49.004818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:49.016704 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:49.017569 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:49.018345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:49.019623 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:49.020460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:49.021270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:49.180624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:49.193403 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:49.197773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:49.197773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-514899c2-e3e9-4d56-9f43-10d4a649b706 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.200583 Aug 24 06:38:49.197773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1268/2534] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:48 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:49.826058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6953ca58-a9ef-4f9f-8576-c2ab18d9d566 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:49.826693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6953ca58-a9ef-4f9f-8576-c2ab18d9d566 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:49.829259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=66 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:49.835818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6953ca58-a9ef-4f9f-8576-c2ab18d9d566 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:49.835818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6953ca58-a9ef-4f9f-8576-c2ab18d9d566 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:49.835818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6953ca58-a9ef-4f9f-8576-c2ab18d9d566 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:49.837535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6953ca58-a9ef-4f9f-8576-c2ab18d9d566 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:49.837535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6953ca58-a9ef-4f9f-8576-c2ab18d9d566 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:49.837535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6953ca58-a9ef-4f9f-8576-c2ab18d9d566 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:49.854659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=100 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:50.005232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6953ca58-a9ef-4f9f-8576-c2ab18d9d566 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:50.014302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6953ca58-a9ef-4f9f-8576-c2ab18d9d566 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1366 microversion: 2.1 time: 0.192599 Aug 24 06:38:50.014887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1267/2535] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:49 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:50.091906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-9a5bb315-5447-4c32-ba39-30077dd7f944 req-26b1a3cc-4cb1-4522-b810-8f3d44936c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8ec04b-3c19-4874-a301-4de2acda1c85", "name": "network-vif-plugged", "status": "completed", "tag": "fc64794e-bc96-44d1-87da-ffda0bff00eb"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:38:50.102182 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-9a5bb315-5447-4c32-ba39-30077dd7f944 req-26b1a3cc-4cb1-4522-b810-8f3d44936c3b service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:50.102649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-9a5bb315-5447-4c32-ba39-30077dd7f944 req-26b1a3cc-4cb1-4522-b810-8f3d44936c3b service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:50.103064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-9a5bb315-5447-4c32-ba39-30077dd7f944 req-26b1a3cc-4cb1-4522-b810-8f3d44936c3b service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:50.114574 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-9a5bb315-5447-4c32-ba39-30077dd7f944 req-26b1a3cc-4cb1-4522-b810-8f3d44936c3b service nova] Creating event network-vif-plugged:fc64794e-bc96-44d1-87da-ffda0bff00eb for instance ec8ec04b-3c19-4874-a301-4de2acda1c85 on hv-cinder-85426 Aug 24 06:38:50.119761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-9a5bb315-5447-4c32-ba39-30077dd7f944 req-26b1a3cc-4cb1-4522-b810-8f3d44936c3b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093962 Aug 24 06:38:50.120631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1269/2536] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:38:50.219833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:50.220485 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:50.227082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:50.227562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:50.227992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:50.228708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:50.229159 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:50.229580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:50.367931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:50.377428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:50.378918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:50.380068 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-62a819bc-02d9-4fec-9e8e-4d20978552c5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.164587 Aug 24 06:38:50.380636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1268/2537] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:50 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:51.048322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-250514dc-5825-414b-a4a4-a20666d305db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:51.049787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-250514dc-5825-414b-a4a4-a20666d305db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:51.056188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-250514dc-5825-414b-a4a4-a20666d305db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:51.056837 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-250514dc-5825-414b-a4a4-a20666d305db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:51.057278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-250514dc-5825-414b-a4a4-a20666d305db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:51.058006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-250514dc-5825-414b-a4a4-a20666d305db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:51.058439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-250514dc-5825-414b-a4a4-a20666d305db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:51.058872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-250514dc-5825-414b-a4a4-a20666d305db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:51.195317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-250514dc-5825-414b-a4a4-a20666d305db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:51.203227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-250514dc-5825-414b-a4a4-a20666d305db tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1366 microversion: 2.1 time: 0.159636 Aug 24 06:38:51.203800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1270/2538] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:51 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:51.403533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:51.404179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:51.410571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:51.411041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:51.411461 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:51.412132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:51.412596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:51.413010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:51.541378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:51.551151 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:51.552604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:51.553779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fc8886c7-eb5c-4081-9e94-4d83e952b811 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.154181 Aug 24 06:38:51.554332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1269/2539] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:51 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:52.225691 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2b7f1d48-ccf5-4466-98e9-a31343bae0ad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:52.226475 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2b7f1d48-ccf5-4466-98e9-a31343bae0ad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:52.228478 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:52.229311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=12 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:52.235260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7f1d48-ccf5-4466-98e9-a31343bae0ad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:52.235747 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7f1d48-ccf5-4466-98e9-a31343bae0ad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:52.236202 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7f1d48-ccf5-4466-98e9-a31343bae0ad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:52.237018 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7f1d48-ccf5-4466-98e9-a31343bae0ad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:52.240332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7f1d48-ccf5-4466-98e9-a31343bae0ad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:52.240332 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2b7f1d48-ccf5-4466-98e9-a31343bae0ad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:52.386005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2b7f1d48-ccf5-4466-98e9-a31343bae0ad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:52.395485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2b7f1d48-ccf5-4466-98e9-a31343bae0ad tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1555 microversion: 2.1 time: 0.174151 Aug 24 06:38:52.396058 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1271/2540] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:38:52 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1555 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:52.416742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4b7f067a-c115-47b7-942d-1df88e5f6fbc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:52.417347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4b7f067a-c115-47b7-942d-1df88e5f6fbc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:52.423971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7f067a-c115-47b7-942d-1df88e5f6fbc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:52.424450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7f067a-c115-47b7-942d-1df88e5f6fbc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:52.424934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7f067a-c115-47b7-942d-1df88e5f6fbc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:52.425629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7f067a-c115-47b7-942d-1df88e5f6fbc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:52.426067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7f067a-c115-47b7-942d-1df88e5f6fbc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:52.426477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4b7f067a-c115-47b7-942d-1df88e5f6fbc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:52.517684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4b7f067a-c115-47b7-942d-1df88e5f6fbc tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104525 Aug 24 06:38:52.518346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1270/2541] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 24 06:38:52 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:38:52.579391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:52.580104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:52.586813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:52.587298 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:52.587728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:52.588432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:52.588936 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:52.589389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:52.754037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:52.765132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:52.766575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:52.767873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-439f817a-b601-4171-8dcb-88fc170bc1ca tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.193230 Aug 24 06:38:52.768441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1272/2542] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:52 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:38:53.792949 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:53.793792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:53.800118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:53.800632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:53.801065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:53.801768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:53.802210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:53.802626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:53.919789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-d042bfeb-abd8-4154-a598-5a4c848353c9 req-43d7b034-d77d-44b0-8141-6a3b40c880e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec8ec04b-3c19-4874-a301-4de2acda1c85", "tag": "fc64794e-bc96-44d1-87da-ffda0bff00eb"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:38:53.931269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-d042bfeb-abd8-4154-a598-5a4c848353c9 req-43d7b034-d77d-44b0-8141-6a3b40c880e4 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:53.931725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-d042bfeb-abd8-4154-a598-5a4c848353c9 req-43d7b034-d77d-44b0-8141-6a3b40c880e4 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:53.932152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-d042bfeb-abd8-4154-a598-5a4c848353c9 req-43d7b034-d77d-44b0-8141-6a3b40c880e4 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:53.945141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-d042bfeb-abd8-4154-a598-5a4c848353c9 req-43d7b034-d77d-44b0-8141-6a3b40c880e4 service nova] Creating event network-changed:fc64794e-bc96-44d1-87da-ffda0bff00eb for instance ec8ec04b-3c19-4874-a301-4de2acda1c85 on hv-cinder-85426 Aug 24 06:38:53.950811 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-d042bfeb-abd8-4154-a598-5a4c848353c9 req-43d7b034-d77d-44b0-8141-6a3b40c880e4 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037216 Aug 24 06:38:53.951648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1273/2543] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:38:53.974250 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:53.990492 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:53.993675 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:53.995901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dc824858-3579-4490-84b4-bbe568e1842c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.207206 Aug 24 06:38:53.996932 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1271/2544] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:53 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:55.021764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:55.022358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:55.029265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:55.029752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:55.030185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:55.030900 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:55.031342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:55.031759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:55.190082 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:55.206340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:55.209092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:55.211208 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9788f467-4401-4f4f-9a16-499ffb06e576 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.194234 Aug 24 06:38:55.212303 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1274/2545] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:55 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:56.237509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:56.238624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:56.249440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:56.250097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:56.250570 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:56.251639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:56.252292 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:56.252750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:56.388729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:56.398257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:56.399780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:56.401012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-707e1624-db4a-44e5-b6fe-1e92caea953f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.169332 Aug 24 06:38:56.401577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1272/2546] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:56 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:57.423584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:57.424632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:57.426940 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:57.431839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:57.432424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:57.432979 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:57.433730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:57.434801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:57.435330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:57.570610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:57.580217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:57.581777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:57.582925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-231f0ac1-7350-4f48-8b4e-18e0ba00b90b tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.163446 Aug 24 06:38:57.583487 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1275/2547] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:57 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:58.621469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:58.622610 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:58.629286 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:58.629771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:58.630201 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:58.630895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:58.631349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:58.631769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:58.773089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:58.782166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:58.783667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:58.784872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3f19568e-d193-461b-8cd6-37a59382db6d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.167411 Aug 24 06:38:58.785433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1273/2548] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:58 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:38:59.811064 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:38:59.811888 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:38:59.818847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:59.819329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:59.819759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:59.820463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:38:59.820947 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:38:59.821366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:38:59.970610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:59.979799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:59.981929 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:38:59.983111 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9b2c7b7f-bc79-4fbe-bc27-31e85455418a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.177580 Aug 24 06:38:59.984381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1276/2549] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:38:59 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:01.006490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:01.007163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:01.014268 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:01.014749 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:01.015176 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:01.016276 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:01.016742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:01.017158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:01.153647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:01.162624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:01.164112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:01.165311 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9c885a34-9062-4a42-8f8f-08cdf577bcce tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.162726 Aug 24 06:39:01.165865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1274/2550] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:01 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:02.192327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:02.193016 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:02.202161 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:02.202661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:02.203103 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:02.203847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:02.204311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:02.204776 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:02.352676 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:02.362271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:02.363769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:02.364981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-32accbfa-a0c3-476b-8015-5ae0eedcbb96 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.178146 Aug 24 06:39:02.365549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1277/2551] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:02 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:03.387971 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:03.388602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:03.394750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:03.395230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:03.395662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:03.396356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:03.396825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:03.397243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:03.527297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:03.536935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:03.538532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:03.539692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-77917532-ec0b-4ff7-af92-a9ff5b2099d4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156355 Aug 24 06:39:03.540246 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1275/2552] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:03 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:04.563059 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:04.564165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:04.570969 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:04.571449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:04.571872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:04.572586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:04.573029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:04.573441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:04.721441 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:04.731679 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:04.733353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:04.734546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f0da8f4a-b8ce-462f-b00f-3fc9617a3e8c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.175674 Aug 24 06:39:04.735117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1278/2553] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:04 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:05.757796 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:05.758422 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:05.765043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:05.765517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:05.765941 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:05.766623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:05.767067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:05.767477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:05.902435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:05.911300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:05.912824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:05.914021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-af842adb-7d6e-4781-b719-b4d9a343fd8a tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.160163 Aug 24 06:39:05.914572 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1276/2554] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:05 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:39:06.938377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:06.938991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:06.945633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:06.946144 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:06.946578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:06.947279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:06.947729 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:06.948146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:07.081511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:07.090521 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:07.092009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:07.093197 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1e69c9f0-f39d-434b-87e7-4a9790dd6716 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159589 Aug 24 06:39:07.093759 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1279/2555] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:06 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:08.115680 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:08.116291 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:08.122624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:08.123095 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:08.123517 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:08.124191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:08.124671 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:08.125083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:08.257858 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:08.268164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:08.269752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:08.270983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-338b77cd-3f85-4c12-8945-e1c5aba87464 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159262 Aug 24 06:39:08.271562 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1277/2556] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:08 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:09.294219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:09.294986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:09.301408 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:09.301880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:09.302307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:09.302985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:09.303428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:09.303852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:09.435657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:09.444418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:09.445991 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:09.447120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3011c6f0-8209-4281-ab24-fe04742d1afe tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157029 Aug 24 06:39:09.447880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1280/2557] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:09 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:10.470944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:10.471559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:10.478175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:10.478655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:10.479092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:10.479771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:10.480224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:10.481283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:10.608588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:10.617336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:10.618817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:10.620041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-320e300b-f841-48d5-a0bb-f3246287a787 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.152993 Aug 24 06:39:10.620614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1278/2558] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:10 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:11.643176 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:11.643741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:11.650181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:11.650650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:11.651075 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:11.651753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:11.652192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:11.652635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:11.782635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:11.791366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:11.792878 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:11.794601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-63dad8d3-05f5-48be-b315-3e4cbe640048 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.155388 Aug 24 06:39:11.795159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1281/2559] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:11 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:12.817536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:12.818129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:12.824618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:12.825089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:12.825511 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:12.826187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:12.826632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:12.827042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:12.962991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:12.972137 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:12.973669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:12.974813 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fefd7bfa-6893-4d9e-a414-982cf7199bb9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.161156 Aug 24 06:39:12.975364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1279/2560] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:12 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:13.999160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:13.999709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:14.006617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:14.007089 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:14.007516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:14.008224 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:14.008716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:14.009134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:14.149333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:14.164106 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:14.166935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:14.169764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c81ae325-0a9c-4080-8caf-453fa11fb683 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.175289 Aug 24 06:39:14.170589 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1282/2561] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:13 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:15.194073 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:15.202506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:15.202506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:15.202506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:15.202879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:15.203341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:15.203779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:15.204188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:15.331416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:15.340138 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:15.341662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:15.342791 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e43168de-1115-471a-9657-4e2102354215 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.152643 Aug 24 06:39:15.343337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1280/2562] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:15 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:16.366321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:16.366852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:16.373907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:16.374377 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:16.374809 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:16.375503 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:16.375926 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:16.376340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:16.378855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=90 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:16.506863 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:16.515642 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:16.517545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:16.518374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-107ea793-951b-4744-9832-4b6b0d185d45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156037 Aug 24 06:39:16.518952 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1283/2563] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:16 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:17.542079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:17.542714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:17.549456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:17.549934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:17.550356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:17.551042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:17.551486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:17.551896 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:17.691097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:17.699782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:17.701290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:17.702487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a4f7571d-3e2a-46e3-b430-7b10f65ca35d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.164309 Aug 24 06:39:17.703232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1281/2564] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:17 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:18.729926 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:18.729926 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:18.732990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:18.733506 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:18.733941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:18.734641 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:18.735301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:18.735742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:18.867172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:18.876516 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:18.878101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:18.879256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3433078d-a320-4486-95ee-7180acc14d9f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157781 Aug 24 06:39:18.879821 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1284/2565] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:18 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:39:19.902871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:19.903561 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:19.910454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:19.910995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:19.911428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:19.912118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:19.912626 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:19.913043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:20.046294 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:20.055160 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:20.056681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:20.057839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f191639e-89c0-412d-91be-4d0d37a5deb5 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158922 Aug 24 06:39:20.059140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1282/2566] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:19 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:21.082288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:21.082849 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:21.089388 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:21.090369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:21.090799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:21.091490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:21.091941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:21.092360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:21.223127 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:21.233225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:21.236989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:21.236989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3ac2b7e0-6c29-4113-a255-67fdc7379019 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157628 Aug 24 06:39:21.236989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1285/2567] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:21 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:22.258815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:22.259435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:22.261845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=32 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:22.266579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:22.267054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:22.267484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:22.268163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:22.268640 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:22.271803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:22.271803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=92 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:22.399901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:22.408722 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:22.410223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:22.411359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2ad0ad8b-e029-4bcd-9710-979434523291 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.156497 Aug 24 06:39:22.411909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1283/2568] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:22 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:23.434347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:23.435214 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:23.441853 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:23.442340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:23.442790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:23.443485 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:23.443930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:23.444353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:23.570726 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:23.579753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:23.581306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:23.582447 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3799b249-3050-46d3-a94c-61ca261e2a60 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.152127 Aug 24 06:39:23.583010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1286/2569] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:23 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:24.605852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:24.606493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:24.612895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:24.613376 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:24.613805 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:24.614486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:24.614934 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:24.615354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:24.743666 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:24.752727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:24.754217 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:24.755356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b45ae3e1-a177-45cd-9bbd-b8d6e4c854bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.153897 Aug 24 06:39:24.755909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1284/2570] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:24 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:25.778708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:25.779322 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:25.785946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:25.786421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:25.786852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:25.787617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:25.787992 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:25.788415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:25.919877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:25.928750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:25.930253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:25.931406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d920e536-2d85-486e-8dc2-b41f2c962852 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157168 Aug 24 06:39:25.931958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1287/2571] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:25 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:26.954482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:26.955081 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:26.961679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:26.962097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:26.962525 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:26.963205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:26.963652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:26.964070 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:27.090497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:27.099205 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:27.100748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:27.101904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-5d0b13db-cf75-4bbe-a946-2ec9606a363e tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.151395 Aug 24 06:39:27.102461 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1285/2572] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:26 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:28.125522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:28.126093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:28.128413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=26 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:28.133160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:28.133640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:28.134062 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:28.134745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:28.135183 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:28.135596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:28.267003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:28.275600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:28.277697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:28.278832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f6b9b0dd-fab3-4bab-a257-80c9e7daffcd tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.157365 Aug 24 06:39:28.279388 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1288/2573] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:28 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:29.301881 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:29.302482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:29.309938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:29.310415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:29.310839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:29.311547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:29.311981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:29.312393 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:29.446212 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:29.455332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:29.456855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:29.457996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-42adfa1a-6d10-4c19-b882-cceccf796f45 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.160075 Aug 24 06:39:29.458540 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1286/2574] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:29 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:30.153960 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b4514501-aa3b-4fb1-ae63-46b288c41720 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:30.154533 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b4514501-aa3b-4fb1-ae63-46b288c41720 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:30.160919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4514501-aa3b-4fb1-ae63-46b288c41720 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:30.161401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4514501-aa3b-4fb1-ae63-46b288c41720 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:30.161832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4514501-aa3b-4fb1-ae63-46b288c41720 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:30.162520 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4514501-aa3b-4fb1-ae63-46b288c41720 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:30.162966 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4514501-aa3b-4fb1-ae63-46b288c41720 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:30.163389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b4514501-aa3b-4fb1-ae63-46b288c41720 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:30.186974 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b4514501-aa3b-4fb1-ae63-46b288c41720 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85/ips" status: 200 len: 148 microversion: 2.1 time: 0.036881 Aug 24 06:39:30.188546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1289/2575] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 24 06:39:30 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:39:30.481592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:30.482178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:30.488595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:30.489074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:30.489504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:30.490183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:30.490633 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:30.491051 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:30.618335 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:30.627799 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:30.629336 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:30.630487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-63e6faae-35d1-4844-bfa6-a5bbb3529611 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.153369 Aug 24 06:39:30.631046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1287/2576] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:30 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:31.653637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:31.654213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:31.660708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:31.661190 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:31.661626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:31.662319 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:31.662769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:31.663194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:31.804137 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:31.813932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:31.815432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:31.816617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-60a65f6c-4201-4940-a117-bb3b67bf88bc tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.167079 Aug 24 06:39:31.817181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1290/2577] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:31 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:32.841334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:32.841936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:32.848018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:32.848514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:32.848960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:32.849639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:32.850086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:32.850501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:32.984229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:32.992935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:32.994438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:32.996117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-89915f52-01e3-4a13-9a9f-572ee1cdd8e7 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.159506 Aug 24 06:39:32.996681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1288/2578] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:32 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:34.019798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:34.020363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:34.027343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:34.027873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:34.028304 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:34.029027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:34.029476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:34.029897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:34.162061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:34.170922 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:34.172509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:34.173666 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d5936664-d8bd-42bc-8715-3720fea7351c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 200 len: 1804 microversion: 2.20 time: 0.158006 Aug 24 06:39:34.174229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1291/2579] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:34 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 1804 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:34.205048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-558d2a7d-27ed-49f7-ab27-99066b28ad17 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '.version_select at 0x7fcddc150820>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:34.283964 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-558d2a7d-27ed-49f7-ab27-99066b28ad17 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576137281" status: 204 len: 0 microversion: 2.20 time: 0.082634 Aug 24 06:39:34.284478 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1289/2580] 10.222.0.62 () {60 vars in 1262 bytes} [Wed Aug 24 06:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576137281 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 06:39:35.241820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-46e5fdc1-7132-4999-b71f-a9035b9607c8 req-ca0dce83-487f-492d-8d67-1f6f385e1172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9", "tag": "6fa5961a-6a56-4ea0-88f8-85ee1d70c184"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:39:35.251521 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-46e5fdc1-7132-4999-b71f-a9035b9607c8 req-ca0dce83-487f-492d-8d67-1f6f385e1172 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:35.251994 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-46e5fdc1-7132-4999-b71f-a9035b9607c8 req-ca0dce83-487f-492d-8d67-1f6f385e1172 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:35.252362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-46e5fdc1-7132-4999-b71f-a9035b9607c8 req-ca0dce83-487f-492d-8d67-1f6f385e1172 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:35.265949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-46e5fdc1-7132-4999-b71f-a9035b9607c8 req-ca0dce83-487f-492d-8d67-1f6f385e1172 service nova] Creating event network-changed:6fa5961a-6a56-4ea0-88f8-85ee1d70c184 for instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 on hv-cinder-85426 Aug 24 06:39:35.272649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-46e5fdc1-7132-4999-b71f-a9035b9607c8 req-ca0dce83-487f-492d-8d67-1f6f385e1172 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034955 Aug 24 06:39:35.273484 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1292/2581] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:39:35.504707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b4a89799-eb1a-4df2-bafe-8c445efd6bcf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Action: 'create', calling method: .version_select at 0x7fcde0b31dc0>, body: {"keypair": {"name": "tempest-keypair-1270955512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGlOknVvE/Oww1vgivDXqyCIGekzO9CG4g8egAxKCJ/NgitN0U4UXGSt5Hs6nZER5M7EeR7pvCl2DXPlM7qGbXc6t659YYYpW+s9Ack9ypTXexY17ljqmeQvS8rfdGsyQ=="}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:39:35.523958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-b4a89799-eb1a-4df2-bafe-8c445efd6bcf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Getting quotas for project f4e8d9878aff47cea1bd895f618badb8. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:39:35.529371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-b4a89799-eb1a-4df2-bafe-8c445efd6bcf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Getting quotas for user 5059723f417445fa934ecfe3e50d0197 and project f4e8d9878aff47cea1bd895f618badb8. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:39:35.662142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b4a89799-eb1a-4df2-bafe-8c445efd6bcf tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.161572 Aug 24 06:39:35.662895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1290/2582] 10.222.0.62 () {62 vars in 1200 bytes} [Wed Aug 24 06:39:35 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 163 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:37.841129 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-249115878", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84581a9b-8bba-47b1-a8fd-ca40693e6cc8"}], "security_groups": [{"name": "tempest-securitygroup--1750390704"}], "key_name": "tempest-keypair-1270955512", "user_data": "}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:39:37.949505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] validate_networks() for [('84581a9b-8bba-47b1-a8fd-ca40693e6cc8', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:39:38.352695 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:39:38.353130 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:39:38.353604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:39:38.354014 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:39:38.354490 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:39:38.363784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:38.364280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:38.364728 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:38.365457 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:38.365907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:38.366336 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:38.383519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Getting quotas for project f4e8d9878aff47cea1bd895f618badb8. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:39:38.388477 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Getting quotas for user 5059723f417445fa934ecfe3e50d0197 and project f4e8d9878aff47cea1bd895f618badb8. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:39:38.399897 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:39:38.402427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:39:38.583345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0d106f2e-013b-44f7-8c45-2cab474bb932 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.748085 Aug 24 06:39:38.584199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1293/2583] 10.222.0.62 () {62 vars in 1188 bytes} [Wed Aug 24 06:39:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 06:39:38.595270 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-14a286d3-50c1-41de-9668-e1b85cad8238 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:38.595861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-14a286d3-50c1-41de-9668-e1b85cad8238 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:38.657743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-14a286d3-50c1-41de-9668-e1b85cad8238 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:38.665588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-14a286d3-50c1-41de-9668-e1b85cad8238 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:38.667601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-14a286d3-50c1-41de-9668-e1b85cad8238 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:38.668764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-14a286d3-50c1-41de-9668-e1b85cad8238 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1281 microversion: 2.20 time: 0.077840 Aug 24 06:39:38.671631 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1291/2584] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:38 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:39.694054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:39.694637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:39.701131 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:39.701607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:39.702040 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:39.702735 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:39.703185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:39.703600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:39.766599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:39.775149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:39.777237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:39.781839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6f29cc51-9a99-4b60-bd2e-68d4e5fbb8a4 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1277 microversion: 2.20 time: 0.090694 Aug 24 06:39:39.781839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1294/2585] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:39 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:40.801334 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:40.801954 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:40.809287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:40.810860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:40.811297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:40.812055 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:40.812595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:40.812957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:40.895522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:40.905118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:40.906695 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:40.907859 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ee9788c9-d62b-470e-94b9-d721b8242857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1339 microversion: 2.20 time: 0.110858 Aug 24 06:39:40.908532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1292/2586] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:40 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1339 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:41.930548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:41.931180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:41.938938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:41.939410 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:41.939838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:41.940590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:41.941032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:41.941450 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:41.969595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-8dba792b-e2f2-47cc-b621-07c75920f2bd req-83203fe6-f292-4a05-a0e3-d7334862cab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebadb55-a641-4674-8ab9-c6df06704b25", "tag": "dd8c18c8-3caf-4abf-a93e-150a2db505e6"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:39:41.981115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-8dba792b-e2f2-47cc-b621-07c75920f2bd req-83203fe6-f292-4a05-a0e3-d7334862cab8 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:41.981583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-8dba792b-e2f2-47cc-b621-07c75920f2bd req-83203fe6-f292-4a05-a0e3-d7334862cab8 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:41.982227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-8dba792b-e2f2-47cc-b621-07c75920f2bd req-83203fe6-f292-4a05-a0e3-d7334862cab8 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:41.993733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-8dba792b-e2f2-47cc-b621-07c75920f2bd req-83203fe6-f292-4a05-a0e3-d7334862cab8 service nova] Creating event network-changed:dd8c18c8-3caf-4abf-a93e-150a2db505e6 for instance 3ebadb55-a641-4674-8ab9-c6df06704b25 on hv-cinder-85426 Aug 24 06:39:42.001040 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-8dba792b-e2f2-47cc-b621-07c75920f2bd req-83203fe6-f292-4a05-a0e3-d7334862cab8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034529 Aug 24 06:39:42.001931 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1293/2587] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:39:42.086106 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:42.095342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:42.096351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:42.097476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-24a21d82-49bb-46c5-a392-76ead6c5c3e6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1407 microversion: 2.20 time: 0.170899 Aug 24 06:39:42.098042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1295/2588] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:41 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:43.121681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:43.122367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:43.128638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:43.129118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:43.129550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:43.130228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:43.130677 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:43.131094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:43.262583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:43.270947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:43.272360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:43.273476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-64240188-7b7b-4d84-afc6-2f7d579b041c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1407 microversion: 2.20 time: 0.157293 Aug 24 06:39:43.274025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1294/2589] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:43 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:44.296845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:44.297488 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:44.304266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:44.304786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:44.305220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:44.305916 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:44.306367 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:44.306786 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:44.438765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:44.449351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:44.451569 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:44.452805 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a7679892-bc89-4041-9295-dbc8b48cd44f tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1407 microversion: 2.20 time: 0.159924 Aug 24 06:39:44.453672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1296/2590] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:44 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:45.474940 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:45.475568 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:45.482455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:45.482927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:45.483560 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:45.484043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:45.484488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:45.484924 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:45.619557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:45.628419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:45.629994 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:45.631077 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ec4bc6e6-0feb-4e02-954a-7a073fb179e1 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1407 microversion: 2.20 time: 0.160019 Aug 24 06:39:45.631656 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1295/2591] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:45 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:46.168324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-4e1c81d9-d99a-4e65-b282-03c95579e00a req-4dd6378c-5fa8-4d18-8a98-ffe2e4ba4c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebadb55-a641-4674-8ab9-c6df06704b25", "name": "network-vif-plugged", "status": "completed", "tag": "dd8c18c8-3caf-4abf-a93e-150a2db505e6"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:39:46.178345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-4e1c81d9-d99a-4e65-b282-03c95579e00a req-4dd6378c-5fa8-4d18-8a98-ffe2e4ba4c50 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:46.178887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-4e1c81d9-d99a-4e65-b282-03c95579e00a req-4dd6378c-5fa8-4d18-8a98-ffe2e4ba4c50 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:46.179341 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-4e1c81d9-d99a-4e65-b282-03c95579e00a req-4dd6378c-5fa8-4d18-8a98-ffe2e4ba4c50 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:46.191486 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-4e1c81d9-d99a-4e65-b282-03c95579e00a req-4dd6378c-5fa8-4d18-8a98-ffe2e4ba4c50 service nova] Creating event network-vif-plugged:dd8c18c8-3caf-4abf-a93e-150a2db505e6 for instance 3ebadb55-a641-4674-8ab9-c6df06704b25 on hv-cinder-85426 Aug 24 06:39:46.199501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-4e1c81d9-d99a-4e65-b282-03c95579e00a req-4dd6378c-5fa8-4d18-8a98-ffe2e4ba4c50 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032588 Aug 24 06:39:46.199501 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1297/2592] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:39:46.653902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:46.654514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:46.660890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:46.661362 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:46.661785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:46.662463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:46.662901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:46.663310 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:46.797991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:46.806085 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:46.807615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:46.808727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bd7a91fe-345e-4f77-83c4-a292e79b5823 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1407 microversion: 2.20 time: 0.159230 Aug 24 06:39:46.809277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1296/2593] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:46 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:47.832361 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:47.833100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:47.839899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:47.840373 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:47.840848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:47.841541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:47.841990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:47.842411 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:47.845065 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=76 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:47.979356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:47.988514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:47.990219 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:39:47.991374 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-70175d78-c437-49f1-bfd1-c2bce4ea501c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1599 microversion: 2.20 time: 0.163834 Aug 24 06:39:47.991937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1298/2594] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:39:47 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 06:39:48.014497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fe88f531-f9fa-431c-b5ea-25e5e191141d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:39:48.015054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fe88f531-f9fa-431c-b5ea-25e5e191141d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:39:48.021830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe88f531-f9fa-431c-b5ea-25e5e191141d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:48.022311 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe88f531-f9fa-431c-b5ea-25e5e191141d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:48.022743 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe88f531-f9fa-431c-b5ea-25e5e191141d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:48.023702 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe88f531-f9fa-431c-b5ea-25e5e191141d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:48.024155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe88f531-f9fa-431c-b5ea-25e5e191141d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:48.024605 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fe88f531-f9fa-431c-b5ea-25e5e191141d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:48.103653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fe88f531-f9fa-431c-b5ea-25e5e191141d tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093676 Aug 24 06:39:48.104271 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1297/2595] 10.222.0.62 () {60 vars in 1316 bytes} [Wed Aug 24 06:39:48 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:39:49.053130 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-4f1d974a-754d-4217-8288-db164b9376bf req-9dc9cece-1c4f-4aed-b610-24fe0dd543e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebadb55-a641-4674-8ab9-c6df06704b25", "tag": "dd8c18c8-3caf-4abf-a93e-150a2db505e6"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:39:49.061087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:49.061895 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=6 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:49.066529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-4f1d974a-754d-4217-8288-db164b9376bf req-9dc9cece-1c4f-4aed-b610-24fe0dd543e5 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:39:49.067042 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-4f1d974a-754d-4217-8288-db164b9376bf req-9dc9cece-1c4f-4aed-b610-24fe0dd543e5 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:39:49.067466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-4f1d974a-754d-4217-8288-db164b9376bf req-9dc9cece-1c4f-4aed-b610-24fe0dd543e5 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:39:49.085625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-4f1d974a-754d-4217-8288-db164b9376bf req-9dc9cece-1c4f-4aed-b610-24fe0dd543e5 service nova] Creating event network-changed:dd8c18c8-3caf-4abf-a93e-150a2db505e6 for instance 3ebadb55-a641-4674-8ab9-c6df06704b25 on hv-cinder-85426 Aug 24 06:39:49.085625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-4f1d974a-754d-4217-8288-db164b9376bf req-9dc9cece-1c4f-4aed-b610-24fe0dd543e5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035845 Aug 24 06:39:49.086026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1299/2596] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:40:05.850861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:40:05.851628 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:40:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:40:25.240849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=6 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:25.242494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:25.243128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=65 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:25.247071 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-23046620-6a5e-4909-adbd-fe048efa60fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:40:25.248935 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-23046620-6a5e-4909-adbd-fe048efa60fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:40:25.253439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23046620-6a5e-4909-adbd-fe048efa60fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:25.253927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23046620-6a5e-4909-adbd-fe048efa60fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:25.254357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23046620-6a5e-4909-adbd-fe048efa60fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:25.255043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23046620-6a5e-4909-adbd-fe048efa60fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:40:25.255490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23046620-6a5e-4909-adbd-fe048efa60fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:40:25.255909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23046620-6a5e-4909-adbd-fe048efa60fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:40:25.282281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-23046620-6a5e-4909-adbd-fe048efa60fa tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25/ips" status: 200 len: 151 microversion: 2.20 time: 0.042122 Aug 24 06:40:25.282855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1298/2597] 10.222.0.62 () {60 vars in 1289 bytes} [Wed Aug 24 06:40:25 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 06:41:35.593654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09c26f46-ce31-4745-8a66-229ed6a232e3] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:41:35.594160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:35.594840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=7 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:35.626661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:35.626661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:35.626661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.626661 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.627150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.627150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.627150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.627150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] HTTP exception thrown: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Request method failure captured: Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: DELETE /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 HTTP/1.1 Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcI_I9huvEuUVzRrBxRPdTG5qqUGpAdOvZQwpwndKekqpzx6nxYwOufm6cj1diqelUoat7BmXfCuCCyfQbzUbJH2Ne0wS3vk3thmsR_zFKt8mIthbCrQxYL6szHbAdh8cneu1yTM3W9rwToG1VfOG6HV0xiq0AWyQLRFhlAE9aP36Wc Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:41:35.627576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ff194aa4a2d744caaa09e0ceee54b1d2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 25908fb02f7f46f5b9e483811302a67e Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:41:35.629722 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '5950cfdd-41b3-4842-81ab-e6507515a4a2'} Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:41:35.630933 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:41:35.632965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:41:35.634710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Returning 404 to user: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:41:35.634710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-65e28b7a-4ca7-42fa-bac4-3d02a2a7a170 tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "DELETE /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 404 len: 111 microversion: 2.1 time: 0.035923 Aug 24 06:41:35.634710 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1300/2598] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:41:35 2022] DELETE /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:41:35.637069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:41:35.637701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] [instance: 5950cfdd-41b3-4842-81ab-e6507515a4a2] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:41:35.645126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.645614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.646059 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.646750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:35.647200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:35.647623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:35.662288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] HTTP exception thrown: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Request method failure captured: Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 HTTP/1.1 Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcI_I9huvEuUVzRrBxRPdTG5qqUGpAdOvZQwpwndKekqpzx6nxYwOufm6cj1diqelUoat7BmXfCuCCyfQbzUbJH2Ne0wS3vk3thmsR_zFKt8mIthbCrQxYL6szHbAdh8cneu1yTM3W9rwToG1VfOG6HV0xiq0AWyQLRFhlAE9aP36Wc Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:41:35.669912 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/ff194aa4a2d744caaa09e0ceee54b1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_ff194aa4a2d744caaa09e0ceee54b1d2", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: ff194aa4a2d744caaa09e0ceee54b1d2 Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1002448169 Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 25908fb02f7f46f5b9e483811302a67e Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-AttachVolumeTestJSON-1002448169-project Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:41:35.671782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '5950cfdd-41b3-4842-81ab-e6507515a4a2'} Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:41:35.673718 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. Aug 24 06:41:35.675425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:41:35.677735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] Returning 404 to user: Instance 5950cfdd-41b3-4842-81ab-e6507515a4a2 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:41:35.677735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0415ddae-f172-4cdc-99fb-ab1deee82bbf tempest-AttachVolumeTestJSON-1002448169 tempest-AttachVolumeTestJSON-1002448169-project] 10.222.0.62 "GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2" status: 404 len: 111 microversion: 2.1 time: 0.033170 Aug 24 06:41:35.677735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1299/2599] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:41:35 2022] GET /compute/v2.1/servers/5950cfdd-41b3-4842-81ab-e6507515a4a2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:41:36.941894 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-f28fcbee-6374-4725-a4d0-54e0c18346b2 req-b80656de-834f-4444-a222-9a551cc21362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9", "name": "network-vif-deleted", "tag": "6fa5961a-6a56-4ea0-88f8-85ee1d70c184"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:41:36.954555 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-f28fcbee-6374-4725-a4d0-54e0c18346b2 req-b80656de-834f-4444-a222-9a551cc21362 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:41:36.957690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-f28fcbee-6374-4725-a4d0-54e0c18346b2 req-b80656de-834f-4444-a222-9a551cc21362 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:41:36.957690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-f28fcbee-6374-4725-a4d0-54e0c18346b2 req-b80656de-834f-4444-a222-9a551cc21362 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:41:36.968201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-f28fcbee-6374-4725-a4d0-54e0c18346b2 req-b80656de-834f-4444-a222-9a551cc21362 service nova] Creating event network-vif-deleted:6fa5961a-6a56-4ea0-88f8-85ee1d70c184 for instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 on hv-cinder-85426 Aug 24 06:41:36.971907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] [09c26f46-ce31-4745-8a66-229ed6a232e3] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 37458. Aug 24 06:41:36.973558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-f28fcbee-6374-4725-a4d0-54e0c18346b2 req-b80656de-834f-4444-a222-9a551cc21362 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036196 Aug 24 06:41:36.974335 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1301/2600] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:41:39.925347 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:41:39.926226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:41:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:41:45.246205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:41:45.246891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:41:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:43:25.858962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:43:25.859593 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:43:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:43:37.640792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef1e0970-9ea8-4035-8bd7-5d475c4a624f] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 06:43:37.647890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=6 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:43:37.647890 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-70bf9c48-9cc0-4707-9f80-ed1d75426a01 req-e3fa0942-776a-4a39-8516-c77aad6744fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8e12ed7-0b6e-4995-a3c0-221ce6c18041", "name": "network-vif-deleted", "tag": "19c5b9e4-2438-4dd5-ba21-d02e604b373c"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:43:37.655969 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-70bf9c48-9cc0-4707-9f80-ed1d75426a01 req-e3fa0942-776a-4a39-8516-c77aad6744fd service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:43:37.656442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-70bf9c48-9cc0-4707-9f80-ed1d75426a01 req-e3fa0942-776a-4a39-8516-c77aad6744fd service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:43:37.656897 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-70bf9c48-9cc0-4707-9f80-ed1d75426a01 req-e3fa0942-776a-4a39-8516-c77aad6744fd service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:43:37.667761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-70bf9c48-9cc0-4707-9f80-ed1d75426a01 req-e3fa0942-776a-4a39-8516-c77aad6744fd service nova] Creating event network-vif-deleted:19c5b9e4-2438-4dd5-ba21-d02e604b373c for instance d8e12ed7-0b6e-4995-a3c0-221ce6c18041 on hv-cinder-85426 Aug 24 06:43:37.672888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-70bf9c48-9cc0-4707-9f80-ed1d75426a01 req-e3fa0942-776a-4a39-8516-c77aad6744fd service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033731 Aug 24 06:43:37.682100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1300/2601] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:43:56.311027 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:43:56.311638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:43:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:44:52.261612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:44:52.262229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:44:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:44:59.938633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:44:59.939173 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:44:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:45:05.255345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:45:05.256032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:45:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:46:42.982165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=4 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:46:42.983977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09c26f46-ce31-4745-8a66-229ed6a232e3] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 06:46:42.989023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3d1f9c4f-5d73-444a-ac4a-e6313543fb8b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:42.989604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3d1f9c4f-5d73-444a-ac4a-e6313543fb8b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:42.996600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d1f9c4f-5d73-444a-ac4a-e6313543fb8b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:42.997078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d1f9c4f-5d73-444a-ac4a-e6313543fb8b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:42.997504 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d1f9c4f-5d73-444a-ac4a-e6313543fb8b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:42.998184 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d1f9c4f-5d73-444a-ac4a-e6313543fb8b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:42.998626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d1f9c4f-5d73-444a-ac4a-e6313543fb8b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:42.999046 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3d1f9c4f-5d73-444a-ac4a-e6313543fb8b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:43.025734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3d1f9c4f-5d73-444a-ac4a-e6313543fb8b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:46:43.067210 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-170e5a20-f5c3-4342-8e55-216f16ddca6b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:43.067830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-170e5a20-f5c3-4342-8e55-216f16ddca6b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:43.076048 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-170e5a20-f5c3-4342-8e55-216f16ddca6b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:43.076479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-170e5a20-f5c3-4342-8e55-216f16ddca6b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:43.076980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-170e5a20-f5c3-4342-8e55-216f16ddca6b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:43.077670 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-170e5a20-f5c3-4342-8e55-216f16ddca6b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:43.078120 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-170e5a20-f5c3-4342-8e55-216f16ddca6b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:43.078539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-170e5a20-f5c3-4342-8e55-216f16ddca6b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:43.083900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef1e0970-9ea8-4035-8bd7-5d475c4a624f] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 37678. Aug 24 06:46:43.103941 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-170e5a20-f5c3-4342-8e55-216f16ddca6b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Going to try to terminate instance {{(pid=121150) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:46:43.404919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3d1f9c4f-5d73-444a-ac4a-e6313543fb8b tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "DELETE /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 204 len: 0 microversion: 2.1 time: 0.423686 Aug 24 06:46:43.405503 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1302/2602] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:46:42 2022] DELETE /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:46:43.415918 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-78aecf78-14ff-4da7-adc4-40d767ecd2ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:43.416629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-78aecf78-14ff-4da7-adc4-40d767ecd2ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:43.423269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78aecf78-14ff-4da7-adc4-40d767ecd2ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:43.423743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78aecf78-14ff-4da7-adc4-40d767ecd2ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:43.424171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78aecf78-14ff-4da7-adc4-40d767ecd2ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:43.424892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78aecf78-14ff-4da7-adc4-40d767ecd2ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:43.425422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78aecf78-14ff-4da7-adc4-40d767ecd2ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:43.425837 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-78aecf78-14ff-4da7-adc4-40d767ecd2ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:43.440258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-170e5a20-f5c3-4342-8e55-216f16ddca6b tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 204 len: 0 microversion: 2.1 time: 0.382546 Aug 24 06:46:43.441603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1301/2603] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:46:43 2022] DELETE /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:46:43.450602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a2f708cb-4479-483e-aa6a-7f27b94a6afb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:43.451297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a2f708cb-4479-483e-aa6a-7f27b94a6afb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:43.457223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a2f708cb-4479-483e-aa6a-7f27b94a6afb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:43.457703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a2f708cb-4479-483e-aa6a-7f27b94a6afb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:43.458346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a2f708cb-4479-483e-aa6a-7f27b94a6afb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:43.458818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a2f708cb-4479-483e-aa6a-7f27b94a6afb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:43.459273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a2f708cb-4479-483e-aa6a-7f27b94a6afb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:43.459785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a2f708cb-4479-483e-aa6a-7f27b94a6afb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:43.740435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-78aecf78-14ff-4da7-adc4-40d767ecd2ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:43.749326 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-78aecf78-14ff-4da7-adc4-40d767ecd2ac tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1508 microversion: 2.1 time: 0.337691 Aug 24 06:46:43.749723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a2f708cb-4479-483e-aa6a-7f27b94a6afb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:43.750061 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1303/2604] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:43 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1508 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:43.757624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a2f708cb-4479-483e-aa6a-7f27b94a6afb tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1679 microversion: 2.1 time: 0.311258 Aug 24 06:46:43.758202 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1302/2605] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:43 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1679 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:44.631808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] [09c26f46-ce31-4745-8a66-229ed6a232e3] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 37696. Aug 24 06:46:44.687337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-4723c723-f1ed-4065-9304-4e7385ec7e67 req-d6713d3b-0d71-4b4c-8b99-40723eac909d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6752dc86-45bf-4d60-b06a-55a478d89775", "name": "network-vif-deleted", "tag": "56b6b3bc-bbb2-4822-947b-68f85df40e56"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:44.696937 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-4723c723-f1ed-4065-9304-4e7385ec7e67 req-d6713d3b-0d71-4b4c-8b99-40723eac909d service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:44.697413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-4723c723-f1ed-4065-9304-4e7385ec7e67 req-d6713d3b-0d71-4b4c-8b99-40723eac909d service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:44.697836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-4723c723-f1ed-4065-9304-4e7385ec7e67 req-d6713d3b-0d71-4b4c-8b99-40723eac909d service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:44.710554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-4723c723-f1ed-4065-9304-4e7385ec7e67 req-d6713d3b-0d71-4b4c-8b99-40723eac909d service nova] Creating event network-vif-deleted:56b6b3bc-bbb2-4822-947b-68f85df40e56 for instance 6752dc86-45bf-4d60-b06a-55a478d89775 on hv-cinder-85426 Aug 24 06:46:44.715736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-4723c723-f1ed-4065-9304-4e7385ec7e67 req-d6713d3b-0d71-4b4c-8b99-40723eac909d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099534 Aug 24 06:46:44.716342 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1304/2606] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:44.770922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9fddaf69-90ac-4592-a433-8751126a6a7d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:44.771506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9fddaf69-90ac-4592-a433-8751126a6a7d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:44.778440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fddaf69-90ac-4592-a433-8751126a6a7d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:44.778942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fddaf69-90ac-4592-a433-8751126a6a7d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:44.779338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fddaf69-90ac-4592-a433-8751126a6a7d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:44.780023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fddaf69-90ac-4592-a433-8751126a6a7d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:44.780464 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fddaf69-90ac-4592-a433-8751126a6a7d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:44.780624 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b8ecb138-146e-4297-91cf-680cc804c066 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:44.780909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9fddaf69-90ac-4592-a433-8751126a6a7d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:44.781181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b8ecb138-146e-4297-91cf-680cc804c066 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:44.787794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ecb138-146e-4297-91cf-680cc804c066 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:44.788264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ecb138-146e-4297-91cf-680cc804c066 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:44.788723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ecb138-146e-4297-91cf-680cc804c066 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:44.789517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ecb138-146e-4297-91cf-680cc804c066 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:44.789957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ecb138-146e-4297-91cf-680cc804c066 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:44.790393 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b8ecb138-146e-4297-91cf-680cc804c066 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:44.861309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b8ecb138-146e-4297-91cf-680cc804c066 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:44.888767 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9fddaf69-90ac-4592-a433-8751126a6a7d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:44.889166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b8ecb138-146e-4297-91cf-680cc804c066 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1612 microversion: 2.1 time: 0.104831 Aug 24 06:46:44.889166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1305/2607] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:44 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1612 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:44.889574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9fddaf69-90ac-4592-a433-8751126a6a7d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 200 len: 1466 microversion: 2.1 time: 0.122566 Aug 24 06:46:44.891691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1303/2608] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:44 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 1466 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:45.458384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-8bd52f71-6009-4b73-9f55-4f4dfb837167 req-89eb23ef-0ff2-488d-9b82-48aa15e63df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec8ec04b-3c19-4874-a301-4de2acda1c85", "name": "network-vif-deleted", "tag": "fc64794e-bc96-44d1-87da-ffda0bff00eb"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:45.467581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-8bd52f71-6009-4b73-9f55-4f4dfb837167 req-89eb23ef-0ff2-488d-9b82-48aa15e63df8 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.470763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-8bd52f71-6009-4b73-9f55-4f4dfb837167 req-89eb23ef-0ff2-488d-9b82-48aa15e63df8 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.470763 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-8bd52f71-6009-4b73-9f55-4f4dfb837167 req-89eb23ef-0ff2-488d-9b82-48aa15e63df8 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.479652 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-8bd52f71-6009-4b73-9f55-4f4dfb837167 req-89eb23ef-0ff2-488d-9b82-48aa15e63df8 service nova] Creating event network-vif-deleted:fc64794e-bc96-44d1-87da-ffda0bff00eb for instance ec8ec04b-3c19-4874-a301-4de2acda1c85 on hv-cinder-85426 Aug 24 06:46:45.484650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-8bd52f71-6009-4b73-9f55-4f4dfb837167 req-89eb23ef-0ff2-488d-9b82-48aa15e63df8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084471 Aug 24 06:46:45.485276 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1306/2609] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:46:45.867161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:46:45.867778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:46:45.915649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:45.915649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:45.915649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.915649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.916305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.916422 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:45.917440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.917440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.917657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: 6752dc86-45bf-4d60-b06a-55a478d89775] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:45.917764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.920353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.921008 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.921443 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.922375 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.922913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.923345 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.938545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] HTTP exception thrown: Instance 6752dc86-45bf-4d60-b06a-55a478d89775 could not be found. Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Request method failure captured: Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 HTTP/1.1 Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcKrWIVODpGKYwuAjadGNhY4NWvtqpqnx0Eqk2Jv476klt3FCknTTgC7Lp6zVuEV3Qss59XKRLhUuiBtlrv4Rdl7sk5an2zO6A3FeeJFSXBQEGT4B0QnxI4EIo4TLtLFqknF7HyQ1uF165HUtypVjOsoC_avY3WmBTaXarybT-MPPC4 Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: c467d980c962456c9fa0e28364efd2a3 Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714652183 Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:46:45.940714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c467d980c962456c9fa0e28364efd2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c467d980c962456c9fa0e28364efd2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c467d980c962456c9fa0e28364efd2a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c467d980c962456c9fa0e28364efd2a3", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714652183 Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: c467d980c962456c9fa0e28364efd2a3 Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714652183 Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-ServerRescueNegativeTestJSON-714652183-project Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 069dc6f771a74dd4ab22d9d5e68e3cc9 Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714652183-project Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 6752dc86-45bf-4d60-b06a-55a478d89775 could not be found. Aug 24 06:46:45.942603 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '6752dc86-45bf-4d60-b06a-55a478d89775'} Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6752dc86-45bf-4d60-b06a-55a478d89775 could not be found. Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:46:45.943681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6752dc86-45bf-4d60-b06a-55a478d89775 could not be found. Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6752dc86-45bf-4d60-b06a-55a478d89775 could not be found. Aug 24 06:46:45.950907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:46:45.952382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Returning 404 to user: Instance 6752dc86-45bf-4d60-b06a-55a478d89775 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:46:45.952382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-98dcc5d8-b535-41ab-9db0-26c531a73749 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775" status: 404 len: 111 microversion: 2.1 time: 0.038755 Aug 24 06:46:45.952382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1307/2610] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:45 2022] GET /compute/v2.1/servers/6752dc86-45bf-4d60-b06a-55a478d89775 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:46:45.952707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.952707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.952707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.952707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lazy-loading 'fault' on Instance uuid ec8ec04b-3c19-4874-a301-4de2acda1c85 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:46:45.958209 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-704aeeef-5df9-4e70-a301-171cfa30cb92 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:45.958932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-704aeeef-5df9-4e70-a301-171cfa30cb92 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:45.966264 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-704aeeef-5df9-4e70-a301-171cfa30cb92 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.966996 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-704aeeef-5df9-4e70-a301-171cfa30cb92 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.967438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-704aeeef-5df9-4e70-a301-171cfa30cb92 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.968213 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-704aeeef-5df9-4e70-a301-171cfa30cb92 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:45.968731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-704aeeef-5df9-4e70-a301-171cfa30cb92 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:45.969155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-704aeeef-5df9-4e70-a301-171cfa30cb92 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:45.994688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:45.998170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-704aeeef-5df9-4e70-a301-171cfa30cb92 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:46:46.003812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2c01b78b-3daa-4e36-8cf0-b77184b0f925 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 200 len: 1331 microversion: 2.1 time: 0.104729 Aug 24 06:46:46.004520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1304/2611] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:45 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:46.319592 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-704aeeef-5df9-4e70-a301-171cfa30cb92 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 204 len: 0 microversion: 2.1 time: 0.365139 Aug 24 06:46:46.320577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1308/2612] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:46:45 2022] DELETE /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:46:46.328614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bc2fc6dc-653b-4bfe-80fd-0e0b4806f92d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:46.329231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bc2fc6dc-653b-4bfe-80fd-0e0b4806f92d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:46.335723 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc2fc6dc-653b-4bfe-80fd-0e0b4806f92d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:46.336228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc2fc6dc-653b-4bfe-80fd-0e0b4806f92d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:46.337043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc2fc6dc-653b-4bfe-80fd-0e0b4806f92d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:46.337772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc2fc6dc-653b-4bfe-80fd-0e0b4806f92d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:46.338228 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc2fc6dc-653b-4bfe-80fd-0e0b4806f92d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:46.339166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc2fc6dc-653b-4bfe-80fd-0e0b4806f92d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:46.475371 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bc2fc6dc-653b-4bfe-80fd-0e0b4806f92d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:46.483260 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bc2fc6dc-653b-4bfe-80fd-0e0b4806f92d tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1522 microversion: 2.1 time: 0.158916 Aug 24 06:46:46.483824 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1305/2613] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:46 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:47.026110 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:47.026834 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:47.033351 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:47.033768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:47.034203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:47.034893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:47.035343 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:47.035766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:47.049967 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 HTTP/1.1 Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:46:47.051633 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:46:47.053607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': 'ec8ec04b-3c19-4874-a301-4de2acda1c85'} Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:46:47.054690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:46:47.056157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:46:47.058155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 404 to user: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:46:47.058155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c8fd8163-c055-4919-b87a-25b792e038f1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 404 len: 111 microversion: 2.1 time: 0.031387 Aug 24 06:46:47.058155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1309/2614] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:47 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:46:47.063126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-49087126-3643-4db4-9a14-25a3d53ba6c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '.version_select at 0x7fcddc15cca0>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:47.221835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-49087126-3643-4db4-9a14-25a3d53ba6c1 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-473834849" status: 202 len: 0 microversion: 2.1 time: 0.162703 Aug 24 06:46:47.222474 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1306/2615] 10.222.0.62 () {58 vars in 1218 bytes} [Wed Aug 24 06:46:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-473834849 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:46:47.499925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-b0ebee90-21e1-44a9-9b86-75755e331828 req-2651dd27-ef3e-48c2-a471-7a035d858d35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce39956a-712f-48bb-83fd-c0f2efe66f83", "name": "network-vif-deleted", "tag": "7e43a66d-183d-446c-b558-8011888536fc"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:47.503056 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8dc493b9-0b47-4c72-a760-fbd6de083406 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:47.503738 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8dc493b9-0b47-4c72-a760-fbd6de083406 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:47.509305 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-b0ebee90-21e1-44a9-9b86-75755e331828 req-2651dd27-ef3e-48c2-a471-7a035d858d35 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:47.509769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-b0ebee90-21e1-44a9-9b86-75755e331828 req-2651dd27-ef3e-48c2-a471-7a035d858d35 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:47.510193 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-b0ebee90-21e1-44a9-9b86-75755e331828 req-2651dd27-ef3e-48c2-a471-7a035d858d35 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:47.510707 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dc493b9-0b47-4c72-a760-fbd6de083406 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:47.511188 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dc493b9-0b47-4c72-a760-fbd6de083406 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:47.511616 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dc493b9-0b47-4c72-a760-fbd6de083406 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:47.512300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dc493b9-0b47-4c72-a760-fbd6de083406 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:47.512800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dc493b9-0b47-4c72-a760-fbd6de083406 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:47.513248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dc493b9-0b47-4c72-a760-fbd6de083406 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:47.521721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-b0ebee90-21e1-44a9-9b86-75755e331828 req-2651dd27-ef3e-48c2-a471-7a035d858d35 service nova] Creating event network-vif-deleted:7e43a66d-183d-446c-b558-8011888536fc for instance ce39956a-712f-48bb-83fd-c0f2efe66f83 on hv-cinder-85426 Aug 24 06:46:47.528442 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-b0ebee90-21e1-44a9-9b86-75755e331828 req-2651dd27-ef3e-48c2-a471-7a035d858d35 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032211 Aug 24 06:46:47.533576 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1310/2616] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:47.589727 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8dc493b9-0b47-4c72-a760-fbd6de083406 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '069dc6f771a74dd4ab22d9d5e68e3cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c467d980c962456c9fa0e28364efd2a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:47.600025 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8dc493b9-0b47-4c72-a760-fbd6de083406 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 200 len: 1480 microversion: 2.1 time: 0.100825 Aug 24 06:46:47.619475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1307/2617] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:47 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 1480 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:48.200087 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1783b09e-9bbd-4b6d-a962-45bc6d95ecab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Action: 'create', calling method: .version_select at 0x7fcddc21be50>, body: {"keypair": {"name": "tempest-keypair-1564415567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMB49oruvpoDN12Rtf37c//zjbViCLfUSzHf86A/eY0Ciq4O+6jgKvDBElqurO8tkMe1Zy2UdCYnIEWcQ5g2o4w8tis+sytb1dwW4M55fnWr+6hYhJKAPnpBkpkyHz8dWw=="}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:48.215672 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-1783b09e-9bbd-4b6d-a962-45bc6d95ecab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'key_pairs'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:46:48.219511 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-1783b09e-9bbd-4b6d-a962-45bc6d95ecab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for user 6abfd0a28f9e482badae7018f1b7f9a1 and project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'key_pairs'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:46:48.356847 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1783b09e-9bbd-4b6d-a962-45bc6d95ecab tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.161586 Aug 24 06:46:48.357908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1311/2618] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 24 06:46:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:46:48.639232 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:48.639951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] [instance: ce39956a-712f-48bb-83fd-c0f2efe66f83] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:48.646735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:48.659382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:48.659382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:48.659382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:48.659382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:48.659832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:48.663696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] HTTP exception thrown: Instance ce39956a-712f-48bb-83fd-c0f2efe66f83 could not be found. Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Request method failure captured: Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 HTTP/1.1 Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcKrWIVODpGKYwuAjadGNhY4NWvtqpqnx0Eqk2Jv476klt3FCknTTgC7Lp6zVuEV3Qss59XKRLhUuiBtlrv4Rdl7sk5an2zO6A3FeeJFSXBQEGT4B0QnxI4EIo4TLtLFqknF7HyQ1uF165HUtypVjOsoC_avY3WmBTaXarybT-MPPC4 Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: c467d980c962456c9fa0e28364efd2a3 Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-714652183 Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:46:48.665451 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c467d980c962456c9fa0e28364efd2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/c467d980c962456c9fa0e28364efd2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/c467d980c962456c9fa0e28364efd2a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_c467d980c962456c9fa0e28364efd2a3", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-ServerRescueNegativeTestJSON-714652183 Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: c467d980c962456c9fa0e28364efd2a3 Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-714652183 Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-ServerRescueNegativeTestJSON-714652183-project Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 069dc6f771a74dd4ab22d9d5e68e3cc9 Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-ServerRescueNegativeTestJSON-714652183-project Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance ce39956a-712f-48bb-83fd-c0f2efe66f83 could not be found. Aug 24 06:46:48.667289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': 'ce39956a-712f-48bb-83fd-c0f2efe66f83'} Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce39956a-712f-48bb-83fd-c0f2efe66f83 could not be found. Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:46:48.668337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce39956a-712f-48bb-83fd-c0f2efe66f83 could not be found. Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce39956a-712f-48bb-83fd-c0f2efe66f83 could not be found. Aug 24 06:46:48.670124 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:46:48.671667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] Returning 404 to user: Instance ce39956a-712f-48bb-83fd-c0f2efe66f83 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:46:48.671667 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dac1b2fa-b1d1-4ae8-a8ab-e0ba58bc4f52 tempest-ServerRescueNegativeTestJSON-714652183 tempest-ServerRescueNegativeTestJSON-714652183-project] 10.222.0.62 "GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83" status: 404 len: 111 microversion: 2.1 time: 0.032292 Aug 24 06:46:48.672119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1308/2619] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:48 2022] GET /compute/v2.1/servers/ce39956a-712f-48bb-83fd-c0f2efe66f83 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:46:51.611260 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-361095234", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51fe0999-9ccc-4b64-9b23-f80a9285df9a"}], "security_groups": [{"name": "tempest-securitygroup--1245829856"}], "key_name": "tempest-keypair-1564415567", "user_data": "}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:51.778249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] validate_networks() for [('51fe0999-9ccc-4b64-9b23-f80a9285df9a', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:46:52.205730 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:46:52.206146 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:46:52.206675 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:46:52.207003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:46:52.207407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:46:52.216948 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:52.217428 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:52.217855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:52.218568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:52.219043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:52.219461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:52.236801 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:46:52.240717 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Getting quotas for user 6abfd0a28f9e482badae7018f1b7f9a1 and project b1f2c78322cb4c999f1e01b82b81a884. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:46:52.252379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:46:52.254884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:46:52.408959 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-acca4d45-c49f-4488-8797-770d4647535a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.803077 Aug 24 06:46:52.416266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1312/2620] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:46:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 06:46:52.421413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-49281301-4a10-4632-b29b-ce2215e64d82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:52.422026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-49281301-4a10-4632-b29b-ce2215e64d82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:52.495871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-49281301-4a10-4632-b29b-ce2215e64d82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:52.503874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-49281301-4a10-4632-b29b-ce2215e64d82 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1241 microversion: 2.1 time: 0.086097 Aug 24 06:46:52.505231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1309/2621] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:52 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:53.525380 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-48986a7f-27b0-45cf-8f2f-b421dfb86544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:53.526539 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-48986a7f-27b0-45cf-8f2f-b421dfb86544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:53.533010 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48986a7f-27b0-45cf-8f2f-b421dfb86544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:53.535435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48986a7f-27b0-45cf-8f2f-b421dfb86544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:53.535435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48986a7f-27b0-45cf-8f2f-b421dfb86544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:53.535435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48986a7f-27b0-45cf-8f2f-b421dfb86544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:53.535435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48986a7f-27b0-45cf-8f2f-b421dfb86544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:53.535844 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-48986a7f-27b0-45cf-8f2f-b421dfb86544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:53.603074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-48986a7f-27b0-45cf-8f2f-b421dfb86544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:53.612296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-48986a7f-27b0-45cf-8f2f-b421dfb86544 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1245 microversion: 2.1 time: 0.091455 Aug 24 06:46:53.613004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1313/2622] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:53 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1245 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:54.635428 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a3fe1b1c-a1d5-4e7b-844a-75532a62cec4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:54.636153 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a3fe1b1c-a1d5-4e7b-844a-75532a62cec4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:54.644026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3fe1b1c-a1d5-4e7b-844a-75532a62cec4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:54.644520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3fe1b1c-a1d5-4e7b-844a-75532a62cec4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:54.644958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3fe1b1c-a1d5-4e7b-844a-75532a62cec4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:54.645654 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3fe1b1c-a1d5-4e7b-844a-75532a62cec4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:54.646242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3fe1b1c-a1d5-4e7b-844a-75532a62cec4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:54.646617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a3fe1b1c-a1d5-4e7b-844a-75532a62cec4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:54.716909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a3fe1b1c-a1d5-4e7b-844a-75532a62cec4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:54.724773 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a3fe1b1c-a1d5-4e7b-844a-75532a62cec4 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1293 microversion: 2.1 time: 0.093311 Aug 24 06:46:54.730705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1310/2623] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:54 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:46:55.162968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0c0270b8-f231-4096-85e0-2a5e00f18052 tempest-VolumesGetTestJSON-26298688 tempest-VolumesGetTestJSON-26298688-project] Action: 'create', calling method: .version_select at 0x7fcddc07a4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1406649005", "metadata": {"Type": "work"}}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:55.751756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-71379383-f079-497a-a481-e2cb597e72ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:55.752435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-71379383-f079-497a-a481-e2cb597e72ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:55.759123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-71379383-f079-497a-a481-e2cb597e72ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.760027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-71379383-f079-497a-a481-e2cb597e72ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.761106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-71379383-f079-497a-a481-e2cb597e72ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.761911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-71379383-f079-497a-a481-e2cb597e72ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:55.762425 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-71379383-f079-497a-a481-e2cb597e72ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:55.762991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-71379383-f079-497a-a481-e2cb597e72ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:55.918545 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-71379383-f079-497a-a481-e2cb597e72ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:55.927478 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-71379383-f079-497a-a481-e2cb597e72ac tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1367 microversion: 2.1 time: 0.179686 Aug 24 06:46:55.928050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1311/2624] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:55 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:56.625588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-aeb3c26d-c16b-45f7-ab64-77418b3bddc8 req-0d13612b-8f0d-48a1-9001-5519a34bc4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe858eb-d84f-4ba4-af6c-e0bcf799d5ee", "tag": "6646426f-1de3-43d7-ad1c-685c53fd2663"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:46:56.635660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-aeb3c26d-c16b-45f7-ab64-77418b3bddc8 req-0d13612b-8f0d-48a1-9001-5519a34bc4b2 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:56.636220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-aeb3c26d-c16b-45f7-ab64-77418b3bddc8 req-0d13612b-8f0d-48a1-9001-5519a34bc4b2 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:56.636682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-aeb3c26d-c16b-45f7-ab64-77418b3bddc8 req-0d13612b-8f0d-48a1-9001-5519a34bc4b2 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:56.647687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-aeb3c26d-c16b-45f7-ab64-77418b3bddc8 req-0d13612b-8f0d-48a1-9001-5519a34bc4b2 service nova] Creating event network-changed:6646426f-1de3-43d7-ad1c-685c53fd2663 for instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee on hv-cinder-85426 Aug 24 06:46:56.653158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-aeb3c26d-c16b-45f7-ab64-77418b3bddc8 req-0d13612b-8f0d-48a1-9001-5519a34bc4b2 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031592 Aug 24 06:46:56.654111 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1312/2625] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:46:56.951207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b5126b70-ba81-4bb7-88dd-d627853c866d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:56.951904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b5126b70-ba81-4bb7-88dd-d627853c866d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:56.958682 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5126b70-ba81-4bb7-88dd-d627853c866d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:56.959180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5126b70-ba81-4bb7-88dd-d627853c866d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:56.959629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5126b70-ba81-4bb7-88dd-d627853c866d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:56.960348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5126b70-ba81-4bb7-88dd-d627853c866d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:56.960847 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5126b70-ba81-4bb7-88dd-d627853c866d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:56.961261 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b5126b70-ba81-4bb7-88dd-d627853c866d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:57.174224 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b5126b70-ba81-4bb7-88dd-d627853c866d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:57.182529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b5126b70-ba81-4bb7-88dd-d627853c866d tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1367 microversion: 2.1 time: 0.237055 Aug 24 06:46:57.183095 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1313/2626] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:56 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:58.203327 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-4d3c5515-27d5-4e95-94f0-c9244a7faa3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:58.204020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-4d3c5515-27d5-4e95-94f0-c9244a7faa3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:58.210407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d3c5515-27d5-4e95-94f0-c9244a7faa3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:58.210877 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d3c5515-27d5-4e95-94f0-c9244a7faa3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:58.211299 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d3c5515-27d5-4e95-94f0-c9244a7faa3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:58.211968 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d3c5515-27d5-4e95-94f0-c9244a7faa3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:58.212408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d3c5515-27d5-4e95-94f0-c9244a7faa3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:58.212846 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-4d3c5515-27d5-4e95-94f0-c9244a7faa3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:58.590296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-4d3c5515-27d5-4e95-94f0-c9244a7faa3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:58.598040 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-4d3c5515-27d5-4e95-94f0-c9244a7faa3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1367 microversion: 2.1 time: 0.398660 Aug 24 06:46:58.598598 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1314/2627] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:58 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:46:59.618441 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-07aec392-6beb-407e-9f9d-fcfed548befd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:46:59.619194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-07aec392-6beb-407e-9f9d-fcfed548befd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:46:59.625632 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07aec392-6beb-407e-9f9d-fcfed548befd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:59.632558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07aec392-6beb-407e-9f9d-fcfed548befd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:59.632558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07aec392-6beb-407e-9f9d-fcfed548befd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:59.632558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07aec392-6beb-407e-9f9d-fcfed548befd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:46:59.632558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07aec392-6beb-407e-9f9d-fcfed548befd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:46:59.633001 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-07aec392-6beb-407e-9f9d-fcfed548befd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:46:59.759173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-07aec392-6beb-407e-9f9d-fcfed548befd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:46:59.767181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-07aec392-6beb-407e-9f9d-fcfed548befd tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1367 microversion: 2.1 time: 0.152489 Aug 24 06:46:59.768039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1315/2628] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:46:59 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:00.788734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-96e6044c-2cf0-416f-817c-23daf5cf88e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:00.789516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-96e6044c-2cf0-416f-817c-23daf5cf88e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:00.795618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96e6044c-2cf0-416f-817c-23daf5cf88e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:00.796089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96e6044c-2cf0-416f-817c-23daf5cf88e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:00.796527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96e6044c-2cf0-416f-817c-23daf5cf88e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:00.797203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96e6044c-2cf0-416f-817c-23daf5cf88e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:00.797650 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96e6044c-2cf0-416f-817c-23daf5cf88e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:00.798063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-96e6044c-2cf0-416f-817c-23daf5cf88e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:00.927603 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-96e6044c-2cf0-416f-817c-23daf5cf88e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:00.935440 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-96e6044c-2cf0-416f-817c-23daf5cf88e3 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1367 microversion: 2.1 time: 0.150653 Aug 24 06:47:00.935991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1316/2629] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:00 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:01.956600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-52f4efb7-0e72-4bcb-a234-a4f02b02da67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:01.957236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-52f4efb7-0e72-4bcb-a234-a4f02b02da67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:01.963706 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-52f4efb7-0e72-4bcb-a234-a4f02b02da67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:01.964180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-52f4efb7-0e72-4bcb-a234-a4f02b02da67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:01.965180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-52f4efb7-0e72-4bcb-a234-a4f02b02da67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:01.965860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-52f4efb7-0e72-4bcb-a234-a4f02b02da67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:01.966308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-52f4efb7-0e72-4bcb-a234-a4f02b02da67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:01.966725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-52f4efb7-0e72-4bcb-a234-a4f02b02da67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:02.098035 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-52f4efb7-0e72-4bcb-a234-a4f02b02da67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:02.106029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-52f4efb7-0e72-4bcb-a234-a4f02b02da67 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1367 microversion: 2.1 time: 0.153356 Aug 24 06:47:02.106590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1317/2630] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:01 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:02.226031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:02.247836 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=10 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:02.408378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-002645cc-33a7-4177-b7a3-8915ed972553 req-c1cbe60f-b612-46a7-9c8d-24f6c858d9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe858eb-d84f-4ba4-af6c-e0bcf799d5ee", "name": "network-vif-plugged", "status": "completed", "tag": "6646426f-1de3-43d7-ad1c-685c53fd2663"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:02.417962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-002645cc-33a7-4177-b7a3-8915ed972553 req-c1cbe60f-b612-46a7-9c8d-24f6c858d9e7 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:02.418432 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-002645cc-33a7-4177-b7a3-8915ed972553 req-c1cbe60f-b612-46a7-9c8d-24f6c858d9e7 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:02.418856 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-002645cc-33a7-4177-b7a3-8915ed972553 req-c1cbe60f-b612-46a7-9c8d-24f6c858d9e7 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:02.429920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-002645cc-33a7-4177-b7a3-8915ed972553 req-c1cbe60f-b612-46a7-9c8d-24f6c858d9e7 service nova] Creating event network-vif-plugged:6646426f-1de3-43d7-ad1c-685c53fd2663 for instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee on hv-cinder-85426 Aug 24 06:47:02.435936 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-002645cc-33a7-4177-b7a3-8915ed972553 req-c1cbe60f-b612-46a7-9c8d-24f6c858d9e7 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089236 Aug 24 06:47:02.436565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1318/2631] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:47:03.125223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:03.129771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9f04c773-db27-45ff-9c87-16c8ea7865f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:03.130475 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9f04c773-db27-45ff-9c87-16c8ea7865f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:03.137663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f04c773-db27-45ff-9c87-16c8ea7865f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:03.138136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f04c773-db27-45ff-9c87-16c8ea7865f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:03.138558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f04c773-db27-45ff-9c87-16c8ea7865f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:03.139254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f04c773-db27-45ff-9c87-16c8ea7865f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:03.139697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f04c773-db27-45ff-9c87-16c8ea7865f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:03.140115 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f04c773-db27-45ff-9c87-16c8ea7865f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:03.144647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:03.276621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9f04c773-db27-45ff-9c87-16c8ea7865f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:03.285691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9f04c773-db27-45ff-9c87-16c8ea7865f9 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1367 microversion: 2.1 time: 0.161469 Aug 24 06:47:03.286283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1319/2632] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:03 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:47:03.530097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:03.607871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:04.311849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ce214fb7-b142-4bb6-973d-32d970b0dc01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:04.312436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ce214fb7-b142-4bb6-973d-32d970b0dc01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:04.319329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce214fb7-b142-4bb6-973d-32d970b0dc01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.319803 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce214fb7-b142-4bb6-973d-32d970b0dc01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.320225 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce214fb7-b142-4bb6-973d-32d970b0dc01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.320928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce214fb7-b142-4bb6-973d-32d970b0dc01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.321372 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce214fb7-b142-4bb6-973d-32d970b0dc01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.321784 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ce214fb7-b142-4bb6-973d-32d970b0dc01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.449553 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ce214fb7-b142-4bb6-973d-32d970b0dc01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:04.457444 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ce214fb7-b142-4bb6-973d-32d970b0dc01 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1556 microversion: 2.1 time: 0.150335 Aug 24 06:47:04.458166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1320/2633] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:47:04 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:47:04.477374 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-70be483f-8034-466d-863e-2a4327f8f473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:04.477839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-70be483f-8034-466d-863e-2a4327f8f473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:04.484235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70be483f-8034-466d-863e-2a4327f8f473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.484752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70be483f-8034-466d-863e-2a4327f8f473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.485180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70be483f-8034-466d-863e-2a4327f8f473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.485861 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70be483f-8034-466d-863e-2a4327f8f473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:04.486308 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70be483f-8034-466d-863e-2a4327f8f473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:04.486726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-70be483f-8034-466d-863e-2a4327f8f473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:04.569315 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-70be483f-8034-466d-863e-2a4327f8f473 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095647 Aug 24 06:47:04.569906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1321/2634] 10.222.0.62 () {58 vars in 1275 bytes} [Wed Aug 24 06:47:04 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:47:05.577443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-39a84393-1d34-46ae-bcf3-c3d363e70ca3 req-fc61b2f0-9aa0-44f8-8b74-7bd2bbd0126e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efe858eb-d84f-4ba4-af6c-e0bcf799d5ee", "tag": "6646426f-1de3-43d7-ad1c-685c53fd2663"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:05.587050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-39a84393-1d34-46ae-bcf3-c3d363e70ca3 req-fc61b2f0-9aa0-44f8-8b74-7bd2bbd0126e service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:05.587506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-39a84393-1d34-46ae-bcf3-c3d363e70ca3 req-fc61b2f0-9aa0-44f8-8b74-7bd2bbd0126e service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:05.587973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-39a84393-1d34-46ae-bcf3-c3d363e70ca3 req-fc61b2f0-9aa0-44f8-8b74-7bd2bbd0126e service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:05.599409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-39a84393-1d34-46ae-bcf3-c3d363e70ca3 req-fc61b2f0-9aa0-44f8-8b74-7bd2bbd0126e service nova] Creating event network-changed:6646426f-1de3-43d7-ad1c-685c53fd2663 for instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee on hv-cinder-85426 Aug 24 06:47:05.604515 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-39a84393-1d34-46ae-bcf3-c3d363e70ca3 req-fc61b2f0-9aa0-44f8-8b74-7bd2bbd0126e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031969 Aug 24 06:47:05.605112 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1322/2635] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:47:36.827158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:36.828325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=16 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:47:36.832476 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7cccde36-4d33-4088-8cec-9011d7ed0894 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:36.833074 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7cccde36-4d33-4088-8cec-9011d7ed0894 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:36.839329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cccde36-4d33-4088-8cec-9011d7ed0894 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:36.846983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cccde36-4d33-4088-8cec-9011d7ed0894 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:36.846983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cccde36-4d33-4088-8cec-9011d7ed0894 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:36.846983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cccde36-4d33-4088-8cec-9011d7ed0894 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:36.846983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cccde36-4d33-4088-8cec-9011d7ed0894 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:36.847742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7cccde36-4d33-4088-8cec-9011d7ed0894 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:36.865768 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7cccde36-4d33-4088-8cec-9011d7ed0894 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee/ips" status: 200 len: 149 microversion: 2.1 time: 0.040285 Aug 24 06:47:36.866354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1323/2636] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 24 06:47:36 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:47:36.934583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cf387c85-ab62-48d0-b89b-816553276b09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:36.935467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cf387c85-ab62-48d0-b89b-816553276b09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:36.942642 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf387c85-ab62-48d0-b89b-816553276b09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:36.943120 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf387c85-ab62-48d0-b89b-816553276b09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:36.943547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf387c85-ab62-48d0-b89b-816553276b09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:36.944223 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf387c85-ab62-48d0-b89b-816553276b09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:36.944701 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf387c85-ab62-48d0-b89b-816553276b09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:36.945508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-cf387c85-ab62-48d0-b89b-816553276b09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:36.971329 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-cf387c85-ab62-48d0-b89b-816553276b09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Going to try to terminate instance {{(pid=121150) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:47:37.290703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cf387c85-ab62-48d0-b89b-816553276b09 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 204 len: 0 microversion: 2.20 time: 0.359213 Aug 24 06:47:37.291526 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1324/2637] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Aug 24 06:47:36 2022] DELETE /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 06:47:37.299923 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:37.300635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:37.306415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:37.306907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:37.307332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:37.307996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:37.308439 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:37.308874 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:37.447860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:37.456203 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:37.459442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:37.459442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-21c0dc8e-97ff-460a-bb3d-d074777047f6 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1723 microversion: 2.20 time: 0.163026 Aug 24 06:47:37.459731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1325/2638] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:37 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:47:38.483581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:38.484269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:38.490586 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:38.491065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:38.491501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:38.492296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:38.493313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:38.493732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:38.559657 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:38.568163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:38.572400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:38.572400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d94f8b3e-283a-4a5c-9959-394e36d8ac5c tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1655 microversion: 2.20 time: 0.091503 Aug 24 06:47:38.572400 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1326/2639] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:38 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1655 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:47:38.630187 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-8d1de7d9-504b-4dd7-939a-4e22a8098e64 req-c5ca9f9a-c93d-45a4-b661-d66602eb1850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebadb55-a641-4674-8ab9-c6df06704b25", "name": "network-vif-deleted", "tag": "dd8c18c8-3caf-4abf-a93e-150a2db505e6"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:47:38.639848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-8d1de7d9-504b-4dd7-939a-4e22a8098e64 req-c5ca9f9a-c93d-45a4-b661-d66602eb1850 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:38.640324 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-8d1de7d9-504b-4dd7-939a-4e22a8098e64 req-c5ca9f9a-c93d-45a4-b661-d66602eb1850 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:38.640778 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-8d1de7d9-504b-4dd7-939a-4e22a8098e64 req-c5ca9f9a-c93d-45a4-b661-d66602eb1850 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:38.652444 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-8d1de7d9-504b-4dd7-939a-4e22a8098e64 req-c5ca9f9a-c93d-45a4-b661-d66602eb1850 service nova] Creating event network-vif-deleted:dd8c18c8-3caf-4abf-a93e-150a2db505e6 for instance 3ebadb55-a641-4674-8ab9-c6df06704b25 on hv-cinder-85426 Aug 24 06:47:38.657922 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-8d1de7d9-504b-4dd7-939a-4e22a8098e64 req-c5ca9f9a-c93d-45a4-b661-d66602eb1850 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031236 Aug 24 06:47:38.658558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1327/2640] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:47:39.730042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:39.730872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:39.737007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:39.737480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:39.737904 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:39.738580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:39.739022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:39.739437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:39.770386 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:39.770853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:39.771365 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:39.771714 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lazy-loading 'fault' on Instance uuid 3ebadb55-a641-4674-8ab9-c6df06704b25 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:47:39.816395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:39.825665 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:39.827079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5059723f417445fa934ecfe3e50d0197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e8d9878aff47cea1bd895f618badb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:47:39.828206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b759d1d4-bf7f-493b-8bef-628f2e691779 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 200 len: 1371 microversion: 2.20 time: 0.239237 Aug 24 06:47:39.828788 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1328/2641] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:39 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 06:47:40.854653 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:40.855446 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:47:40.861689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:40.862170 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:40.862596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:40.863269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:47:40.863717 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:47:40.864136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:47:40.879943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] HTTP exception thrown: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Request method failure captured: Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 HTTP/1.1 Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJHw9FnfXl7Qixnl2B4FOA3Q_MeZsKoYPpNiEu2m2_pU0ZqXnvOReJZo597cLettI2bfMH_G0Hbudk53U8FJp5OuKBigQJD3kwCaetS1YgdOS1YU0crSpJphvVcqfPW6XE882h_uFjpi2uYCjV-3IY3aRSSEEf-bpH3kjO71bGtyo8 Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: f4e8d9878aff47cea1bd895f618badb8 Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:47:40.881590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f4e8d9878aff47cea1bd895f618badb8", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: f4e8d9878aff47cea1bd895f618badb8 Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-AttachVolumeShelveTestJSON-293735452-project Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 5059723f417445fa934ecfe3e50d0197 Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-AttachVolumeShelveTestJSON-293735452-project Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:47:40.884313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '3ebadb55-a641-4674-8ab9-c6df06704b25'} Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:47:40.885527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:47:40.887370 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:47:40.889026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Returning 404 to user: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:47:40.889026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-93875171-6029-4159-bd34-6b7922f7e7e9 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 404 len: 111 microversion: 2.20 time: 0.032238 Aug 24 06:47:40.889026 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1329/2642] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:47:40 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 06:47:40.892128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2806e0b9-6efe-463a-9b79-52972bff5857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '.version_select at 0x7fcddc142430>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:47:40.993452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2806e0b9-6efe-463a-9b79-52972bff5857 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270955512" status: 204 len: 0 microversion: 2.20 time: 0.104353 Aug 24 06:47:40.994054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1330/2643] 10.222.0.62 () {60 vars in 1262 bytes} [Wed Aug 24 06:47:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1270955512 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 06:48:36.944669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:36.945404 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:48:37.105764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8dba3370-8be4-406d-8371-0adfd1e522e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:37.106256 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8dba3370-8be4-406d-8371-0adfd1e522e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:37.112873 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dba3370-8be4-406d-8371-0adfd1e522e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:37.113350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dba3370-8be4-406d-8371-0adfd1e522e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:37.113777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dba3370-8be4-406d-8371-0adfd1e522e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:37.114504 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dba3370-8be4-406d-8371-0adfd1e522e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:37.114948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dba3370-8be4-406d-8371-0adfd1e522e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:37.115359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8dba3370-8be4-406d-8371-0adfd1e522e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:37.290368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8dba3370-8be4-406d-8371-0adfd1e522e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Going to try to terminate instance {{(pid=121150) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:48:37.722721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8dba3370-8be4-406d-8371-0adfd1e522e5 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 204 len: 0 microversion: 2.1 time: 0.783098 Aug 24 06:48:37.723408 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1331/2644] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:48:36 2022] DELETE /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 0 bytes in 785 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 06:48:37.732140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-84c5d302-c814-4f08-a67b-81618cb87b00 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:37.737457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-84c5d302-c814-4f08-a67b-81618cb87b00 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:37.738736 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84c5d302-c814-4f08-a67b-81618cb87b00 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:37.739207 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84c5d302-c814-4f08-a67b-81618cb87b00 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:37.739629 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84c5d302-c814-4f08-a67b-81618cb87b00 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:37.740303 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84c5d302-c814-4f08-a67b-81618cb87b00 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:37.740771 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84c5d302-c814-4f08-a67b-81618cb87b00 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:37.741190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-84c5d302-c814-4f08-a67b-81618cb87b00 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:37.871178 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-84c5d302-c814-4f08-a67b-81618cb87b00 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:37.882532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-84c5d302-c814-4f08-a67b-81618cb87b00 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1681 microversion: 2.1 time: 0.154289 Aug 24 06:48:37.883096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1332/2645] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:37 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:38.904664 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1c68789f-a369-42fb-b186-1558c0bcba99 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:38.905409 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1c68789f-a369-42fb-b186-1558c0bcba99 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:38.912113 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c68789f-a369-42fb-b186-1558c0bcba99 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:38.912644 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c68789f-a369-42fb-b186-1558c0bcba99 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:38.913072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c68789f-a369-42fb-b186-1558c0bcba99 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:38.913800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c68789f-a369-42fb-b186-1558c0bcba99 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:38.914259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c68789f-a369-42fb-b186-1558c0bcba99 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:38.914681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c68789f-a369-42fb-b186-1558c0bcba99 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:39.055251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-1c68789f-a369-42fb-b186-1558c0bcba99 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:39.063184 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1c68789f-a369-42fb-b186-1558c0bcba99 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1681 microversion: 2.1 time: 0.162520 Aug 24 06:48:39.063737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1333/2646] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:38 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:40.083220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0ede6403-dd9e-4402-adae-d3497784ff56 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:40.083984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0ede6403-dd9e-4402-adae-d3497784ff56 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:40.090524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ede6403-dd9e-4402-adae-d3497784ff56 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:40.091011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ede6403-dd9e-4402-adae-d3497784ff56 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:40.091452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ede6403-dd9e-4402-adae-d3497784ff56 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:40.092158 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ede6403-dd9e-4402-adae-d3497784ff56 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:40.092663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ede6403-dd9e-4402-adae-d3497784ff56 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:40.093083 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0ede6403-dd9e-4402-adae-d3497784ff56 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:40.198647 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0ede6403-dd9e-4402-adae-d3497784ff56 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:40.214419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0ede6403-dd9e-4402-adae-d3497784ff56 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1613 microversion: 2.1 time: 0.127575 Aug 24 06:48:40.214419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1334/2647] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:40 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1613 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:40.293643 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-3a362ecf-1370-42ba-a208-f93729ce2e26 req-1cfd4bad-b4af-41a3-9c90-861ae28aa383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efe858eb-d84f-4ba4-af6c-e0bcf799d5ee", "name": "network-vif-deleted", "tag": "6646426f-1de3-43d7-ad1c-685c53fd2663"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:48:40.303395 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-3a362ecf-1370-42ba-a208-f93729ce2e26 req-1cfd4bad-b4af-41a3-9c90-861ae28aa383 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:40.303876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-3a362ecf-1370-42ba-a208-f93729ce2e26 req-1cfd4bad-b4af-41a3-9c90-861ae28aa383 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:40.304307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-3a362ecf-1370-42ba-a208-f93729ce2e26 req-1cfd4bad-b4af-41a3-9c90-861ae28aa383 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:40.316649 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-3a362ecf-1370-42ba-a208-f93729ce2e26 req-1cfd4bad-b4af-41a3-9c90-861ae28aa383 service nova] Creating event network-vif-deleted:6646426f-1de3-43d7-ad1c-685c53fd2663 for instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee on hv-cinder-85426 Aug 24 06:48:40.322399 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-3a362ecf-1370-42ba-a208-f93729ce2e26 req-1cfd4bad-b4af-41a3-9c90-861ae28aa383 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032327 Aug 24 06:48:40.323373 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1335/2648] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:48:41.229190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:41.229925 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:41.237478 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:41.238116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:41.238577 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:41.239726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:41.239726 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:41.240247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:41.274571 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:41.274955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:41.275381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:41.275822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lazy-loading 'fault' on Instance uuid efe858eb-d84f-4ba4-af6c-e0bcf799d5ee {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:48:41.330318 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6abfd0a28f9e482badae7018f1b7f9a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1f2c78322cb4c999f1e01b82b81a884', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:48:41.338337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fa681e9c-6eae-45f2-be63-765169119710 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 200 len: 1331 microversion: 2.1 time: 0.113487 Aug 24 06:48:41.339117 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1336/2649] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:41 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:48:42.359942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:42.360730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:42.367200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.367684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.368116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.368838 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:42.369289 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:42.369712 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:42.383611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee HTTP/1.1 Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:48:42.385302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:42.387155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': 'efe858eb-d84f-4ba4-af6c-e0bcf799d5ee'} Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:42.388208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:42.390013 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:42.392128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 404 to user: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:42.392128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1c223ac2-403d-43c3-acf4-c22bfcbe6659 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 404 len: 111 microversion: 2.1 time: 0.030832 Aug 24 06:48:42.392128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1337/2650] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:42 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:48:42.395769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-dac9febc-b776-4d4e-9db0-fbac5750963c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '.version_select at 0x7fcddc1421f0>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:42.524368 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-dac9febc-b776-4d4e-9db0-fbac5750963c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564415567" status: 202 len: 0 microversion: 2.1 time: 0.131990 Aug 24 06:48:42.525243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1338/2651] 10.222.0.62 () {58 vars in 1221 bytes} [Wed Aug 24 06:48:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1564415567 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 06:48:43.411105 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:43.411762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:43.421893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.422624 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.423220 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.424234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.424970 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.425483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.440186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: DELETE /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee HTTP/1.1 Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:48:43.441955 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:43.443762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': 'efe858eb-d84f-4ba4-af6c-e0bcf799d5ee'} Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:43.444984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:43.446837 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.448541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 404 to user: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:43.448541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-28823212-22ba-4266-ac9a-d5816627de3a tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 404 len: 111 microversion: 2.1 time: 0.036785 Aug 24 06:48:43.448541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1339/2652] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:48:43 2022] DELETE /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:48:43.451797 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:48:43.452418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: efe858eb-d84f-4ba4-af6c-e0bcf799d5ee] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:48:43.458442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.458911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.459337 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.460012 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:48:43.460454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:48:43.460893 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:48:43.474061 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee HTTP/1.1 Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:48:43.475609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:43.477480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': 'efe858eb-d84f-4ba4-af6c-e0bcf799d5ee'} Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:48:43.478483 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. Aug 24 06:48:43.479987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:48:43.481387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 404 to user: Instance efe858eb-d84f-4ba4-af6c-e0bcf799d5ee could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:48:43.481387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-647654d4-b6a8-4c23-ac0a-c60ab24cce4f tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee" status: 404 len: 111 microversion: 2.1 time: 0.029037 Aug 24 06:48:43.481387 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1340/2653] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:48:43 2022] GET /compute/v2.1/servers/efe858eb-d84f-4ba4-af6c-e0bcf799d5ee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:48:44.014554 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0c0270b8-f231-4096-85e0-2a5e00f18052 tempest-VolumesGetTestJSON-26298688 tempest-VolumesGetTestJSON-26298688-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 108.976724 Aug 24 06:48:44.015768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1314/2654] 10.222.0.62 () {60 vars in 1156 bytes} [Wed Aug 24 06:46:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 108979 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 06:48:56.321822 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:48:56.322540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:48:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:49:59.949385 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:49:59.950066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:49:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:50:05.265486 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:50:05.266270 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:50:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:50:05.877142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:50:05.877772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:50:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:51:32.273242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:51:32.274014 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:51:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:51:36.605914 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef1e0970-9ea8-4035-8bd7-5d475c4a624f] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 06:51:36.606925 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:36.613072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:36.613072 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-7fa646a8-3d1d-4783-a738-bb74f652450c req-c99046ff-5c58-49e2-af72-568729827de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f57e168-0ea9-4010-ac53-24c1da2474d7", "name": "network-vif-deleted", "tag": "eac62d9b-9d4a-455c-a18c-d1a1aa1b3a1b"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:51:36.624584 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-7fa646a8-3d1d-4783-a738-bb74f652450c req-c99046ff-5c58-49e2-af72-568729827de1 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:51:36.625069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-7fa646a8-3d1d-4783-a738-bb74f652450c req-c99046ff-5c58-49e2-af72-568729827de1 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:51:36.625501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-7fa646a8-3d1d-4783-a738-bb74f652450c req-c99046ff-5c58-49e2-af72-568729827de1 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:51:36.636742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-7fa646a8-3d1d-4783-a738-bb74f652450c req-c99046ff-5c58-49e2-af72-568729827de1 service nova] Creating event network-vif-deleted:eac62d9b-9d4a-455c-a18c-d1a1aa1b3a1b for instance 6f57e168-0ea9-4010-ac53-24c1da2474d7 on hv-cinder-85426 Aug 24 06:51:36.643894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-7fa646a8-3d1d-4783-a738-bb74f652450c req-c99046ff-5c58-49e2-af72-568729827de1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039298 Aug 24 06:51:36.644976 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1341/2655] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:52:16.330565 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:52:16.330970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:52:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:53:19.957906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:53:19.958583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:53:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:53:25.273920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:53:25.274599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:53:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:53:25.885044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:53:25.885611 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:53:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:53:39.511011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:53:39.511558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:53:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:54:44.184060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09c26f46-ce31-4745-8a66-229ed6a232e3] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:54:44.188074 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:44.188588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:44.195281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:44.195753 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:44.196248 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:44.196965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:44.197406 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:44.197821 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:44.210986 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] HTTP exception thrown: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Request method failure captured: Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: DELETE /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 HTTP/1.1 Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcJHw9FnfXl7Qixnl2B4FOA3Q_MeZsKoYPpNiEu2m2_pU0ZqXnvOReJZo597cLettI2bfMH_G0Hbudk53U8FJp5OuKBigQJD3kwCaetS1YgdOS1YU0crSpJphvVcqfPW6XE882h_uFjpi2uYCjV-3IY3aRSSEEf-bpH3kjO71bGtyo8 Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: f4e8d9878aff47cea1bd895f618badb8 Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:54:44.212716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f4e8d9878aff47cea1bd895f618badb8", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: f4e8d9878aff47cea1bd895f618badb8 Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeShelveTestJSON-293735452-project Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 5059723f417445fa934ecfe3e50d0197 Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeShelveTestJSON-293735452-project Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:54:44.214228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '3ebadb55-a641-4674-8ab9-c6df06704b25'} Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:54:44.215019 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:54:44.216307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:44.217644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Returning 404 to user: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:54:44.217644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9de441f0-9a40-4a6c-8705-f0a282e59deb tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "DELETE /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 404 len: 111 microversion: 2.20 time: 0.032442 Aug 24 06:54:44.217644 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1315/2656] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Aug 24 06:54:44 2022] DELETE /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 06:54:44.225748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:44.226467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 3ebadb55-a641-4674-8ab9-c6df06704b25] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:44.235761 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:44.239947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:44.239947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:44.239947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:44.239947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:44.240360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:44.241493 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef1e0970-9ea8-4035-8bd7-5d475c4a624f] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 40548. Aug 24 06:54:44.253054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] HTTP exception thrown: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Request method failure captured: Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 HTTP/1.1 Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJHw9FnfXl7Qixnl2B4FOA3Q_MeZsKoYPpNiEu2m2_pU0ZqXnvOReJZo597cLettI2bfMH_G0Hbudk53U8FJp5OuKBigQJD3kwCaetS1YgdOS1YU0crSpJphvVcqfPW6XE882h_uFjpi2uYCjV-3IY3aRSSEEf-bpH3kjO71bGtyo8 Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: f4e8d9878aff47cea1bd895f618badb8 Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:54:44.254684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f4e8d9878aff47cea1bd895f618badb8", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: f4e8d9878aff47cea1bd895f618badb8 Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-AttachVolumeShelveTestJSON-293735452-project Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 5059723f417445fa934ecfe3e50d0197 Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-AttachVolumeShelveTestJSON-293735452-project Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:54:44.256093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '3ebadb55-a641-4674-8ab9-c6df06704b25'} Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:54:44.256956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. Aug 24 06:54:44.258181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:44.259357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Returning 404 to user: Instance 3ebadb55-a641-4674-8ab9-c6df06704b25 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:54:44.259357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b49ca56d-01cd-4a08-bc94-836528f42355 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25" status: 404 len: 111 microversion: 2.20 time: 0.037097 Aug 24 06:54:44.259357 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1342/2657] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:54:44 2022] GET /compute/v2.1/servers/3ebadb55-a641-4674-8ab9-c6df06704b25 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 06:54:45.504724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:45.505218 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:45.513423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:45.513899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:45.514330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:45.515021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:45.515468 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:45.515891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:45.531152 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] [09c26f46-ce31-4745-8a66-229ed6a232e3] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 40560. Aug 24 06:54:45.532667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] HTTP exception thrown: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Request method failure captured: Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: DELETE /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 HTTP/1.1 Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcJHw9FnfXl7Qixnl2B4FOA3Q_MeZsKoYPpNiEu2m2_pU0ZqXnvOReJZo597cLettI2bfMH_G0Hbudk53U8FJp5OuKBigQJD3kwCaetS1YgdOS1YU0crSpJphvVcqfPW6XE882h_uFjpi2uYCjV-3IY3aRSSEEf-bpH3kjO71bGtyo8 Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: f4e8d9878aff47cea1bd895f618badb8 Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:54:45.534229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f4e8d9878aff47cea1bd895f618badb8", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: f4e8d9878aff47cea1bd895f618badb8 Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeShelveTestJSON-293735452-project Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 5059723f417445fa934ecfe3e50d0197 Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeShelveTestJSON-293735452-project Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. Aug 24 06:54:45.542674 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9'} Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:54:45.543439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. Aug 24 06:54:45.544711 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:45.546262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Returning 404 to user: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:54:45.546262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1c263c18-9309-423b-b4b9-46f4b481b8af tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "DELETE /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 404 len: 111 microversion: 2.20 time: 0.034736 Aug 24 06:54:45.546262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1316/2658] 10.222.0.62 () {60 vars in 1280 bytes} [Wed Aug 24 06:54:45 2022] DELETE /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 06:54:45.549521 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:45.550128 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] [instance: 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:54:45.557981 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:45.558488 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:45.558919 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:45.559594 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:54:45.560041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:54:45.560458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:54:45.574487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] HTTP exception thrown: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Request method failure captured: Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 HTTP/1.1 Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJHw9FnfXl7Qixnl2B4FOA3Q_MeZsKoYPpNiEu2m2_pU0ZqXnvOReJZo597cLettI2bfMH_G0Hbudk53U8FJp5OuKBigQJD3kwCaetS1YgdOS1YU0crSpJphvVcqfPW6XE882h_uFjpi2uYCjV-3IY3aRSSEEf-bpH3kjO71bGtyo8 Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: f4e8d9878aff47cea1bd895f618badb8 Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:54:45.576020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/f4e8d9878aff47cea1bd895f618badb8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_f4e8d9878aff47cea1bd895f618badb8", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: f4e8d9878aff47cea1bd895f618badb8 Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-293735452 Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-AttachVolumeShelveTestJSON-293735452-project Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 5059723f417445fa934ecfe3e50d0197 Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-AttachVolumeShelveTestJSON-293735452-project Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. Aug 24 06:54:45.577480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9'} Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:54:45.578316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. Aug 24 06:54:45.579625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:45.580812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] Returning 404 to user: Instance 45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:54:45.580812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-23615018-3d61-4a07-9ea5-63e7bb62b228 tempest-AttachVolumeShelveTestJSON-293735452 tempest-AttachVolumeShelveTestJSON-293735452-project] 10.222.0.62 "GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9" status: 404 len: 111 microversion: 2.20 time: 0.032090 Aug 24 06:54:45.580812 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1343/2659] 10.222.0.62 () {60 vars in 1277 bytes} [Wed Aug 24 06:54:45 2022] GET /compute/v2.1/servers/45a6e2b3-35f3-4fb5-8fdb-a27ccc6edbf9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 06:54:51.127160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a51d4d1e-58e9-4e41-bea1-3a38d4d5e59b tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Action: 'create', calling method: .version_select at 0x7fcdcffa9ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-940224009"}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:54:51.886480 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a51d4d1e-58e9-4e41-bea1-3a38d4d5e59b tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.872350 Aug 24 06:54:51.887101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1317/2660] 10.222.0.62 () {60 vars in 1155 bytes} [Wed Aug 24 06:54:51 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 874 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 06:54:51.899257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d3ba9e1e-ff9b-4d9e-adbd-e43d8821dc8a tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcddc150550>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:52.000419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d3ba9e1e-ff9b-4d9e-adbd-e43d8821dc8a tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9" status: 200 len: 344 microversion: 2.1 time: 0.104912 Aug 24 06:54:52.000951 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1344/2661] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 24 06:54:51 2022] GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9 => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:52.281941 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:54:52.282092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:54:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:54:53.014907 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5179dd4e-5a11-4f05-a395-2746830e0629 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcddc07a310>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:53.063612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5179dd4e-5a11-4f05-a395-2746830e0629 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9" status: 200 len: 345 microversion: 2.1 time: 0.053248 Aug 24 06:54:53.064282 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1318/2662] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 24 06:54:53 2022] GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:53.077243 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-64c236f7-b693-4289-9e0c-5fa5e5812d0e tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Action: 'create', calling method: .version_select at 0x7fcddc341700>, body: {"snapshot": {"volume_id": "7342b2fe-2d38-4b20-9a1c-836b887b40d9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1358138464"}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:54:53.431876 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-64c236f7-b693-4289-9e0c-5fa5e5812d0e tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.358883 Aug 24 06:54:53.432541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1345/2663] 10.222.0.62 () {60 vars in 1162 bytes} [Wed Aug 24 06:54:53 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:53.443667 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d52f96ae-31ac-4da5-9221-edd4c63241d1 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcddc304820>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:53.473149 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d52f96ae-31ac-4da5-9221-edd4c63241d1 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db" status: 200 len: 287 microversion: 2.1 time: 0.033638 Aug 24 06:54:53.473705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1319/2664] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 24 06:54:53 2022] GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:53.484206 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9c6c14fa-6957-4da5-bc2f-73385795dfc9 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcde0b59ee0>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:53.515514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9c6c14fa-6957-4da5-bc2f-73385795dfc9 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035019 Aug 24 06:54:53.516086 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1346/2665] 10.222.0.62 () {58 vars in 1140 bytes} [Wed Aug 24 06:54:53 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:53.527634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8cd2bea8-a2ee-4f0b-8391-9d97ccd28ea2 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcdcff709d0>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:53.557072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8cd2bea8-a2ee-4f0b-8391-9d97ccd28ea2 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db" status: 200 len: 287 microversion: 2.1 time: 0.032627 Aug 24 06:54:53.557489 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1320/2666] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 24 06:54:53 2022] GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:54.570180 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b86b3898-ac1a-47f6-be3e-7f0cb4295b26 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcddd7a4f70>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:54.598878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b86b3898-ac1a-47f6-be3e-7f0cb4295b26 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db" status: 200 len: 287 microversion: 2.1 time: 0.033236 Aug 24 06:54:54.599472 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1347/2667] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 24 06:54:54 2022] GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:55.609344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=4 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:55.610099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=4 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:55.613879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-33126e49-dc69-458d-be07-07717b316602 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcdcff8e430>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:55.643522 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-33126e49-dc69-458d-be07-07717b316602 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db" status: 200 len: 287 microversion: 2.1 time: 0.035394 Aug 24 06:54:55.644073 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1321/2668] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 24 06:54:55 2022] GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:56.656251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6a17f0f9-4a81-4ae3-b457-3c17fd7beb1f tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcddc179b80>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:56.685692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6a17f0f9-4a81-4ae3-b457-3c17fd7beb1f tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db" status: 200 len: 288 microversion: 2.1 time: 0.034233 Aug 24 06:54:56.686416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1348/2669] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 24 06:54:56 2022] GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:56.698852 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7cc86181-08f4-471a-a03f-7f75f6cc151d tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcdcff70a60>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:56.825397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7cc86181-08f4-471a-a03f-7f75f6cc151d tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "DELETE /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db" status: 202 len: 0 microversion: 2.1 time: 0.131739 Aug 24 06:54:56.826004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1322/2670] 10.222.0.62 () {58 vars in 1254 bytes} [Wed Aug 24 06:54:56 2022] DELETE /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:54:56.834280 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-008d0d0f-6241-48ba-8d43-afb04fe51672 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcddc3523a0>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:56.863569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-008d0d0f-6241-48ba-8d43-afb04fe51672 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db" status: 200 len: 287 microversion: 2.1 time: 0.033009 Aug 24 06:54:56.864127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1349/2671] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 24 06:54:56 2022] GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:57.875627 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f932a4c0-abd2-44bb-b44f-c9b3c4cb7aae tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcde0a7c670>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:57.905078 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-f932a4c0-abd2-44bb-b44f-c9b3c4cb7aae tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] HTTP exception thrown: Snapshot 706f8b3a-cad0-4cc2-a6bd-0588b85606db could not be found. Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f932a4c0-abd2-44bb-b44f-c9b3c4cb7aae tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Request method failure captured: Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db HTTP/1.1 Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcs6TfkHvpDYvcAl5IhnQ94kSITMsFNi-MNR6unq1j1nGFSUus4Q9q1r9_rehEADc4li-mnUpCeoIK-AzcvSGnjR5EaFA2nXtNL5mmSjfOvh-XSDdJgYwFbQkzl2nF2mQC3syj4PCz-wRdXFEXKcTMFS-0jjnveV7jO0xueTTWogYMY Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: b497d4d51a85438a816a14e2455dd948 Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:54:57.907355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b497d4d51a85438a816a14e2455dd948", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: b497d4d51a85438a816a14e2455dd948 Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-VolumesSnapshotsTestJSON-340333213-project Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: e4837de70e5a460e899d696c7337bf78 Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-VolumesSnapshotsTestJSON-340333213-project Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Snapshot 706f8b3a-cad0-4cc2-a6bd-0588b85606db could not be found. Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '706f8b3a-cad0-4cc2-a6bd-0588b85606db'} Aug 24 06:54:57.908727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 706f8b3a-cad0-4cc2-a6bd-0588b85606db could not be found. (HTTP 404) (Request-ID: req-4988f99e-20b2-4902-8b56-46fc0bdcee8b) Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:57.909479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:54:57.911000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 706f8b3a-cad0-4cc2-a6bd-0588b85606db could not be found. Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 06:54:57.912186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 706f8b3a-cad0-4cc2-a6bd-0588b85606db could not be found. Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 706f8b3a-cad0-4cc2-a6bd-0588b85606db could not be found. Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f932a4c0-abd2-44bb-b44f-c9b3c4cb7aae tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Returning 404 to user: Snapshot 706f8b3a-cad0-4cc2-a6bd-0588b85606db could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:54:57.913581 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f932a4c0-abd2-44bb-b44f-c9b3c4cb7aae tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db" status: 404 len: 111 microversion: 2.1 time: 0.037572 Aug 24 06:54:57.914409 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1323/2672] 10.222.0.62 () {58 vars in 1251 bytes} [Wed Aug 24 06:54:57 2022] GET /compute/v2.1/os-snapshots/706f8b3a-cad0-4cc2-a6bd-0588b85606db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:54:57.917842 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-06845844-c68e-483a-adc9-4fed391417fe tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcde0b414c0>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:58.109612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-06845844-c68e-483a-adc9-4fed391417fe tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9" status: 202 len: 0 microversion: 2.1 time: 0.195740 Aug 24 06:54:58.110186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1350/2673] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 24 06:54:57 2022] DELETE /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 06:54:58.119629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2a1b6135-1758-4ca0-9bf9-a13b73684942 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcddc07a160>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:58.167117 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2a1b6135-1758-4ca0-9bf9-a13b73684942 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9" status: 200 len: 344 microversion: 2.1 time: 0.051937 Aug 24 06:54:58.171456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1324/2674] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 24 06:54:58 2022] GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:54:59.181927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-22dcb213-55e5-4fd9-8ac7-e434ae791605 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcddc179940>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:59.210734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-22dcb213-55e5-4fd9-8ac7-e434ae791605 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] HTTP exception thrown: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-22dcb213-55e5-4fd9-8ac7-e434ae791605 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Request method failure captured: Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9 HTTP/1.1 Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcs6TfkHvpDYvcAl5IhnQ94kSITMsFNi-MNR6unq1j1nGFSUus4Q9q1r9_rehEADc4li-mnUpCeoIK-AzcvSGnjR5EaFA2nXtNL5mmSjfOvh-XSDdJgYwFbQkzl2nF2mQC3syj4PCz-wRdXFEXKcTMFS-0jjnveV7jO0xueTTWogYMY Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: b497d4d51a85438a816a14e2455dd948 Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:54:59.213668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b497d4d51a85438a816a14e2455dd948", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: b497d4d51a85438a816a14e2455dd948 Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-VolumesSnapshotsTestJSON-340333213-project Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: e4837de70e5a460e899d696c7337bf78 Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-VolumesSnapshotsTestJSON-340333213-project Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '7342b2fe-2d38-4b20-9a1c-836b887b40d9'} Aug 24 06:54:59.215043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. (HTTP 404) (Request-ID: req-f95d1ed0-e470-4786-815b-85efc63327de) Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:59.215752 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:54:59.216855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 06:54:59.217833 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-22dcb213-55e5-4fd9-8ac7-e434ae791605 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Returning 404 to user: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-22dcb213-55e5-4fd9-8ac7-e434ae791605 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9" status: 404 len: 109 microversion: 2.1 time: 0.037761 Aug 24 06:54:59.218792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1351/2675] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 24 06:54:59 2022] GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:54:59.229165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c68ee1f7-8579-4811-a095-e62ad9c39bd8 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcddc0598b0>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:59.261816 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-c68ee1f7-8579-4811-a095-e62ad9c39bd8 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] HTTP exception thrown: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c68ee1f7-8579-4811-a095-e62ad9c39bd8 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Request method failure captured: Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: DELETE /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9 HTTP/1.1 Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcs6TfkHvpDYvcAl5IhnQ94kSITMsFNi-MNR6unq1j1nGFSUus4Q9q1r9_rehEADc4li-mnUpCeoIK-AzcvSGnjR5EaFA2nXtNL5mmSjfOvh-XSDdJgYwFbQkzl2nF2mQC3syj4PCz-wRdXFEXKcTMFS-0jjnveV7jO0xueTTWogYMY Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: b497d4d51a85438a816a14e2455dd948 Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:54:59.264584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b497d4d51a85438a816a14e2455dd948", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: b497d4d51a85438a816a14e2455dd948 Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-VolumesSnapshotsTestJSON-340333213-project Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: e4837de70e5a460e899d696c7337bf78 Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-VolumesSnapshotsTestJSON-340333213-project Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '7342b2fe-2d38-4b20-9a1c-836b887b40d9'} Aug 24 06:54:59.265812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. (HTTP 404) (Request-ID: req-e2d62c72-c469-42a8-a016-fdf77e1a9da5) Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:59.266547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 06:54:59.267588 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 06:54:59.269638 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c68ee1f7-8579-4811-a095-e62ad9c39bd8 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Returning 404 to user: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c68ee1f7-8579-4811-a095-e62ad9c39bd8 tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "DELETE /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9" status: 404 len: 109 microversion: 2.1 time: 0.042563 Aug 24 06:54:59.271877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1325/2676] 10.222.0.62 () {58 vars in 1248 bytes} [Wed Aug 24 06:54:59 2022] DELETE /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:54:59.279147 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-648c6a94-32c2-443a-be6e-87aed7192e2f tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Calling method '.version_select at 0x7fcddc142af0>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:54:59.310835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-648c6a94-32c2-443a-be6e-87aed7192e2f tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] HTTP exception thrown: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-648c6a94-32c2-443a-be6e-87aed7192e2f tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Request method failure captured: Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9 HTTP/1.1 Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcs6TfkHvpDYvcAl5IhnQ94kSITMsFNi-MNR6unq1j1nGFSUus4Q9q1r9_rehEADc4li-mnUpCeoIK-AzcvSGnjR5EaFA2nXtNL5mmSjfOvh-XSDdJgYwFbQkzl2nF2mQC3syj4PCz-wRdXFEXKcTMFS-0jjnveV7jO0xueTTWogYMY Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: b497d4d51a85438a816a14e2455dd948 Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:54:59.314082 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b497d4d51a85438a816a14e2455dd948"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b497d4d51a85438a816a14e2455dd948", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: b497d4d51a85438a816a14e2455dd948 Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-340333213 Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-VolumesSnapshotsTestJSON-340333213-project Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: e4837de70e5a460e899d696c7337bf78 Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-VolumesSnapshotsTestJSON-340333213-project Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '7342b2fe-2d38-4b20-9a1c-836b887b40d9'} Aug 24 06:54:59.315361 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. (HTTP 404) (Request-ID: req-a1ada852-6fd5-4f8c-ad9c-f001c75a68c0) Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:59.316306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 06:54:59.317385 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 06:54:59.318331 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-648c6a94-32c2-443a-be6e-87aed7192e2f tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] Returning 404 to user: Volume 7342b2fe-2d38-4b20-9a1c-836b887b40d9 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-648c6a94-32c2-443a-be6e-87aed7192e2f tempest-VolumesSnapshotsTestJSON-340333213 tempest-VolumesSnapshotsTestJSON-340333213-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9" status: 404 len: 109 microversion: 2.1 time: 0.042696 Aug 24 06:54:59.319267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1352/2677] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 24 06:54:59 2022] GET /compute/v2.1/os-volumes/7342b2fe-2d38-4b20-9a1c-836b887b40d9 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:55:03.308527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a22072e4-37f7-4fd8-b0fa-38ebde0dd268 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] Calling method '.version_select at 0x7fcdcff54820>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:03.354514 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a22072e4-37f7-4fd8-b0fa-38ebde0dd268 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/ba8bfdef-c1e8-4451-be4b-2bb12218785d" status: 200 len: 351 microversion: 2.1 time: 0.051337 Aug 24 06:55:03.355066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1326/2678] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 24 06:55:03 2022] GET /compute/v2.1/os-volumes/ba8bfdef-c1e8-4451-be4b-2bb12218785d => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:55:04.994251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=6 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:04.994972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=6 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:04.998750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-1df28749-f9fa-4d2d-a8f3-3e68a21f5b82 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] Calling method '.version_select at 0x7fcddc423940>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:05.046347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-1df28749-f9fa-4d2d-a8f3-3e68a21f5b82 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/08895dca-48ee-42ce-8295-6a94ce6687ee" status: 200 len: 351 microversion: 2.1 time: 0.055274 Aug 24 06:55:05.046914 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1353/2679] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 24 06:55:04 2022] GET /compute/v2.1/os-volumes/08895dca-48ee-42ce-8295-6a94ce6687ee => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:55:06.754256 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-020ebdb2-08b7-4e49-be06-c93147589db8 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] Calling method '.version_select at 0x7fcdcff8e3a0>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:06.799845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-020ebdb2-08b7-4e49-be06-c93147589db8 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/d01658a3-22d7-4d40-9770-ff978f92ff14" status: 200 len: 351 microversion: 2.1 time: 0.049933 Aug 24 06:55:06.800433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1327/2680] 10.222.0.62 () {58 vars in 1245 bytes} [Wed Aug 24 06:55:06 2022] GET /compute/v2.1/os-volumes/d01658a3-22d7-4d40-9770-ff978f92ff14 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:55:06.813416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-127cf884-4990-43a1-8a05-8bafc555ffc1 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] Calling method '.version_select at 0x7fcde0b59f70>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:06.893496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-127cf884-4990-43a1-8a05-8bafc555ffc1 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084407 Aug 24 06:55:06.894057 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1354/2681] 10.222.0.62 () {58 vars in 1134 bytes} [Wed Aug 24 06:55:06 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:06.907818 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9e10d6ad-9403-40d5-8a90-f52b72846937 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] Calling method '.version_select at 0x7fcdcff70b80>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:06.989964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9e10d6ad-9403-40d5-8a90-f52b72846937 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085810 Aug 24 06:55:06.990529 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1328/2682] 10.222.0.62 () {58 vars in 1149 bytes} [Wed Aug 24 06:55:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:55:07.003909 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8716ab26-b7cf-4be1-8b94-1c7055115e1e tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] Calling method '.version_select at 0x7fcddc150790>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:07.084899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8716ab26-b7cf-4be1-8b94-1c7055115e1e tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] 10.222.0.62 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.084600 Aug 24 06:55:07.085458 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1355/2683] 10.222.0.62 () {58 vars in 1134 bytes} [Wed Aug 24 06:55:06 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:07.098212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b8a820e4-2456-4100-9a32-0ae5048bf57d tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] Calling method '.version_select at 0x7fcddc05c550>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:07.178975 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b8a820e4-2456-4100-9a32-0ae5048bf57d tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] 10.222.0.62 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084405 Aug 24 06:55:07.179539 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1329/2684] 10.222.0.62 () {58 vars in 1167 bytes} [Wed Aug 24 06:55:07 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:55:07.192615 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-56009ec8-09ef-4923-b267-65bc4a43f935 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] Calling method '.version_select at 0x7fcddc156820>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:07.275524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-56009ec8-09ef-4923-b267-65bc4a43f935 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086277 Aug 24 06:55:07.278547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1356/2685] 10.222.0.62 () {58 vars in 1170 bytes} [Wed Aug 24 06:55:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:55:07.289005 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4afbd6e7-04a7-446d-91f7-1fe435d90230 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] Calling method '.version_select at 0x7fcddc05c3a0>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:07.369665 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4afbd6e7-04a7-446d-91f7-1fe435d90230 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.084324 Aug 24 06:55:07.370233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1330/2686] 10.222.0.62 () {58 vars in 1155 bytes} [Wed Aug 24 06:55:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:07.382945 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-cae3155b-54fa-4a52-8b2b-38e27709502d tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] Calling method '.version_select at 0x7fcde0b59a60>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:07.464636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-cae3155b-54fa-4a52-8b2b-38e27709502d tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085408 Aug 24 06:55:07.465195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1357/2687] 10.222.0.62 () {58 vars in 1188 bytes} [Wed Aug 24 06:55:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:55:07.477860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-94b1b7a2-c227-44ac-a030-b4bfee6389b6 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] Calling method '.version_select at 0x7fcdcff70ee0>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:07.560590 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-94b1b7a2-c227-44ac-a030-b4bfee6389b6 tempest-VolumesTestJSON-146551044 tempest-VolumesTestJSON-146551044-project] 10.222.0.62 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.086384 Aug 24 06:55:07.561155 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1331/2688] 10.222.0.62 () {58 vars in 1155 bytes} [Wed Aug 24 06:55:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:55:36.340093 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:55:36.340748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:55:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:55:37.635052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:37.635535 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:37.641655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:37.642138 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:37.642600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:37.643290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:37.643744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:37.644163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:37.657034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: DELETE /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 HTTP/1.1 Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:55:37.658575 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:55:37.659754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': 'ec8ec04b-3c19-4874-a301-4de2acda1c85'} Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:55:37.660459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:55:37.661679 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.662757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 404 to user: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:55:37.662757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7a3341d2-2bfc-4e20-8331-3666e3d1a1a6 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 404 len: 111 microversion: 2.1 time: 0.030060 Aug 24 06:55:37.662757 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1358/2689] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:55:37 2022] DELETE /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:55:37.670252 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:37.670901 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: ec8ec04b-3c19-4874-a301-4de2acda1c85] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:37.677066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:37.677544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:37.677970 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:37.678654 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:37.679100 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:37.679650 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:37.693980 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 HTTP/1.1 Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:55:37.695505 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:55:37.696831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': 'ec8ec04b-3c19-4874-a301-4de2acda1c85'} Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:55:37.697635 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. Aug 24 06:55:37.698796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.699748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 404 to user: Instance ec8ec04b-3c19-4874-a301-4de2acda1c85 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:55:37.699748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d2d66da2-78ea-4c71-9d9a-829fa3e87c02 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85" status: 404 len: 111 microversion: 2.1 time: 0.032321 Aug 24 06:55:37.699748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1332/2690] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:37 2022] GET /compute/v2.1/servers/ec8ec04b-3c19-4874-a301-4de2acda1c85 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:55:37.705676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:37.706179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:37.712287 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:37.712806 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:37.713239 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:37.713926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:37.714411 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:37.714832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:37.728662 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: DELETE /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 HTTP/1.1 Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 06:55:37.730177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:55:37.731552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '183454a1-0335-4121-8d9f-c6599b8f2532'} Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:55:37.732277 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:55:37.733342 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.734406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 404 to user: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:55:37.734406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-848cd639-03d0-4482-bf24-4c647a496d8c tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 404 len: 111 microversion: 2.1 time: 0.029800 Aug 24 06:55:37.734406 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1359/2691] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:55:37 2022] DELETE /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 06:55:37.740170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:55:37.740806 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 183454a1-0335-4121-8d9f-c6599b8f2532] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:55:37.747523 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:37.748211 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:37.748787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:37.749360 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:55:37.749807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:55:37.750223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:55:37.763827 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 HTTP/1.1 Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:55:37.767271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:55:37.768456 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '183454a1-0335-4121-8d9f-c6599b8f2532'} Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:55:37.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. Aug 24 06:55:37.770177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:55:37.771125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 404 to user: Instance 183454a1-0335-4121-8d9f-c6599b8f2532 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:55:37.771125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5c813cf9-84a6-4783-ad67-48c329f03f16 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532" status: 404 len: 111 microversion: 2.1 time: 0.030455 Aug 24 06:55:37.771125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1333/2692] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:55:37 2022] GET /compute/v2.1/servers/183454a1-0335-4121-8d9f-c6599b8f2532 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:56:17.532759 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=4 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:17.533498 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=4 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:17.696549 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-61eb07f9-ca5e-4cf1-96ca-a645ffe9d654 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Action: 'create', calling method: .version_select at 0x7fcddc156280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1493528279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQoIrMxigEKzoy4xL3rw0csXZ3dYwtg3v+nvrbLwWqzRhH35dET0RevRVQZRAwBhMBqc11uVnQs4TdnKzSr7pDUfW7bbMVmj8RSeBoxeujJHHXwiWEGmzklkqCTt5y8JQ=="}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:17.714986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-61eb07f9-ca5e-4cf1-96ca-a645ffe9d654 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Getting quotas for project 01a59a0e0c9e4e8fa1c0e147e720eccb. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:56:17.719274 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-61eb07f9-ca5e-4cf1-96ca-a645ffe9d654 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Getting quotas for user 86ff51618d4b4b71bfad73467ddc8585 and project 01a59a0e0c9e4e8fa1c0e147e720eccb. Resources: {'key_pairs'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:56:17.803339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-61eb07f9-ca5e-4cf1-96ca-a645ffe9d654 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.275390 Aug 24 06:56:17.804251 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1360/2693] 10.222.0.62 () {60 vars in 1159 bytes} [Wed Aug 24 06:56:17 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:56:36.077239 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1635151908", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1493528279", "security_groups": [{"name": "tempest-secgroup-smoke-353565614"}], "block_device_mapping_v2": [{"uuid": "f1d0776b-58d2-41d9-be98-ae02eb7e8d04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "08b4e612-3ec2-429b-ae98-81aca6c98b3f"}]}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:36.086946 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=4 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:36.087596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=4 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:36.191742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] validate_networks() for [('08b4e612-3ec2-429b-ae98-81aca6c98b3f', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:56:36.658126 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:56:36.658542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:56:36.659011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:56:36.659415 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:56:36.659820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:56:36.668352 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:36.668851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:36.669279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:36.669990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:36.670437 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:36.670848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:36.687201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Getting quotas for project 01a59a0e0c9e4e8fa1c0e147e720eccb. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:56:36.691049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Getting quotas for user 86ff51618d4b4b71bfad73467ddc8585 and project 01a59a0e0c9e4e8fa1c0e147e720eccb. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:56:36.748071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:56:36.750205 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1d0776b-58d2-41d9-be98-ae02eb7e8d04',volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:56:37.092359 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [a6b3a371-f144-4478-9b32-5f94474552de] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:56:38.099292 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [a6b3a371-f144-4478-9b32-5f94474552de] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41748. Aug 24 06:56:38.103610 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2c8c3d3b-ab57-4b16-bae1-a2ce4d9c7117 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.030398 Aug 24 06:56:38.104286 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1334/2694] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:56:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 2032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:56:38.112827 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=4 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:38.113703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:38.117585 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b92626ba-2bc9-4d3e-9a02-5c19df681b2e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:38.118766 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b92626ba-2bc9-4d3e-9a02-5c19df681b2e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:38.173412 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b92626ba-2bc9-4d3e-9a02-5c19df681b2e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:38.181751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b92626ba-2bc9-4d3e-9a02-5c19df681b2e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1095 microversion: 2.1 time: 0.070405 Aug 24 06:56:38.182322 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1361/2695] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:38 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:39.203434 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-f71c2206-e449-443f-be0b-a61716b98c32 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:39.203983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-f71c2206-e449-443f-be0b-a61716b98c32 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:39.210118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f71c2206-e449-443f-be0b-a61716b98c32 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:39.210593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f71c2206-e449-443f-be0b-a61716b98c32 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:39.211024 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f71c2206-e449-443f-be0b-a61716b98c32 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:39.211707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f71c2206-e449-443f-be0b-a61716b98c32 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:39.212153 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f71c2206-e449-443f-be0b-a61716b98c32 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:39.212604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-f71c2206-e449-443f-be0b-a61716b98c32 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:39.275850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-f71c2206-e449-443f-be0b-a61716b98c32 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:39.284290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-f71c2206-e449-443f-be0b-a61716b98c32 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1145 microversion: 2.1 time: 0.085378 Aug 24 06:56:39.284964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1335/2696] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:39 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:39.968430 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:56:39.968688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:56:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:56:40.305281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-f37cb8ac-7ccb-4402-98da-69111524c3a0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:40.306005 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-f37cb8ac-7ccb-4402-98da-69111524c3a0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:40.312614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f37cb8ac-7ccb-4402-98da-69111524c3a0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:40.313091 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f37cb8ac-7ccb-4402-98da-69111524c3a0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:40.313523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f37cb8ac-7ccb-4402-98da-69111524c3a0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:40.314214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f37cb8ac-7ccb-4402-98da-69111524c3a0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:40.314668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f37cb8ac-7ccb-4402-98da-69111524c3a0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:40.315089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-f37cb8ac-7ccb-4402-98da-69111524c3a0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:40.388065 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-f37cb8ac-7ccb-4402-98da-69111524c3a0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:40.395994 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-f37cb8ac-7ccb-4402-98da-69111524c3a0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1193 microversion: 2.1 time: 0.094640 Aug 24 06:56:40.396573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1362/2697] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:40 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:41.417329 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2e4be94b-789e-4416-8a98-7960fc848abb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:41.417949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2e4be94b-789e-4416-8a98-7960fc848abb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:41.424690 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e4be94b-789e-4416-8a98-7960fc848abb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:41.425333 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e4be94b-789e-4416-8a98-7960fc848abb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:41.425961 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e4be94b-789e-4416-8a98-7960fc848abb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:41.427316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e4be94b-789e-4416-8a98-7960fc848abb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:41.428324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e4be94b-789e-4416-8a98-7960fc848abb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:41.428324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2e4be94b-789e-4416-8a98-7960fc848abb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:41.583840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2e4be94b-789e-4416-8a98-7960fc848abb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:41.591899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2e4be94b-789e-4416-8a98-7960fc848abb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1278 microversion: 2.1 time: 0.178753 Aug 24 06:56:41.592464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1336/2698] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:41 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:56:42.319721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-98630000-9ff7-4e8d-a17c-a67a9cc00981 req-0fa65de2-847c-49b4-839c-f98d01371c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d8732e-df71-4dc8-bd71-6b4661901014", "tag": "87eacd63-b380-4c46-81cd-da9720620f4b"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:42.328777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-98630000-9ff7-4e8d-a17c-a67a9cc00981 req-0fa65de2-847c-49b4-839c-f98d01371c76 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:42.329247 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-98630000-9ff7-4e8d-a17c-a67a9cc00981 req-0fa65de2-847c-49b4-839c-f98d01371c76 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:42.329669 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-98630000-9ff7-4e8d-a17c-a67a9cc00981 req-0fa65de2-847c-49b4-839c-f98d01371c76 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:42.340809 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-98630000-9ff7-4e8d-a17c-a67a9cc00981 req-0fa65de2-847c-49b4-839c-f98d01371c76 service nova] Creating event network-changed:87eacd63-b380-4c46-81cd-da9720620f4b for instance 26d8732e-df71-4dc8-bd71-6b4661901014 on hv-cinder-85426 Aug 24 06:56:42.344052 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR oslo.messaging._drivers.impl_rabbit [req-98630000-9ff7-4e8d-a17c-a67a9cc00981 req-0fa65de2-847c-49b4-839c-f98d01371c76 service nova] [a4baf55b-27fa-42f3-ac12-c4deed60337c] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:56:42.632051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5a4ec2ac-0673-40a0-88cf-f2554bc0938e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:42.632051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5a4ec2ac-0673-40a0-88cf-f2554bc0938e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:42.632051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a4ec2ac-0673-40a0-88cf-f2554bc0938e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:42.632051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a4ec2ac-0673-40a0-88cf-f2554bc0938e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:42.632773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a4ec2ac-0673-40a0-88cf-f2554bc0938e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:42.632773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a4ec2ac-0673-40a0-88cf-f2554bc0938e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:42.632773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a4ec2ac-0673-40a0-88cf-f2554bc0938e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:42.632773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5a4ec2ac-0673-40a0-88cf-f2554bc0938e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:42.764887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5a4ec2ac-0673-40a0-88cf-f2554bc0938e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:42.773745 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5a4ec2ac-0673-40a0-88cf-f2554bc0938e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1266 microversion: 2.1 time: 0.158606 Aug 24 06:56:42.774547 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1337/2699] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:42 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:56:43.350529 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [req-98630000-9ff7-4e8d-a17c-a67a9cc00981 req-0fa65de2-847c-49b4-839c-f98d01371c76 service nova] [a4baf55b-27fa-42f3-ac12-c4deed60337c] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 41788. Aug 24 06:56:43.354678 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-98630000-9ff7-4e8d-a17c-a67a9cc00981 req-0fa65de2-847c-49b4-839c-f98d01371c76 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.095811 Aug 24 06:56:43.355266 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1363/2700] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:56:43.795244 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-1ba6f8d8-e037-4a00-8698-89d57adeca58 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:43.795855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-1ba6f8d8-e037-4a00-8698-89d57adeca58 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:43.802394 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba6f8d8-e037-4a00-8698-89d57adeca58 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:43.802880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba6f8d8-e037-4a00-8698-89d57adeca58 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:43.803313 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba6f8d8-e037-4a00-8698-89d57adeca58 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:43.804006 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba6f8d8-e037-4a00-8698-89d57adeca58 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:43.804466 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba6f8d8-e037-4a00-8698-89d57adeca58 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:43.804913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-1ba6f8d8-e037-4a00-8698-89d57adeca58 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:43.940766 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-1ba6f8d8-e037-4a00-8698-89d57adeca58 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:43.948612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-1ba6f8d8-e037-4a00-8698-89d57adeca58 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1266 microversion: 2.1 time: 0.157247 Aug 24 06:56:43.949167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1338/2701] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:43 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:44.969744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c238df55-896f-4680-beb1-0b5fd61d7ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:44.970422 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c238df55-896f-4680-beb1-0b5fd61d7ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:44.976541 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c238df55-896f-4680-beb1-0b5fd61d7ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:44.977023 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c238df55-896f-4680-beb1-0b5fd61d7ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:44.977442 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c238df55-896f-4680-beb1-0b5fd61d7ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:44.978106 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c238df55-896f-4680-beb1-0b5fd61d7ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:44.978546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c238df55-896f-4680-beb1-0b5fd61d7ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:44.978958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c238df55-896f-4680-beb1-0b5fd61d7ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:45.110899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c238df55-896f-4680-beb1-0b5fd61d7ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:45.119317 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c238df55-896f-4680-beb1-0b5fd61d7ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1266 microversion: 2.1 time: 0.154206 Aug 24 06:56:45.119872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1364/2702] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:44 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:45.893263 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:56:45.893412 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 06:56:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 06:56:46.139738 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-50c5de56-1e69-4777-9462-7e9f1d54023c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:46.140290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-50c5de56-1e69-4777-9462-7e9f1d54023c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:46.146263 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50c5de56-1e69-4777-9462-7e9f1d54023c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:46.146736 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50c5de56-1e69-4777-9462-7e9f1d54023c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:46.147165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50c5de56-1e69-4777-9462-7e9f1d54023c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:46.147839 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50c5de56-1e69-4777-9462-7e9f1d54023c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:46.148283 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50c5de56-1e69-4777-9462-7e9f1d54023c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:46.148721 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-50c5de56-1e69-4777-9462-7e9f1d54023c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:46.277473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-50c5de56-1e69-4777-9462-7e9f1d54023c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:46.285204 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-50c5de56-1e69-4777-9462-7e9f1d54023c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1266 microversion: 2.1 time: 0.149596 Aug 24 06:56:46.285764 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1339/2703] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:46 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:47.307226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-573cff93-d4cf-423e-be59-2e292add3915 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:47.307832 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-573cff93-d4cf-423e-be59-2e292add3915 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:47.314434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-573cff93-d4cf-423e-be59-2e292add3915 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:47.314908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-573cff93-d4cf-423e-be59-2e292add3915 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:47.315332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-573cff93-d4cf-423e-be59-2e292add3915 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:47.316011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-573cff93-d4cf-423e-be59-2e292add3915 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:47.316459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-573cff93-d4cf-423e-be59-2e292add3915 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:47.316901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-573cff93-d4cf-423e-be59-2e292add3915 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:47.447645 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-573cff93-d4cf-423e-be59-2e292add3915 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:47.455547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-573cff93-d4cf-423e-be59-2e292add3915 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1266 microversion: 2.1 time: 0.152972 Aug 24 06:56:47.456162 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1365/2704] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:47 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:48.475262 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-14c3ff13-2c8a-4899-b988-4f5007682cc2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:48.475882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-14c3ff13-2c8a-4899-b988-4f5007682cc2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:48.477708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:48.478366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=6 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:48.483613 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14c3ff13-2c8a-4899-b988-4f5007682cc2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:48.484092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14c3ff13-2c8a-4899-b988-4f5007682cc2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:48.484540 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14c3ff13-2c8a-4899-b988-4f5007682cc2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:48.485321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14c3ff13-2c8a-4899-b988-4f5007682cc2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:48.485773 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14c3ff13-2c8a-4899-b988-4f5007682cc2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:48.486186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-14c3ff13-2c8a-4899-b988-4f5007682cc2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:48.619032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-14c3ff13-2c8a-4899-b988-4f5007682cc2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:48.626854 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-14c3ff13-2c8a-4899-b988-4f5007682cc2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1266 microversion: 2.1 time: 0.155452 Aug 24 06:56:48.627421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1340/2705] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:48 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:49.647302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0f86eccc-9132-43f9-9772-cd3b84dd264a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:49.647900 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0f86eccc-9132-43f9-9772-cd3b84dd264a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:49.649815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:49.654997 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f86eccc-9132-43f9-9772-cd3b84dd264a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:49.655469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f86eccc-9132-43f9-9772-cd3b84dd264a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:49.655895 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f86eccc-9132-43f9-9772-cd3b84dd264a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:49.656592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f86eccc-9132-43f9-9772-cd3b84dd264a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:49.657034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f86eccc-9132-43f9-9772-cd3b84dd264a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:49.662668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0f86eccc-9132-43f9-9772-cd3b84dd264a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:49.794084 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0f86eccc-9132-43f9-9772-cd3b84dd264a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:49.801700 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0f86eccc-9132-43f9-9772-cd3b84dd264a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1266 microversion: 2.1 time: 0.158330 Aug 24 06:56:49.802259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1366/2706] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:49 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:50.822309 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-93d5be97-cd2c-45ec-97f7-f74f9db8c8b7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:50.822938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-93d5be97-cd2c-45ec-97f7-f74f9db8c8b7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:50.829328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93d5be97-cd2c-45ec-97f7-f74f9db8c8b7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:50.829799 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93d5be97-cd2c-45ec-97f7-f74f9db8c8b7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:50.830227 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93d5be97-cd2c-45ec-97f7-f74f9db8c8b7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:50.830902 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93d5be97-cd2c-45ec-97f7-f74f9db8c8b7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:50.831346 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93d5be97-cd2c-45ec-97f7-f74f9db8c8b7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:50.831762 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-93d5be97-cd2c-45ec-97f7-f74f9db8c8b7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:50.967714 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-93d5be97-cd2c-45ec-97f7-f74f9db8c8b7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:50.975519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-93d5be97-cd2c-45ec-97f7-f74f9db8c8b7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1266 microversion: 2.1 time: 0.157315 Aug 24 06:56:50.976013 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1341/2707] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:50 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:51.996423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-55a20199-29ac-4ed2-90b7-f93c13ce07d4 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:51.996991 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-55a20199-29ac-4ed2-90b7-f93c13ce07d4 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:52.004054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a20199-29ac-4ed2-90b7-f93c13ce07d4 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:52.004546 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a20199-29ac-4ed2-90b7-f93c13ce07d4 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:52.004978 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a20199-29ac-4ed2-90b7-f93c13ce07d4 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:52.005652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a20199-29ac-4ed2-90b7-f93c13ce07d4 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:52.006098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a20199-29ac-4ed2-90b7-f93c13ce07d4 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:52.006512 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-55a20199-29ac-4ed2-90b7-f93c13ce07d4 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:52.142985 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-55a20199-29ac-4ed2-90b7-f93c13ce07d4 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:52.150973 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-55a20199-29ac-4ed2-90b7-f93c13ce07d4 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1266 microversion: 2.1 time: 0.158957 Aug 24 06:56:52.151567 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1367/2708] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:51 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:53.171421 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-7ff26f3d-0980-482c-b386-f8eb45b1feb0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:53.172048 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-7ff26f3d-0980-482c-b386-f8eb45b1feb0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:53.178517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ff26f3d-0980-482c-b386-f8eb45b1feb0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:53.179003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ff26f3d-0980-482c-b386-f8eb45b1feb0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:53.179438 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ff26f3d-0980-482c-b386-f8eb45b1feb0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:53.180167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ff26f3d-0980-482c-b386-f8eb45b1feb0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:53.181145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ff26f3d-0980-482c-b386-f8eb45b1feb0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:53.181562 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-7ff26f3d-0980-482c-b386-f8eb45b1feb0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:53.326469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-e5a212ee-af42-4a67-8621-7231ae660576 req-51c8f28b-245c-40d6-98c5-bfcb0eee0865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d8732e-df71-4dc8-bd71-6b4661901014", "name": "network-vif-plugged", "status": "completed", "tag": "87eacd63-b380-4c46-81cd-da9720620f4b"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:53.329220 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-7ff26f3d-0980-482c-b386-f8eb45b1feb0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:53.336977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-7ff26f3d-0980-482c-b386-f8eb45b1feb0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1266 microversion: 2.1 time: 0.169214 Aug 24 06:56:53.345158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1342/2709] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:53 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:53.345452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-e5a212ee-af42-4a67-8621-7231ae660576 req-51c8f28b-245c-40d6-98c5-bfcb0eee0865 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:53.345452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-e5a212ee-af42-4a67-8621-7231ae660576 req-51c8f28b-245c-40d6-98c5-bfcb0eee0865 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:53.345452 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-e5a212ee-af42-4a67-8621-7231ae660576 req-51c8f28b-245c-40d6-98c5-bfcb0eee0865 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:53.357144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-e5a212ee-af42-4a67-8621-7231ae660576 req-51c8f28b-245c-40d6-98c5-bfcb0eee0865 service nova] Creating event network-vif-plugged:87eacd63-b380-4c46-81cd-da9720620f4b for instance 26d8732e-df71-4dc8-bd71-6b4661901014 on hv-cinder-85426 Aug 24 06:56:53.362218 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-e5a212ee-af42-4a67-8621-7231ae660576 req-51c8f28b-245c-40d6-98c5-bfcb0eee0865 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154068 Aug 24 06:56:53.362906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1368/2710] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 06:56:54.356915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a8675e7b-4eb1-415d-ae5c-69cbd4c1313c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:54.357517 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a8675e7b-4eb1-415d-ae5c-69cbd4c1313c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:54.363841 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8675e7b-4eb1-415d-ae5c-69cbd4c1313c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:54.364310 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8675e7b-4eb1-415d-ae5c-69cbd4c1313c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:54.364769 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8675e7b-4eb1-415d-ae5c-69cbd4c1313c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:54.365446 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8675e7b-4eb1-415d-ae5c-69cbd4c1313c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:54.365893 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8675e7b-4eb1-415d-ae5c-69cbd4c1313c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:54.366306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a8675e7b-4eb1-415d-ae5c-69cbd4c1313c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:54.497649 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a8675e7b-4eb1-415d-ae5c-69cbd4c1313c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:54.505287 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a8675e7b-4eb1-415d-ae5c-69cbd4c1313c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1266 microversion: 2.1 time: 0.152156 Aug 24 06:56:54.505850 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1343/2711] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:54 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:55.527142 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-126390e5-c630-47ea-8b13-212f9251574d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:55.527737 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-126390e5-c630-47ea-8b13-212f9251574d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:55.533834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-126390e5-c630-47ea-8b13-212f9251574d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:55.534306 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-126390e5-c630-47ea-8b13-212f9251574d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:55.534733 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-126390e5-c630-47ea-8b13-212f9251574d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:55.535436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-126390e5-c630-47ea-8b13-212f9251574d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:55.535879 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-126390e5-c630-47ea-8b13-212f9251574d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:55.536302 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-126390e5-c630-47ea-8b13-212f9251574d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:55.668045 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-126390e5-c630-47ea-8b13-212f9251574d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:55.675623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-126390e5-c630-47ea-8b13-212f9251574d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1454 microversion: 2.1 time: 0.153862 Aug 24 06:56:55.676169 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1369/2712] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:55 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:55.695550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-71697942-ac51-4176-8bc9-236687c909d8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:56:55.696681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-71697942-ac51-4176-8bc9-236687c909d8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:56:55.703299 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71697942-ac51-4176-8bc9-236687c909d8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:55.703790 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71697942-ac51-4176-8bc9-236687c909d8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:55.704226 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71697942-ac51-4176-8bc9-236687c909d8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:55.704972 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71697942-ac51-4176-8bc9-236687c909d8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:55.705427 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71697942-ac51-4176-8bc9-236687c909d8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:55.705856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-71697942-ac51-4176-8bc9-236687c909d8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:55.835366 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-71697942-ac51-4176-8bc9-236687c909d8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:56:55.843604 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-71697942-ac51-4176-8bc9-236687c909d8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1454 microversion: 2.1 time: 0.152252 Aug 24 06:56:55.844169 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1344/2713] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:56:55 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:56:58.183245 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-18cd5854-851f-47dc-8374-b692c625122f req-1caf85f0-caf8-4364-b078-8ac728b346bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d8732e-df71-4dc8-bd71-6b4661901014", "tag": "87eacd63-b380-4c46-81cd-da9720620f4b"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:56:58.192691 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-18cd5854-851f-47dc-8374-b692c625122f req-1caf85f0-caf8-4364-b078-8ac728b346bf service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:56:58.193164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-18cd5854-851f-47dc-8374-b692c625122f req-1caf85f0-caf8-4364-b078-8ac728b346bf service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:56:58.193592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-18cd5854-851f-47dc-8374-b692c625122f req-1caf85f0-caf8-4364-b078-8ac728b346bf service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:56:58.205502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-18cd5854-851f-47dc-8374-b692c625122f req-1caf85f0-caf8-4364-b078-8ac728b346bf service nova] Creating event network-changed:87eacd63-b380-4c46-81cd-da9720620f4b for instance 26d8732e-df71-4dc8-bd71-6b4661901014 on hv-cinder-85426 Aug 24 06:56:58.210509 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-18cd5854-851f-47dc-8374-b692c625122f req-1caf85f0-caf8-4364-b078-8ac728b346bf service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090633 Aug 24 06:56:58.211099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1370/2714] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:58:52.336886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09c26f46-ce31-4745-8a66-229ed6a232e3] AMQP server on 10.222.0.62:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 06:58:52.337536 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:52.338620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=62 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:52.342794 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:52.343317 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:52.350177 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:52.354111 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:52.354111 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:52.354111 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:52.354111 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:52.354605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:52.380669 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 06:58:52.542072 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [6a6fc95c-c399-42da-94e1-2f53132ea67c] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:58:53.345873 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] [09c26f46-ce31-4745-8a66-229ed6a232e3] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 42108. Aug 24 06:58:53.550532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [6a6fc95c-c399-42da-94e1-2f53132ea67c] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 42112. Aug 24 06:58:53.664355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-c7333caa-97d6-41d7-96bf-d5fd546e3eab tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "DELETE /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 204 len: 0 microversion: 2.1 time: 1.330183 Aug 24 06:58:53.665165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1345/2715] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 06:58:52 2022] DELETE /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 0 bytes in 1332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 06:58:53.672144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ef1e0970-9ea8-4035-8bd7-5d475c4a624f] AMQP server on 10.222.0.62:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 06:58:53.672980 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=22 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:53.673780 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=42 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:53.678998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7883ace7-3b96-4606-8c26-e38b178d32a5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:53.686646 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7883ace7-3b96-4606-8c26-e38b178d32a5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:53.686646 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7883ace7-3b96-4606-8c26-e38b178d32a5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:53.687102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7883ace7-3b96-4606-8c26-e38b178d32a5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:53.687536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7883ace7-3b96-4606-8c26-e38b178d32a5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:53.688249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7883ace7-3b96-4606-8c26-e38b178d32a5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:53.688731 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7883ace7-3b96-4606-8c26-e38b178d32a5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:53.689171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7883ace7-3b96-4606-8c26-e38b178d32a5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:53.863455 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7883ace7-3b96-4606-8c26-e38b178d32a5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:58:53.871853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7883ace7-3b96-4606-8c26-e38b178d32a5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1579 microversion: 2.1 time: 0.201699 Aug 24 06:58:53.872460 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1371/2716] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:58:53 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1579 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:58:54.894965 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-dbe8807d-ce98-42b9-9676-6e1f0f4aa9f5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:54.895561 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-dbe8807d-ce98-42b9-9676-6e1f0f4aa9f5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:54.903461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dbe8807d-ce98-42b9-9676-6e1f0f4aa9f5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:54.903944 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dbe8807d-ce98-42b9-9676-6e1f0f4aa9f5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:54.904382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dbe8807d-ce98-42b9-9676-6e1f0f4aa9f5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:54.905116 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dbe8807d-ce98-42b9-9676-6e1f0f4aa9f5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:54.905571 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dbe8807d-ce98-42b9-9676-6e1f0f4aa9f5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:54.906004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-dbe8807d-ce98-42b9-9676-6e1f0f4aa9f5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:55.046976 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-dbe8807d-ce98-42b9-9676-6e1f0f4aa9f5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:58:55.055859 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-dbe8807d-ce98-42b9-9676-6e1f0f4aa9f5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1579 microversion: 2.1 time: 0.165172 Aug 24 06:58:55.056444 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1346/2717] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:58:54 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1579 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:58:56.082967 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7e6b99ca-d250-42ec-bc70-011185ce3ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:56.084405 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7e6b99ca-d250-42ec-bc70-011185ce3ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:56.102230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] [ef1e0970-9ea8-4035-8bd7-5d475c4a624f] Reconnected to AMQP server on 10.222.0.62:5672 via [amqp] client with port 42128. Aug 24 06:58:56.110583 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e6b99ca-d250-42ec-bc70-011185ce3ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:56.111398 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e6b99ca-d250-42ec-bc70-011185ce3ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:56.112235 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e6b99ca-d250-42ec-bc70-011185ce3ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:56.113692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e6b99ca-d250-42ec-bc70-011185ce3ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:56.114592 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e6b99ca-d250-42ec-bc70-011185ce3ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:56.115397 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7e6b99ca-d250-42ec-bc70-011185ce3ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:56.356811 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-7e6b99ca-d250-42ec-bc70-011185ce3ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:58:56.365237 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7e6b99ca-d250-42ec-bc70-011185ce3ac2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1512 microversion: 2.1 time: 0.290001 Aug 24 06:58:56.365818 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1372/2718] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:58:56 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1512 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:58:56.453617 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-50de3177-5499-4bc2-8f28-84fac480c2e9 req-d617a5c5-685b-4371-b3a7-963ef7eb63ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d8732e-df71-4dc8-bd71-6b4661901014", "name": "network-vif-deleted", "tag": "87eacd63-b380-4c46-81cd-da9720620f4b"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:58:56.467589 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-50de3177-5499-4bc2-8f28-84fac480c2e9 req-d617a5c5-685b-4371-b3a7-963ef7eb63ee service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:56.468172 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-50de3177-5499-4bc2-8f28-84fac480c2e9 req-d617a5c5-685b-4371-b3a7-963ef7eb63ee service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:56.468725 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-50de3177-5499-4bc2-8f28-84fac480c2e9 req-d617a5c5-685b-4371-b3a7-963ef7eb63ee service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:56.481340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-50de3177-5499-4bc2-8f28-84fac480c2e9 req-d617a5c5-685b-4371-b3a7-963ef7eb63ee service nova] Creating event network-vif-deleted:87eacd63-b380-4c46-81cd-da9720620f4b for instance 26d8732e-df71-4dc8-bd71-6b4661901014 on hv-cinder-85426 Aug 24 06:58:56.487118 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-50de3177-5499-4bc2-8f28-84fac480c2e9 req-d617a5c5-685b-4371-b3a7-963ef7eb63ee service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037092 Aug 24 06:58:56.488258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1347/2719] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:58:57.406415 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:57.407520 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:57.420418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:57.421966 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:57.422800 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:57.424140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:57.425802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:57.425959 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:57.487110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:57.487602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:57.488046 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:57.488531 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lazy-loading 'fault' on Instance uuid 26d8732e-df71-4dc8-bd71-6b4661901014 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 06:58:57.543288 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:58:57.557989 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bde64a19-d08c-4a2d-a27c-9af0141efeca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 200 len: 1231 microversion: 2.1 time: 0.159086 Aug 24 06:58:57.559283 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1373/2720] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:58:57 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 1231 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:58:58.580553 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:58:58.581265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:58:58.588371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:58.588884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:58.589316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:58.590011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:58.590483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:58.590919 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:58.606437 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] HTTP exception thrown: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Request method failure captured: Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 HTTP/1.1 Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcuKa2ZjppihEYFUcT_dfj0QOF5SQhcB8_CykhTOKUrboZLWMiRrMEDRR470KQDBN2h6ypn-XVgrqE8z9Xi6MHlNOWk0sFXrf3jK2s4hF3o9w9xGggO16AOH32V9zdio038jhhQnHlkwGvnrltlTfRJKsjoeB3cKIN0YqfOS2FIfVKU Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: 01a59a0e0c9e4e8fa1c0e147e720eccb Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-TestVolumeBootPattern-1712330690 Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 06:58:58.608133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_01a59a0e0c9e4e8fa1c0e147e720eccb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-TestVolumeBootPattern-1712330690 Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: 01a59a0e0c9e4e8fa1c0e147e720eccb Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712330690 Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-TestVolumeBootPattern-1712330690-project Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 86ff51618d4b4b71bfad73467ddc8585 Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-TestVolumeBootPattern-1712330690-project Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 06:58:58.609527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '26d8732e-df71-4dc8-bd71-6b4661901014'} Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 06:58:58.610350 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 06:58:58.611685 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 06:58:58.612930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Returning 404 to user: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 06:58:58.612930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-35c90c28-26b1-4480-bb8e-f500207fa472 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 404 len: 111 microversion: 2.1 time: 0.033298 Aug 24 06:58:58.612930 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1348/2721] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:58:58 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 06:58:58.669918 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-608253999", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1493528279", "security_groups": [{"name": "tempest-secgroup-smoke-353565614"}], "block_device_mapping_v2": [{"uuid": "f1d0776b-58d2-41d9-be98-ae02eb7e8d04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "08b4e612-3ec2-429b-ae98-81aca6c98b3f"}]}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:58:58.799705 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.network.neutron [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] validate_networks() for [('08b4e612-3ec2-429b-ae98-81aca6c98b3f', None, None, None, None, None)] {{(pid=121150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 06:58:59.302477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Flavor limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 06:58:59.302960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Image limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 06:58:59.303581 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Flavor pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 06:58:59.304381 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Image pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 06:58:59.305011 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 06:58:59.321029 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:59.321957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:59.323010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:59.324565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:58:59.325817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:58:59.326617 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:58:59.363463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Getting quotas for project 01a59a0e0c9e4e8fa1c0e147e720eccb. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 06:58:59.371435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Getting quotas for user 86ff51618d4b4b71bfad73467ddc8585 and project 01a59a0e0c9e4e8fa1c0e147e720eccb. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 06:58:59.436547 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Going to run 1 instances... {{(pid=121150) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 06:58:59.438687 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1d0776b-58d2-41d9-be98-ae02eb7e8d04',volume_size=None,volume_type=None)] {{(pid=121150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 06:59:00.087986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-64775ff5-0f38-46fe-b1dc-965f8766267e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.422320 Aug 24 06:59:00.089118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1374/2722] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 06:58:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 06:59:00.107159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-69051299-cdcd-403c-9f43-6d9b8ea92ba0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:00.109445 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-69051299-cdcd-403c-9f43-6d9b8ea92ba0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:00.207694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-69051299-cdcd-403c-9f43-6d9b8ea92ba0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:00.216935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-69051299-cdcd-403c-9f43-6d9b8ea92ba0 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1094 microversion: 2.1 time: 0.116621 Aug 24 06:59:00.218195 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1349/2723] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:00 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1094 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:59:01.239195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b158ecbd-29ad-41e0-ac1d-4f97cab068d2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:01.240433 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b158ecbd-29ad-41e0-ac1d-4f97cab068d2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:01.247341 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b158ecbd-29ad-41e0-ac1d-4f97cab068d2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:01.247830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b158ecbd-29ad-41e0-ac1d-4f97cab068d2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:01.248301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b158ecbd-29ad-41e0-ac1d-4f97cab068d2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:01.249050 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b158ecbd-29ad-41e0-ac1d-4f97cab068d2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:01.249499 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b158ecbd-29ad-41e0-ac1d-4f97cab068d2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:01.249920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b158ecbd-29ad-41e0-ac1d-4f97cab068d2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:01.323866 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b158ecbd-29ad-41e0-ac1d-4f97cab068d2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:01.332019 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b158ecbd-29ad-41e0-ac1d-4f97cab068d2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1144 microversion: 2.1 time: 0.097375 Aug 24 06:59:01.332609 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1375/2724] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:01 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:02.355035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-10fdd7c7-5bba-48db-a715-6a29b8954b0c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:02.355988 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-10fdd7c7-5bba-48db-a715-6a29b8954b0c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:02.362856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10fdd7c7-5bba-48db-a715-6a29b8954b0c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:02.363338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10fdd7c7-5bba-48db-a715-6a29b8954b0c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:02.363765 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10fdd7c7-5bba-48db-a715-6a29b8954b0c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:02.365337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10fdd7c7-5bba-48db-a715-6a29b8954b0c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:02.365789 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10fdd7c7-5bba-48db-a715-6a29b8954b0c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:02.366207 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-10fdd7c7-5bba-48db-a715-6a29b8954b0c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:02.605567 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-10fdd7c7-5bba-48db-a715-6a29b8954b0c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:02.614433 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-10fdd7c7-5bba-48db-a715-6a29b8954b0c tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1192 microversion: 2.1 time: 0.263347 Aug 24 06:59:02.615057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1350/2725] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:02 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1192 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:03.636419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e8262c4d-370a-4c9a-bfc4-6aa8689665f6 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:03.637423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e8262c4d-370a-4c9a-bfc4-6aa8689665f6 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:03.644730 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8262c4d-370a-4c9a-bfc4-6aa8689665f6 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:03.645252 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8262c4d-370a-4c9a-bfc4-6aa8689665f6 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:03.645692 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8262c4d-370a-4c9a-bfc4-6aa8689665f6 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:03.646438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8262c4d-370a-4c9a-bfc4-6aa8689665f6 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:03.646899 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8262c4d-370a-4c9a-bfc4-6aa8689665f6 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:03.647363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e8262c4d-370a-4c9a-bfc4-6aa8689665f6 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:03.978655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e8262c4d-370a-4c9a-bfc4-6aa8689665f6 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:03.997075 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e8262c4d-370a-4c9a-bfc4-6aa8689665f6 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1277 microversion: 2.1 time: 0.364257 Aug 24 06:59:04.008777 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1376/2726] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:03 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1277 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:59:04.609968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-5b024bbe-8f87-479e-88ee-13a20aebed8f req-5a671068-4976-4718-9a97-6f7a9e3983f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4c673a-0707-4178-9dbc-236ddd8c0d51", "tag": "70e3bcc9-9005-4f9e-8a33-18bf4f587489"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:59:04.620924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-5b024bbe-8f87-479e-88ee-13a20aebed8f req-5a671068-4976-4718-9a97-6f7a9e3983f1 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:04.621399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-5b024bbe-8f87-479e-88ee-13a20aebed8f req-5a671068-4976-4718-9a97-6f7a9e3983f1 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:04.621832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-5b024bbe-8f87-479e-88ee-13a20aebed8f req-5a671068-4976-4718-9a97-6f7a9e3983f1 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:04.633586 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-5b024bbe-8f87-479e-88ee-13a20aebed8f req-5a671068-4976-4718-9a97-6f7a9e3983f1 service nova] Creating event network-changed:70e3bcc9-9005-4f9e-8a33-18bf4f587489 for instance cf4c673a-0707-4178-9dbc-236ddd8c0d51 on hv-cinder-85426 Aug 24 06:59:04.638968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-5b024bbe-8f87-479e-88ee-13a20aebed8f req-5a671068-4976-4718-9a97-6f7a9e3983f1 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032714 Aug 24 06:59:04.639572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1351/2727] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:59:05.028716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6d74f424-325a-4af0-b5c4-0aa54a662fdd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:05.029993 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6d74f424-325a-4af0-b5c4-0aa54a662fdd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:05.037878 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d74f424-325a-4af0-b5c4-0aa54a662fdd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:05.038354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d74f424-325a-4af0-b5c4-0aa54a662fdd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:05.038844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d74f424-325a-4af0-b5c4-0aa54a662fdd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:05.039569 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d74f424-325a-4af0-b5c4-0aa54a662fdd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:05.040019 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d74f424-325a-4af0-b5c4-0aa54a662fdd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:05.040436 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6d74f424-325a-4af0-b5c4-0aa54a662fdd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:05.253602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6d74f424-325a-4af0-b5c4-0aa54a662fdd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:05.268363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6d74f424-325a-4af0-b5c4-0aa54a662fdd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1265 microversion: 2.1 time: 0.242906 Aug 24 06:59:05.269607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1377/2728] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:05 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1265 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:06.291865 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-cdd0ccba-0e0d-4ade-a245-c6eb9a7c519e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:06.292602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-cdd0ccba-0e0d-4ade-a245-c6eb9a7c519e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:06.299486 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdd0ccba-0e0d-4ade-a245-c6eb9a7c519e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:06.300091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdd0ccba-0e0d-4ade-a245-c6eb9a7c519e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:06.300552 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdd0ccba-0e0d-4ade-a245-c6eb9a7c519e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:06.301265 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdd0ccba-0e0d-4ade-a245-c6eb9a7c519e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:06.302425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdd0ccba-0e0d-4ade-a245-c6eb9a7c519e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:06.304977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-cdd0ccba-0e0d-4ade-a245-c6eb9a7c519e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:06.452856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-cdd0ccba-0e0d-4ade-a245-c6eb9a7c519e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:06.461026 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-cdd0ccba-0e0d-4ade-a245-c6eb9a7c519e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1265 microversion: 2.1 time: 0.174008 Aug 24 06:59:06.461600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1352/2729] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:06 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:07.481888 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a5f4f82f-c8e3-4403-9ce2-45eb7ad69aba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:07.482468 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a5f4f82f-c8e3-4403-9ce2-45eb7ad69aba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:07.488938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f4f82f-c8e3-4403-9ce2-45eb7ad69aba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:07.489443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f4f82f-c8e3-4403-9ce2-45eb7ad69aba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:07.490477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f4f82f-c8e3-4403-9ce2-45eb7ad69aba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:07.491159 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f4f82f-c8e3-4403-9ce2-45eb7ad69aba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:07.491604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f4f82f-c8e3-4403-9ce2-45eb7ad69aba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:07.492021 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a5f4f82f-c8e3-4403-9ce2-45eb7ad69aba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:07.624781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a5f4f82f-c8e3-4403-9ce2-45eb7ad69aba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:07.632999 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a5f4f82f-c8e3-4403-9ce2-45eb7ad69aba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1265 microversion: 2.1 time: 0.154989 Aug 24 06:59:07.633607 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1378/2730] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:07 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:08.653957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-fb9223d8-9f4d-4e9e-a55c-b40c993f5a51 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:08.654743 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-fb9223d8-9f4d-4e9e-a55c-b40c993f5a51 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:08.661880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb9223d8-9f4d-4e9e-a55c-b40c993f5a51 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:08.662362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb9223d8-9f4d-4e9e-a55c-b40c993f5a51 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:08.663238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb9223d8-9f4d-4e9e-a55c-b40c993f5a51 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:08.663544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb9223d8-9f4d-4e9e-a55c-b40c993f5a51 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:08.663990 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb9223d8-9f4d-4e9e-a55c-b40c993f5a51 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:08.664398 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-fb9223d8-9f4d-4e9e-a55c-b40c993f5a51 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:08.810401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-fb9223d8-9f4d-4e9e-a55c-b40c993f5a51 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:08.818875 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-fb9223d8-9f4d-4e9e-a55c-b40c993f5a51 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1265 microversion: 2.1 time: 0.168909 Aug 24 06:59:08.819440 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1353/2731] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:08 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:59:09.844200 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fb99e555-21d8-4bd1-a25b-9b7a82fb16ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:09.845309 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fb99e555-21d8-4bd1-a25b-9b7a82fb16ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:09.849418 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:09.850565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=6 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:09.859484 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb99e555-21d8-4bd1-a25b-9b7a82fb16ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:09.875958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb99e555-21d8-4bd1-a25b-9b7a82fb16ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:09.875958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb99e555-21d8-4bd1-a25b-9b7a82fb16ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:09.875958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb99e555-21d8-4bd1-a25b-9b7a82fb16ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:09.875958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb99e555-21d8-4bd1-a25b-9b7a82fb16ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:09.876636 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fb99e555-21d8-4bd1-a25b-9b7a82fb16ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:10.039772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fb99e555-21d8-4bd1-a25b-9b7a82fb16ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:10.048017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fb99e555-21d8-4bd1-a25b-9b7a82fb16ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1265 microversion: 2.1 time: 0.211380 Aug 24 06:59:10.048623 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1379/2732] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:09 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:11.070416 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a5162c05-ed6b-483b-b9b5-7d61f85277ce tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:11.071047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a5162c05-ed6b-483b-b9b5-7d61f85277ce tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:11.073748 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:11.079032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5162c05-ed6b-483b-b9b5-7d61f85277ce tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:11.079519 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5162c05-ed6b-483b-b9b5-7d61f85277ce tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:11.079957 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5162c05-ed6b-483b-b9b5-7d61f85277ce tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:11.080706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5162c05-ed6b-483b-b9b5-7d61f85277ce tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:11.081160 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5162c05-ed6b-483b-b9b5-7d61f85277ce tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:11.081578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a5162c05-ed6b-483b-b9b5-7d61f85277ce tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:11.227525 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a5162c05-ed6b-483b-b9b5-7d61f85277ce tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:11.235761 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a5162c05-ed6b-483b-b9b5-7d61f85277ce tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1265 microversion: 2.1 time: 0.169943 Aug 24 06:59:11.236337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1354/2733] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:11 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 06:59:12.257502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c3765d2b-4ad5-468d-9f12-6e5e898e9ea7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:12.258097 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c3765d2b-4ad5-468d-9f12-6e5e898e9ea7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:12.264928 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3765d2b-4ad5-468d-9f12-6e5e898e9ea7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:12.265412 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3765d2b-4ad5-468d-9f12-6e5e898e9ea7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:12.265851 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3765d2b-4ad5-468d-9f12-6e5e898e9ea7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:12.266548 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3765d2b-4ad5-468d-9f12-6e5e898e9ea7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:12.266998 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3765d2b-4ad5-468d-9f12-6e5e898e9ea7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:12.267416 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c3765d2b-4ad5-468d-9f12-6e5e898e9ea7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:12.423043 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c3765d2b-4ad5-468d-9f12-6e5e898e9ea7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:12.432096 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c3765d2b-4ad5-468d-9f12-6e5e898e9ea7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1265 microversion: 2.1 time: 0.179231 Aug 24 06:59:12.432942 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1380/2734] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:12 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:13.453915 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0996c056-5296-4056-982e-ba284358adc8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:13.454572 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0996c056-5296-4056-982e-ba284358adc8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:13.462031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0996c056-5296-4056-982e-ba284358adc8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:13.462614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0996c056-5296-4056-982e-ba284358adc8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:13.463092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0996c056-5296-4056-982e-ba284358adc8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:13.463899 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0996c056-5296-4056-982e-ba284358adc8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:13.464418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0996c056-5296-4056-982e-ba284358adc8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:13.464921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0996c056-5296-4056-982e-ba284358adc8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:13.609949 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0996c056-5296-4056-982e-ba284358adc8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:13.618660 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0996c056-5296-4056-982e-ba284358adc8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1265 microversion: 2.1 time: 0.168619 Aug 24 06:59:13.619400 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1355/2735] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:13 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:14.640423 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-42ff496f-6fc7-492b-a5d1-bde649be4d8e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:14.641177 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-42ff496f-6fc7-492b-a5d1-bde649be4d8e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:14.648005 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42ff496f-6fc7-492b-a5d1-bde649be4d8e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:14.648482 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42ff496f-6fc7-492b-a5d1-bde649be4d8e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:14.648930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42ff496f-6fc7-492b-a5d1-bde649be4d8e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:14.649652 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42ff496f-6fc7-492b-a5d1-bde649be4d8e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:14.650089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42ff496f-6fc7-492b-a5d1-bde649be4d8e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:14.650508 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-42ff496f-6fc7-492b-a5d1-bde649be4d8e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:14.812553 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-42ff496f-6fc7-492b-a5d1-bde649be4d8e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:14.824034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-42ff496f-6fc7-492b-a5d1-bde649be4d8e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1265 microversion: 2.1 time: 0.187351 Aug 24 06:59:14.824839 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1381/2736] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:14 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:15.858622 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-94b2c888-3a98-41b5-a1b6-074fc67514e7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:15.859784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-94b2c888-3a98-41b5-a1b6-074fc67514e7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:15.866891 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94b2c888-3a98-41b5-a1b6-074fc67514e7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:15.867379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94b2c888-3a98-41b5-a1b6-074fc67514e7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:15.868170 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94b2c888-3a98-41b5-a1b6-074fc67514e7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:15.868932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94b2c888-3a98-41b5-a1b6-074fc67514e7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:15.869625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94b2c888-3a98-41b5-a1b6-074fc67514e7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:15.870088 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94b2c888-3a98-41b5-a1b6-074fc67514e7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:15.910041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-7c58c7b1-78f5-4bdd-b7e2-1e0adc5526c8 req-a0753586-ac1f-48fc-a0eb-b6c5dc0a0e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4c673a-0707-4178-9dbc-236ddd8c0d51", "name": "network-vif-plugged", "status": "completed", "tag": "70e3bcc9-9005-4f9e-8a33-18bf4f587489"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:59:15.932343 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-7c58c7b1-78f5-4bdd-b7e2-1e0adc5526c8 req-a0753586-ac1f-48fc-a0eb-b6c5dc0a0e09 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:15.934772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-7c58c7b1-78f5-4bdd-b7e2-1e0adc5526c8 req-a0753586-ac1f-48fc-a0eb-b6c5dc0a0e09 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:15.934772 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-7c58c7b1-78f5-4bdd-b7e2-1e0adc5526c8 req-a0753586-ac1f-48fc-a0eb-b6c5dc0a0e09 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:15.959313 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-7c58c7b1-78f5-4bdd-b7e2-1e0adc5526c8 req-a0753586-ac1f-48fc-a0eb-b6c5dc0a0e09 service nova] Creating event network-vif-plugged:70e3bcc9-9005-4f9e-8a33-18bf4f587489 for instance cf4c673a-0707-4178-9dbc-236ddd8c0d51 on hv-cinder-85426 Aug 24 06:59:15.969437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-7c58c7b1-78f5-4bdd-b7e2-1e0adc5526c8 req-a0753586-ac1f-48fc-a0eb-b6c5dc0a0e09 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071015 Aug 24 06:59:15.970599 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1382/2737] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:59:16.052832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-94b2c888-3a98-41b5-a1b6-074fc67514e7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:16.062697 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-94b2c888-3a98-41b5-a1b6-074fc67514e7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1265 microversion: 2.1 time: 0.208004 Aug 24 06:59:16.064109 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1356/2738] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:15 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1265 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:17.084739 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-00846645-00be-4663-b04b-1d9fff3d191e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:17.085506 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-00846645-00be-4663-b04b-1d9fff3d191e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:17.091956 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00846645-00be-4663-b04b-1d9fff3d191e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:17.092437 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00846645-00be-4663-b04b-1d9fff3d191e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:17.092892 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00846645-00be-4663-b04b-1d9fff3d191e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:17.093587 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00846645-00be-4663-b04b-1d9fff3d191e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:17.094039 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00846645-00be-4663-b04b-1d9fff3d191e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:17.094457 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-00846645-00be-4663-b04b-1d9fff3d191e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:17.235618 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-00846645-00be-4663-b04b-1d9fff3d191e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:17.244389 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-00846645-00be-4663-b04b-1d9fff3d191e tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1265 microversion: 2.1 time: 0.164335 Aug 24 06:59:17.245008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1383/2739] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:17 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:18.265181 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4f7544cb-2005-4058-8759-c81b5057cb39 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:18.265784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4f7544cb-2005-4058-8759-c81b5057cb39 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:18.273086 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f7544cb-2005-4058-8759-c81b5057cb39 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:18.273577 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f7544cb-2005-4058-8759-c81b5057cb39 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:18.274011 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f7544cb-2005-4058-8759-c81b5057cb39 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:18.274706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f7544cb-2005-4058-8759-c81b5057cb39 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:18.275158 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f7544cb-2005-4058-8759-c81b5057cb39 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:18.275580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4f7544cb-2005-4058-8759-c81b5057cb39 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:18.412259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4f7544cb-2005-4058-8759-c81b5057cb39 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:18.421302 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4f7544cb-2005-4058-8759-c81b5057cb39 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1453 microversion: 2.1 time: 0.159906 Aug 24 06:59:18.422271 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1357/2740] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:18 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:18.442962 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-c2f754b3-b1ce-49c9-8b53-2f6a818e53f7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 06:59:18.444044 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-c2f754b3-b1ce-49c9-8b53-2f6a818e53f7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 06:59:18.451688 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2f754b3-b1ce-49c9-8b53-2f6a818e53f7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:18.456469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2f754b3-b1ce-49c9-8b53-2f6a818e53f7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:18.456469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2f754b3-b1ce-49c9-8b53-2f6a818e53f7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:18.456469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2f754b3-b1ce-49c9-8b53-2f6a818e53f7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:18.456469 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2f754b3-b1ce-49c9-8b53-2f6a818e53f7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:18.457143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-c2f754b3-b1ce-49c9-8b53-2f6a818e53f7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:18.605123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-c2f754b3-b1ce-49c9-8b53-2f6a818e53f7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 06:59:18.613462 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-c2f754b3-b1ce-49c9-8b53-2f6a818e53f7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1453 microversion: 2.1 time: 0.175156 Aug 24 06:59:18.614042 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1384/2741] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 06:59:18 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 06:59:21.060460 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-11b10379-47b6-4c75-8738-988b574119cd req-0b96716d-1032-4a5b-bae5-a0ad0ad92016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4c673a-0707-4178-9dbc-236ddd8c0d51", "tag": "70e3bcc9-9005-4f9e-8a33-18bf4f587489"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 06:59:21.071625 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-11b10379-47b6-4c75-8738-988b574119cd req-0b96716d-1032-4a5b-bae5-a0ad0ad92016 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 06:59:21.072098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-11b10379-47b6-4c75-8738-988b574119cd req-0b96716d-1032-4a5b-bae5-a0ad0ad92016 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 06:59:21.072545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-11b10379-47b6-4c75-8738-988b574119cd req-0b96716d-1032-4a5b-bae5-a0ad0ad92016 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 06:59:21.086334 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-11b10379-47b6-4c75-8738-988b574119cd req-0b96716d-1032-4a5b-bae5-a0ad0ad92016 service nova] Creating event network-changed:70e3bcc9-9005-4f9e-8a33-18bf4f587489 for instance cf4c673a-0707-4178-9dbc-236ddd8c0d51 on hv-cinder-85426 Aug 24 06:59:21.092340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-11b10379-47b6-4c75-8738-988b574119cd req-0b96716d-1032-4a5b-bae5-a0ad0ad92016 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035259 Aug 24 06:59:21.092984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1358/2742] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 06:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 06:59:59.976758 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 06:59:59.977698 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 06:59:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:01:01.124157 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:01.125316 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=78 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:01.131171 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-445339482", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1493528279", "security_groups": [{"name": "tempest-secgroup-smoke-353565614"}], "block_device_mapping_v2": [{"uuid": "fa9ad2ea-583d-44c6-90ab-cae01a16351f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "08b4e612-3ec2-429b-ae98-81aca6c98b3f"}]}} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:01:01.326930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.network.neutron [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] validate_networks() for [('08b4e612-3ec2-429b-ae98-81aca6c98b3f', None, None, None, None, None)] {{(pid=121150) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:01:02.004275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Flavor limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:01:02.004754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Image limits 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:01:02.005501 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Flavor pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:01:02.005958 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Image pref 0:0:0 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:01:02.006396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.virt.hardware [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121150) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:01:02.016163 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:02.016689 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:02.017132 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:02.017872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:02.018328 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:02.018845 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:02.037987 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Getting quotas for project 01a59a0e0c9e4e8fa1c0e147e720eccb. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:01:02.042505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.quota [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Getting quotas for user 86ff51618d4b4b71bfad73467ddc8585 and project 01a59a0e0c9e4e8fa1c0e147e720eccb. Resources: {'cores', 'ram', 'instances'} {{(pid=121150) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:01:02.104574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Going to run 1 instances... {{(pid=121150) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:01:02.106781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa9ad2ea-583d-44c6-90ab-cae01a16351f',volume_size=None,volume_type=None)] {{(pid=121150) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:01:02.581480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7d91f1dd-8f0a-4d78-b8ee-8d0c0d40e6cb tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.459160 Aug 24 07:01:02.583079 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1385/2743] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 07:01:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:01:02.592866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:02.593908 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:02.598166 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-70628213-f6fb-4845-b810-9eee4da573e2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:02.598879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-70628213-f6fb-4845-b810-9eee4da573e2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:02.747731 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-70628213-f6fb-4845-b810-9eee4da573e2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:02.760399 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-70628213-f6fb-4845-b810-9eee4da573e2 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1094 microversion: 2.1 time: 0.169538 Aug 24 07:01:02.761150 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1359/2744] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:02 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1094 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:01:03.783732 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0aa81c35-072e-4fc3-8bad-91a0a6581b63 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:03.784325 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-0aa81c35-072e-4fc3-8bad-91a0a6581b63 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:03.791204 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa81c35-072e-4fc3-8bad-91a0a6581b63 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:03.791694 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa81c35-072e-4fc3-8bad-91a0a6581b63 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:03.792126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa81c35-072e-4fc3-8bad-91a0a6581b63 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:03.792865 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa81c35-072e-4fc3-8bad-91a0a6581b63 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:03.793323 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa81c35-072e-4fc3-8bad-91a0a6581b63 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:03.793750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-0aa81c35-072e-4fc3-8bad-91a0a6581b63 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:03.870181 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-0aa81c35-072e-4fc3-8bad-91a0a6581b63 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:03.877948 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0aa81c35-072e-4fc3-8bad-91a0a6581b63 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1144 microversion: 2.1 time: 0.098217 Aug 24 07:01:03.878524 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1386/2745] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:03 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:01:04.902324 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5ea0af78-c9cc-4a98-85d4-9294a134f5ba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:04.903420 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5ea0af78-c9cc-4a98-85d4-9294a134f5ba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:04.918580 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ea0af78-c9cc-4a98-85d4-9294a134f5ba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:04.919125 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ea0af78-c9cc-4a98-85d4-9294a134f5ba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:04.919601 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ea0af78-c9cc-4a98-85d4-9294a134f5ba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:04.920508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ea0af78-c9cc-4a98-85d4-9294a134f5ba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:04.921217 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ea0af78-c9cc-4a98-85d4-9294a134f5ba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:04.921819 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5ea0af78-c9cc-4a98-85d4-9294a134f5ba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:05.001055 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5ea0af78-c9cc-4a98-85d4-9294a134f5ba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:05.009699 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5ea0af78-c9cc-4a98-85d4-9294a134f5ba tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1200 microversion: 2.1 time: 0.114825 Aug 24 07:01:05.010288 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1360/2746] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:04 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1200 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:06.043734 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-2a40a1eb-2cac-42a4-bbe5-8de9daaa9bb5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:06.045786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-2a40a1eb-2cac-42a4-bbe5-8de9daaa9bb5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:06.060346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a40a1eb-2cac-42a4-bbe5-8de9daaa9bb5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:06.060346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a40a1eb-2cac-42a4-bbe5-8de9daaa9bb5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:06.060346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a40a1eb-2cac-42a4-bbe5-8de9daaa9bb5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:06.060855 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a40a1eb-2cac-42a4-bbe5-8de9daaa9bb5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:06.062034 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a40a1eb-2cac-42a4-bbe5-8de9daaa9bb5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:06.063020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-2a40a1eb-2cac-42a4-bbe5-8de9daaa9bb5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:06.384779 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-2a40a1eb-2cac-42a4-bbe5-8de9daaa9bb5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:06.398413 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-2a40a1eb-2cac-42a4-bbe5-8de9daaa9bb5 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1277 microversion: 2.1 time: 0.363151 Aug 24 07:01:06.399110 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1387/2747] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:06 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1277 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:01:07.078989 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-648f1768-32fc-4922-8f21-7954e0077331 req-ed52334a-cec9-456f-a806-d85e307c3d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16631f83-7406-45eb-ba93-111bab158415", "tag": "eaa5fdbb-3d06-4301-8062-937e7f5f549a"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:01:07.096928 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-648f1768-32fc-4922-8f21-7954e0077331 req-ed52334a-cec9-456f-a806-d85e307c3d94 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:07.097657 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-648f1768-32fc-4922-8f21-7954e0077331 req-ed52334a-cec9-456f-a806-d85e307c3d94 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:07.098379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-648f1768-32fc-4922-8f21-7954e0077331 req-ed52334a-cec9-456f-a806-d85e307c3d94 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:07.114452 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-648f1768-32fc-4922-8f21-7954e0077331 req-ed52334a-cec9-456f-a806-d85e307c3d94 service nova] Creating event network-changed:eaa5fdbb-3d06-4301-8062-937e7f5f549a for instance 16631f83-7406-45eb-ba93-111bab158415 on hv-cinder-85426 Aug 24 07:01:07.120206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-648f1768-32fc-4922-8f21-7954e0077331 req-ed52334a-cec9-456f-a806-d85e307c3d94 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048759 Aug 24 07:01:07.120870 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1361/2748] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:01:07.434480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bd2258a1-0a15-4661-b17b-1faff7c16cde tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:07.435119 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bd2258a1-0a15-4661-b17b-1faff7c16cde tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:07.442638 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd2258a1-0a15-4661-b17b-1faff7c16cde tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:07.443125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd2258a1-0a15-4661-b17b-1faff7c16cde tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:07.443557 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd2258a1-0a15-4661-b17b-1faff7c16cde tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:07.444278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd2258a1-0a15-4661-b17b-1faff7c16cde tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:07.444846 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd2258a1-0a15-4661-b17b-1faff7c16cde tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:07.445229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bd2258a1-0a15-4661-b17b-1faff7c16cde tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:07.671843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bd2258a1-0a15-4661-b17b-1faff7c16cde tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:07.680281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bd2258a1-0a15-4661-b17b-1faff7c16cde tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1265 microversion: 2.1 time: 0.251968 Aug 24 07:01:07.681145 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1388/2749] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:07 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:08.708355 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-030538f6-ea67-45ac-8c99-25dab259f31d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:08.709201 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-030538f6-ea67-45ac-8c99-25dab259f31d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:08.716321 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-030538f6-ea67-45ac-8c99-25dab259f31d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:08.728705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-030538f6-ea67-45ac-8c99-25dab259f31d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:08.728705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-030538f6-ea67-45ac-8c99-25dab259f31d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:08.728705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-030538f6-ea67-45ac-8c99-25dab259f31d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:08.728705 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-030538f6-ea67-45ac-8c99-25dab259f31d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:08.729951 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-030538f6-ea67-45ac-8c99-25dab259f31d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:08.858787 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-030538f6-ea67-45ac-8c99-25dab259f31d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:08.867365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-030538f6-ea67-45ac-8c99-25dab259f31d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1265 microversion: 2.1 time: 0.163815 Aug 24 07:01:08.867947 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1362/2750] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:08 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:09.887801 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9f21f5d1-1e2b-4c1e-bede-df77f3fd4e52 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:09.888486 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9f21f5d1-1e2b-4c1e-bede-df77f3fd4e52 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:09.895069 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f21f5d1-1e2b-4c1e-bede-df77f3fd4e52 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:09.895550 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f21f5d1-1e2b-4c1e-bede-df77f3fd4e52 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:09.895975 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f21f5d1-1e2b-4c1e-bede-df77f3fd4e52 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:09.896713 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f21f5d1-1e2b-4c1e-bede-df77f3fd4e52 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:09.897164 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f21f5d1-1e2b-4c1e-bede-df77f3fd4e52 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:09.897580 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f21f5d1-1e2b-4c1e-bede-df77f3fd4e52 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:10.042320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9f21f5d1-1e2b-4c1e-bede-df77f3fd4e52 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:10.050712 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9f21f5d1-1e2b-4c1e-bede-df77f3fd4e52 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1265 microversion: 2.1 time: 0.166637 Aug 24 07:01:10.051266 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1389/2751] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:09 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:11.071777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-5be293a4-c997-4c32-aea6-881a576b3440 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:11.072370 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-5be293a4-c997-4c32-aea6-881a576b3440 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:11.079837 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5be293a4-c997-4c32-aea6-881a576b3440 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:11.080328 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5be293a4-c997-4c32-aea6-881a576b3440 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:11.080796 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5be293a4-c997-4c32-aea6-881a576b3440 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:11.082003 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5be293a4-c997-4c32-aea6-881a576b3440 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:11.082461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5be293a4-c997-4c32-aea6-881a576b3440 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:11.082886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-5be293a4-c997-4c32-aea6-881a576b3440 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:11.234021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-5be293a4-c997-4c32-aea6-881a576b3440 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:11.241231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-5be293a4-c997-4c32-aea6-881a576b3440 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1265 microversion: 2.1 time: 0.173559 Aug 24 07:01:11.241807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1363/2752] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:11 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:01:12.262305 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-fd63798b-7d7b-45e6-bb66-8c3644a44b0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:12.262862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-fd63798b-7d7b-45e6-bb66-8c3644a44b0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:12.265183 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:12.265848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=6 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:12.271273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd63798b-7d7b-45e6-bb66-8c3644a44b0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:12.277099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd63798b-7d7b-45e6-bb66-8c3644a44b0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:12.277099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd63798b-7d7b-45e6-bb66-8c3644a44b0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:12.277099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd63798b-7d7b-45e6-bb66-8c3644a44b0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:12.277099 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd63798b-7d7b-45e6-bb66-8c3644a44b0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:12.277459 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-fd63798b-7d7b-45e6-bb66-8c3644a44b0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:12.411118 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-fd63798b-7d7b-45e6-bb66-8c3644a44b0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:12.419443 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-fd63798b-7d7b-45e6-bb66-8c3644a44b0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1265 microversion: 2.1 time: 0.161214 Aug 24 07:01:12.420018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1390/2753] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:12 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:13.441300 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-eeca3d07-8bf0-4a18-bcaf-4df7e70274a8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:13.441917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-eeca3d07-8bf0-4a18-bcaf-4df7e70274a8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:13.444464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:13.449330 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eeca3d07-8bf0-4a18-bcaf-4df7e70274a8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:13.450060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eeca3d07-8bf0-4a18-bcaf-4df7e70274a8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:13.450509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eeca3d07-8bf0-4a18-bcaf-4df7e70274a8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:13.451199 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eeca3d07-8bf0-4a18-bcaf-4df7e70274a8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:13.451647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eeca3d07-8bf0-4a18-bcaf-4df7e70274a8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:13.452068 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-eeca3d07-8bf0-4a18-bcaf-4df7e70274a8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:13.588968 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-eeca3d07-8bf0-4a18-bcaf-4df7e70274a8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:13.596807 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-eeca3d07-8bf0-4a18-bcaf-4df7e70274a8 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1265 microversion: 2.1 time: 0.160050 Aug 24 07:01:13.597379 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1364/2754] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:13 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:14.617754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b4cfa266-9798-4fea-96a2-a2f9e62c0759 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:14.618364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b4cfa266-9798-4fea-96a2-a2f9e62c0759 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:14.625049 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b4cfa266-9798-4fea-96a2-a2f9e62c0759 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:14.625523 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b4cfa266-9798-4fea-96a2-a2f9e62c0759 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:14.625946 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b4cfa266-9798-4fea-96a2-a2f9e62c0759 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:14.626622 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b4cfa266-9798-4fea-96a2-a2f9e62c0759 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:14.627063 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b4cfa266-9798-4fea-96a2-a2f9e62c0759 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:14.627500 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b4cfa266-9798-4fea-96a2-a2f9e62c0759 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:14.760872 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b4cfa266-9798-4fea-96a2-a2f9e62c0759 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:14.768536 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b4cfa266-9798-4fea-96a2-a2f9e62c0759 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1265 microversion: 2.1 time: 0.154808 Aug 24 07:01:14.769166 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1391/2755] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:14 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:15.788788 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-45defe8b-9b0e-4023-8ec4-073b0efc55ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:15.789390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-45defe8b-9b0e-4023-8ec4-073b0efc55ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:15.795887 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45defe8b-9b0e-4023-8ec4-073b0efc55ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:15.796356 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45defe8b-9b0e-4023-8ec4-073b0efc55ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:15.796820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45defe8b-9b0e-4023-8ec4-073b0efc55ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:15.797496 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45defe8b-9b0e-4023-8ec4-073b0efc55ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:15.797942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45defe8b-9b0e-4023-8ec4-073b0efc55ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:15.798353 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-45defe8b-9b0e-4023-8ec4-073b0efc55ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:15.945097 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-45defe8b-9b0e-4023-8ec4-073b0efc55ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:15.953570 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-45defe8b-9b0e-4023-8ec4-073b0efc55ca tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1265 microversion: 2.1 time: 0.168659 Aug 24 07:01:15.954157 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1365/2756] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:15 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:16.974354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e6b1c5e0-7645-4868-a742-586f12897e01 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:16.975054 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e6b1c5e0-7645-4868-a742-586f12897e01 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:16.982635 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e6b1c5e0-7645-4868-a742-586f12897e01 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:16.983126 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e6b1c5e0-7645-4868-a742-586f12897e01 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:16.983755 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e6b1c5e0-7645-4868-a742-586f12897e01 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:16.984595 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e6b1c5e0-7645-4868-a742-586f12897e01 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:16.985275 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e6b1c5e0-7645-4868-a742-586f12897e01 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:16.985703 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e6b1c5e0-7645-4868-a742-586f12897e01 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:17.125092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e6b1c5e0-7645-4868-a742-586f12897e01 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:17.133098 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e6b1c5e0-7645-4868-a742-586f12897e01 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1265 microversion: 2.1 time: 0.162671 Aug 24 07:01:17.133672 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1392/2757] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:16 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:18.205418 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-deb8d01b-ffd2-4845-bdb8-8b67f54afd14 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:18.206021 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-deb8d01b-ffd2-4845-bdb8-8b67f54afd14 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:18.212127 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-deb8d01b-ffd2-4845-bdb8-8b67f54afd14 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:18.212651 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-deb8d01b-ffd2-4845-bdb8-8b67f54afd14 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:18.213077 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-deb8d01b-ffd2-4845-bdb8-8b67f54afd14 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:18.213938 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-deb8d01b-ffd2-4845-bdb8-8b67f54afd14 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:18.214389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-deb8d01b-ffd2-4845-bdb8-8b67f54afd14 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:18.214812 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-deb8d01b-ffd2-4845-bdb8-8b67f54afd14 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:18.354327 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-deb8d01b-ffd2-4845-bdb8-8b67f54afd14 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:18.363057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-deb8d01b-ffd2-4845-bdb8-8b67f54afd14 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1265 microversion: 2.1 time: 0.211377 Aug 24 07:01:18.363626 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1366/2758] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:18 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:18.444619 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-1e548c6a-956a-4183-a1cf-4a32387e75e5 req-af2b10af-50eb-4fa1-b3b2-70e38bb9bd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16631f83-7406-45eb-ba93-111bab158415", "name": "network-vif-plugged", "status": "completed", "tag": "eaa5fdbb-3d06-4301-8062-937e7f5f549a"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:01:18.455992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-1e548c6a-956a-4183-a1cf-4a32387e75e5 req-af2b10af-50eb-4fa1-b3b2-70e38bb9bd90 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:18.459038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-1e548c6a-956a-4183-a1cf-4a32387e75e5 req-af2b10af-50eb-4fa1-b3b2-70e38bb9bd90 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:18.459038 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-1e548c6a-956a-4183-a1cf-4a32387e75e5 req-af2b10af-50eb-4fa1-b3b2-70e38bb9bd90 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:18.469487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-1e548c6a-956a-4183-a1cf-4a32387e75e5 req-af2b10af-50eb-4fa1-b3b2-70e38bb9bd90 service nova] Creating event network-vif-plugged:eaa5fdbb-3d06-4301-8062-937e7f5f549a for instance 16631f83-7406-45eb-ba93-111bab158415 on hv-cinder-85426 Aug 24 07:01:18.476123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-1e548c6a-956a-4183-a1cf-4a32387e75e5 req-af2b10af-50eb-4fa1-b3b2-70e38bb9bd90 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035151 Aug 24 07:01:18.477080 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1393/2759] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:01:19.383120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-8130f591-2c63-4039-b993-ceeaba239435 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:19.383724 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-8130f591-2c63-4039-b993-ceeaba239435 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:19.390230 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8130f591-2c63-4039-b993-ceeaba239435 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:19.390706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8130f591-2c63-4039-b993-ceeaba239435 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:19.391141 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8130f591-2c63-4039-b993-ceeaba239435 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:19.391820 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8130f591-2c63-4039-b993-ceeaba239435 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:19.392293 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8130f591-2c63-4039-b993-ceeaba239435 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:19.392727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-8130f591-2c63-4039-b993-ceeaba239435 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:19.530035 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-8130f591-2c63-4039-b993-ceeaba239435 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:19.538442 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-8130f591-2c63-4039-b993-ceeaba239435 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1265 microversion: 2.1 time: 0.159147 Aug 24 07:01:19.539023 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1367/2760] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:19 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:20.559984 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e12444b7-7895-4b6f-bfc4-b02c944f90fd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:20.560774 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e12444b7-7895-4b6f-bfc4-b02c944f90fd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:20.567604 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12444b7-7895-4b6f-bfc4-b02c944f90fd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:20.568089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12444b7-7895-4b6f-bfc4-b02c944f90fd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:20.568539 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12444b7-7895-4b6f-bfc4-b02c944f90fd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:20.569262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12444b7-7895-4b6f-bfc4-b02c944f90fd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:20.569742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12444b7-7895-4b6f-bfc4-b02c944f90fd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:20.570161 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e12444b7-7895-4b6f-bfc4-b02c944f90fd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:20.711906 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e12444b7-7895-4b6f-bfc4-b02c944f90fd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:20.722253 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e12444b7-7895-4b6f-bfc4-b02c944f90fd tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1453 microversion: 2.1 time: 0.166485 Aug 24 07:01:20.722815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1394/2761] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:20 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:20.745777 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-4c4353eb-1369-4f5c-8a70-3907128a712d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:20.746476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-4c4353eb-1369-4f5c-8a70-3907128a712d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:20.753363 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c4353eb-1369-4f5c-8a70-3907128a712d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:20.753843 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c4353eb-1369-4f5c-8a70-3907128a712d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:20.754278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c4353eb-1369-4f5c-8a70-3907128a712d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:20.754984 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c4353eb-1369-4f5c-8a70-3907128a712d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:20.755425 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c4353eb-1369-4f5c-8a70-3907128a712d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:20.755845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-4c4353eb-1369-4f5c-8a70-3907128a712d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:20.898212 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-4c4353eb-1369-4f5c-8a70-3907128a712d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:01:20.907045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-4c4353eb-1369-4f5c-8a70-3907128a712d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1453 microversion: 2.1 time: 0.165053 Aug 24 07:01:20.907545 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1368/2762] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:20 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:01:23.048729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-c3f7abf0-1bde-4bff-a4ae-756682d803c5 req-c095bb93-41fa-415a-8656-9b554db72796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16631f83-7406-45eb-ba93-111bab158415", "tag": "eaa5fdbb-3d06-4301-8062-937e7f5f549a"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:01:23.064543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-c3f7abf0-1bde-4bff-a4ae-756682d803c5 req-c095bb93-41fa-415a-8656-9b554db72796 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:23.064543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-c3f7abf0-1bde-4bff-a4ae-756682d803c5 req-c095bb93-41fa-415a-8656-9b554db72796 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:23.064543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-c3f7abf0-1bde-4bff-a4ae-756682d803c5 req-c095bb93-41fa-415a-8656-9b554db72796 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:23.079514 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-c3f7abf0-1bde-4bff-a4ae-756682d803c5 req-c095bb93-41fa-415a-8656-9b554db72796 service nova] Creating event network-changed:eaa5fdbb-3d06-4301-8062-937e7f5f549a for instance 16631f83-7406-45eb-ba93-111bab158415 on hv-cinder-85426 Aug 24 07:01:23.085307 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-c3f7abf0-1bde-4bff-a4ae-756682d803c5 req-c095bb93-41fa-415a-8656-9b554db72796 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040246 Aug 24 07:01:23.085902 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1395/2763] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:01:32.294018 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:01:32.294697 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 07:01:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:01:37.466880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:37.467775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:37.469620 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=22 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:37.470281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=50 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:37.475063 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:37.475544 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:37.475978 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:37.476716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:37.477167 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:37.477618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:37.491935 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: DELETE /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb HTTP/1.1 Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 07:01:37.493656 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. Aug 24 07:01:37.495134 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '90ff1952-1000-4510-ac80-d18576f044cb'} Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:01:37.495838 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. Aug 24 07:01:37.497017 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:01:37.498390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 404 to user: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:01:37.498390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-6e3196f9-6f82-47aa-8480-060bb271dc32 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "DELETE /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 404 len: 111 microversion: 2.1 time: 0.032058 Aug 24 07:01:37.498390 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1369/2764] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 07:01:37 2022] DELETE /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:01:37.501448 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:37.508190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=54 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:37.508190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:01:37.508190 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] [instance: 90ff1952-1000-4510-ac80-d18576f044cb] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:01:37.513742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:37.514234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:37.514660 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:37.515347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:01:37.515795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:01:37.516214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:01:37.530840 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] HTTP exception thrown: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Request method failure captured: Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb HTTP/1.1 Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcJJJnBkuIqz26VhzwE4-uoSBVplGj5uWSLXjogna__rbMyk9LGR2Sx_8-f74sWa6qcllhhoKVtCy2fnRWGoWl49sFA3ijH5rl1pikanOtdvk-n_dHL-WkPtJ5KsgHSt7ni9lrCaErPUQiMxY4N2RIg7Aw_lD_VWb6zbUJHhhQCDm2o Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 07:01:37.532479 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/b1f2c78322cb4c999f1e01b82b81a884"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_b1f2c78322cb4c999f1e01b82b81a884", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-AttachVolumeNegativeTest-97266514 Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: b1f2c78322cb4c999f1e01b82b81a884 Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-97266514 Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 6abfd0a28f9e482badae7018f1b7f9a1 Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-AttachVolumeNegativeTest-97266514-project Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. Aug 24 07:01:37.534821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '90ff1952-1000-4510-ac80-d18576f044cb'} Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:01:37.536230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. Aug 24 07:01:37.538300 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:01:37.540191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] Returning 404 to user: Instance 90ff1952-1000-4510-ac80-d18576f044cb could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:01:37.540191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-27b4b1c8-87c0-4eae-bd90-3080207a5324 tempest-AttachVolumeNegativeTest-97266514 tempest-AttachVolumeNegativeTest-97266514-project] 10.222.0.62 "GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb" status: 404 len: 111 microversion: 2.1 time: 0.034014 Aug 24 07:01:37.540191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1396/2765] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:01:37 2022] GET /compute/v2.1/servers/90ff1952-1000-4510-ac80-d18576f044cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:01:45.287229 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:01:45.287877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 07:01:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:02:04.412057 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1223065641", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "networks": [{"uuid": "5c695ae6-97ca-4d30-9cc9-e74c4c45d506"}]}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:02:04.467687 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] validate_networks() for [('5c695ae6-97ca-4d30-9cc9-e74c4c45d506', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:02:04.859171 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:02:04.859598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:02:04.860120 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:02:04.860578 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:02:04.861646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:02:04.870567 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:04.871054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:04.871497 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:04.872259 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:04.872752 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:04.873180 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:04.889913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Getting quotas for project 057aefc9bbcc4818ab055d3c0ddacdb5. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:02:04.893874 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Getting quotas for user 3a2cc6be0c09472a9b3d319e82d95534 and project 057aefc9bbcc4818ab055d3c0ddacdb5. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:02:04.904747 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:02:04.907112 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:02:05.158629 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-61550aab-ebd4-47cd-9964-679e87ad6ccc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749938 Aug 24 07:02:05.159192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1370/2766] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 07:02:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:02:05.170230 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b91dbd4d-62b3-4a19-83f1-2b386a57d6ff tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:05.170829 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b91dbd4d-62b3-4a19-83f1-2b386a57d6ff tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:05.227290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b91dbd4d-62b3-4a19-83f1-2b386a57d6ff tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:05.235296 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b91dbd4d-62b3-4a19-83f1-2b386a57d6ff tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1214 microversion: 2.1 time: 0.069191 Aug 24 07:02:05.236149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1397/2767] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:05 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:06.256060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-769663d5-5527-45f8-adf5-33dff4d3b228 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:06.262664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-769663d5-5527-45f8-adf5-33dff4d3b228 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:06.310101 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-769663d5-5527-45f8-adf5-33dff4d3b228 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:06.317798 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-769663d5-5527-45f8-adf5-33dff4d3b228 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1214 microversion: 2.1 time: 0.066312 Aug 24 07:02:06.318386 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1371/2768] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:06 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:07.339008 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3b8e58af-644b-4461-b35d-d6659dfb678d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:07.339852 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3b8e58af-644b-4461-b35d-d6659dfb678d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:07.347450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b8e58af-644b-4461-b35d-d6659dfb678d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:07.347920 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b8e58af-644b-4461-b35d-d6659dfb678d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:07.348350 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b8e58af-644b-4461-b35d-d6659dfb678d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:07.349060 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b8e58af-644b-4461-b35d-d6659dfb678d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:07.349497 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b8e58af-644b-4461-b35d-d6659dfb678d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:07.349907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b8e58af-644b-4461-b35d-d6659dfb678d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:07.411435 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3b8e58af-644b-4461-b35d-d6659dfb678d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:07.418947 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3b8e58af-644b-4461-b35d-d6659dfb678d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1266 microversion: 2.1 time: 0.084015 Aug 24 07:02:07.419505 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1398/2769] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:07 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:08.447382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-b3f86026-cdf9-4695-a5ff-a8c79f98401a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:08.448387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-b3f86026-cdf9-4695-a5ff-a8c79f98401a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:08.456692 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3f86026-cdf9-4695-a5ff-a8c79f98401a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:08.457178 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3f86026-cdf9-4695-a5ff-a8c79f98401a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:08.457607 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3f86026-cdf9-4695-a5ff-a8c79f98401a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:08.458301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3f86026-cdf9-4695-a5ff-a8c79f98401a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:08.458775 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3f86026-cdf9-4695-a5ff-a8c79f98401a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:08.459196 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-b3f86026-cdf9-4695-a5ff-a8c79f98401a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:08.530995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-b3f86026-cdf9-4695-a5ff-a8c79f98401a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:08.539279 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-b3f86026-cdf9-4695-a5ff-a8c79f98401a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1272 microversion: 2.1 time: 0.096093 Aug 24 07:02:08.539860 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1372/2770] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:08 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:09.560862 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-715747cd-0444-46ba-aeff-dc827808e752 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:09.561463 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-715747cd-0444-46ba-aeff-dc827808e752 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:09.567911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-715747cd-0444-46ba-aeff-dc827808e752 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:09.569926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-715747cd-0444-46ba-aeff-dc827808e752 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:09.569926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-715747cd-0444-46ba-aeff-dc827808e752 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:09.569926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-715747cd-0444-46ba-aeff-dc827808e752 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:09.569926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-715747cd-0444-46ba-aeff-dc827808e752 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:09.570352 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-715747cd-0444-46ba-aeff-dc827808e752 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:09.800143 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-715747cd-0444-46ba-aeff-dc827808e752 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:09.807843 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-715747cd-0444-46ba-aeff-dc827808e752 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1314 microversion: 2.1 time: 0.250810 Aug 24 07:02:09.808802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1399/2771] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:09 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:10.144720 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-9b6ebd7f-7c8d-4cc9-b330-e7d7c3c6cc10 req-0087c774-dafc-412d-9e36-93451015a3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a92247a7-2c70-42e1-bc30-02c458136c07", "tag": "036f692a-920d-4b29-a635-a4bfd06bc7bd"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:02:10.155474 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-9b6ebd7f-7c8d-4cc9-b330-e7d7c3c6cc10 req-0087c774-dafc-412d-9e36-93451015a3e5 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:10.155956 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-9b6ebd7f-7c8d-4cc9-b330-e7d7c3c6cc10 req-0087c774-dafc-412d-9e36-93451015a3e5 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:10.156659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-9b6ebd7f-7c8d-4cc9-b330-e7d7c3c6cc10 req-0087c774-dafc-412d-9e36-93451015a3e5 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:10.169993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-9b6ebd7f-7c8d-4cc9-b330-e7d7c3c6cc10 req-0087c774-dafc-412d-9e36-93451015a3e5 service nova] Creating event network-changed:036f692a-920d-4b29-a635-a4bfd06bc7bd for instance a92247a7-2c70-42e1-bc30-02c458136c07 on hv-cinder-85426 Aug 24 07:02:10.175269 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-9b6ebd7f-7c8d-4cc9-b330-e7d7c3c6cc10 req-0087c774-dafc-412d-9e36-93451015a3e5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166976 Aug 24 07:02:10.176413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1373/2772] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:02:10.828681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3b1bb359-8687-444d-8671-eb7375c3b6ae tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:10.829298 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3b1bb359-8687-444d-8671-eb7375c3b6ae tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:10.835854 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b1bb359-8687-444d-8671-eb7375c3b6ae tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:10.836339 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b1bb359-8687-444d-8671-eb7375c3b6ae tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:10.836795 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b1bb359-8687-444d-8671-eb7375c3b6ae tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:10.837491 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b1bb359-8687-444d-8671-eb7375c3b6ae tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:10.837938 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b1bb359-8687-444d-8671-eb7375c3b6ae tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:10.838354 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3b1bb359-8687-444d-8671-eb7375c3b6ae tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:10.967573 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-3b1bb359-8687-444d-8671-eb7375c3b6ae tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:10.975754 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3b1bb359-8687-444d-8671-eb7375c3b6ae tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1314 microversion: 2.1 time: 0.151195 Aug 24 07:02:10.976328 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1400/2773] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:10 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:11.997706 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-9af7eb94-7107-4ba4-8757-79df8ada9f2b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:11.998307 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-9af7eb94-7107-4ba4-8757-79df8ada9f2b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:12.005071 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9af7eb94-7107-4ba4-8757-79df8ada9f2b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:12.005548 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9af7eb94-7107-4ba4-8757-79df8ada9f2b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:12.005985 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9af7eb94-7107-4ba4-8757-79df8ada9f2b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:12.006686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9af7eb94-7107-4ba4-8757-79df8ada9f2b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:12.007163 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9af7eb94-7107-4ba4-8757-79df8ada9f2b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:12.007602 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-9af7eb94-7107-4ba4-8757-79df8ada9f2b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:12.138595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-9af7eb94-7107-4ba4-8757-79df8ada9f2b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:12.146694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-9af7eb94-7107-4ba4-8757-79df8ada9f2b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1314 microversion: 2.1 time: 0.153327 Aug 24 07:02:12.147253 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1374/2774] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:11 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:13.168027 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a27b3828-7a62-48f8-9576-54a51ad0bc21 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:13.168659 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a27b3828-7a62-48f8-9576-54a51ad0bc21 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:13.175753 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a27b3828-7a62-48f8-9576-54a51ad0bc21 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:13.176229 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a27b3828-7a62-48f8-9576-54a51ad0bc21 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:13.176684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a27b3828-7a62-48f8-9576-54a51ad0bc21 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:13.177367 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a27b3828-7a62-48f8-9576-54a51ad0bc21 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:13.177817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a27b3828-7a62-48f8-9576-54a51ad0bc21 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:13.178234 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a27b3828-7a62-48f8-9576-54a51ad0bc21 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:13.309278 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a27b3828-7a62-48f8-9576-54a51ad0bc21 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:13.317007 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a27b3828-7a62-48f8-9576-54a51ad0bc21 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1314 microversion: 2.1 time: 0.152867 Aug 24 07:02:13.317522 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1401/2775] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:13 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:14.338689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a48b3833-54cf-4596-8447-795e7bd3f3af tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:14.339233 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a48b3833-54cf-4596-8447-795e7bd3f3af tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:14.346419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a48b3833-54cf-4596-8447-795e7bd3f3af tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:14.347281 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a48b3833-54cf-4596-8447-795e7bd3f3af tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:14.347371 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a48b3833-54cf-4596-8447-795e7bd3f3af tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:14.348022 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a48b3833-54cf-4596-8447-795e7bd3f3af tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:14.348476 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a48b3833-54cf-4596-8447-795e7bd3f3af tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:14.348942 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a48b3833-54cf-4596-8447-795e7bd3f3af tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:14.482884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a48b3833-54cf-4596-8447-795e7bd3f3af tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:14.491007 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a48b3833-54cf-4596-8447-795e7bd3f3af tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1314 microversion: 2.1 time: 0.156224 Aug 24 07:02:14.491599 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1375/2776] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:14 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:15.511507 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-8378b6f9-3c7b-4e3d-96fd-863eb3ee3407 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:15.512087 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-8378b6f9-3c7b-4e3d-96fd-863eb3ee3407 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:15.514429 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:15.519258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8378b6f9-3c7b-4e3d-96fd-863eb3ee3407 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:15.519729 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8378b6f9-3c7b-4e3d-96fd-863eb3ee3407 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:15.520155 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8378b6f9-3c7b-4e3d-96fd-863eb3ee3407 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:15.520853 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8378b6f9-3c7b-4e3d-96fd-863eb3ee3407 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:15.521297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8378b6f9-3c7b-4e3d-96fd-863eb3ee3407 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:15.521708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-8378b6f9-3c7b-4e3d-96fd-863eb3ee3407 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:15.654182 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-8378b6f9-3c7b-4e3d-96fd-863eb3ee3407 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:15.662639 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-8378b6f9-3c7b-4e3d-96fd-863eb3ee3407 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1314 microversion: 2.1 time: 0.154968 Aug 24 07:02:15.663208 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1402/2777] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:15 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:16.648337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:16.649605 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=8 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:16.683140 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-27919a9d-d56b-41c0-b94c-20825408f68f tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:16.683762 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-27919a9d-d56b-41c0-b94c-20825408f68f tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:16.690864 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27919a9d-d56b-41c0-b94c-20825408f68f tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:16.691344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27919a9d-d56b-41c0-b94c-20825408f68f tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:16.691769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27919a9d-d56b-41c0-b94c-20825408f68f tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:16.692453 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27919a9d-d56b-41c0-b94c-20825408f68f tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:16.692927 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27919a9d-d56b-41c0-b94c-20825408f68f tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:16.693366 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-27919a9d-d56b-41c0-b94c-20825408f68f tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:16.708953 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-3bbbc789-eab1-4af3-93b3-45a66659b4db req-3588b3d7-4abe-46de-b4a3-f676ba6f5708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92247a7-2c70-42e1-bc30-02c458136c07", "name": "network-vif-plugged", "status": "completed", "tag": "036f692a-920d-4b29-a635-a4bfd06bc7bd"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:02:16.719584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-3bbbc789-eab1-4af3-93b3-45a66659b4db req-3588b3d7-4abe-46de-b4a3-f676ba6f5708 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:16.720369 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-3bbbc789-eab1-4af3-93b3-45a66659b4db req-3588b3d7-4abe-46de-b4a3-f676ba6f5708 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:16.720983 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-3bbbc789-eab1-4af3-93b3-45a66659b4db req-3588b3d7-4abe-46de-b4a3-f676ba6f5708 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:16.734092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-3bbbc789-eab1-4af3-93b3-45a66659b4db req-3588b3d7-4abe-46de-b4a3-f676ba6f5708 service nova] Creating event network-vif-plugged:036f692a-920d-4b29-a635-a4bfd06bc7bd for instance a92247a7-2c70-42e1-bc30-02c458136c07 on hv-cinder-85426 Aug 24 07:02:16.742186 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-3bbbc789-eab1-4af3-93b3-45a66659b4db req-3588b3d7-4abe-46de-b4a3-f676ba6f5708 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098255 Aug 24 07:02:16.742800 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1376/2778] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:02:16.841017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-27919a9d-d56b-41c0-b94c-20825408f68f tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:16.849333 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-27919a9d-d56b-41c0-b94c-20825408f68f tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1314 microversion: 2.1 time: 0.170036 Aug 24 07:02:16.850136 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1403/2779] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:16 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:02:17.871052 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2943e904-2c06-4d6f-8bcd-ea3cb0b52ce2 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:17.871771 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2943e904-2c06-4d6f-8bcd-ea3cb0b52ce2 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:17.879081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2943e904-2c06-4d6f-8bcd-ea3cb0b52ce2 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:17.879583 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2943e904-2c06-4d6f-8bcd-ea3cb0b52ce2 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:17.880000 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2943e904-2c06-4d6f-8bcd-ea3cb0b52ce2 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:17.880750 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2943e904-2c06-4d6f-8bcd-ea3cb0b52ce2 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:17.881203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2943e904-2c06-4d6f-8bcd-ea3cb0b52ce2 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:17.881647 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2943e904-2c06-4d6f-8bcd-ea3cb0b52ce2 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:18.015964 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2943e904-2c06-4d6f-8bcd-ea3cb0b52ce2 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:18.024156 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2943e904-2c06-4d6f-8bcd-ea3cb0b52ce2 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1314 microversion: 2.1 time: 0.157886 Aug 24 07:02:18.024756 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1377/2780] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:17 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:19.045683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-e1fcd60f-1ad6-43f1-a371-1f9c31218acc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:19.046269 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-e1fcd60f-1ad6-43f1-a371-1f9c31218acc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:19.052781 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fcd60f-1ad6-43f1-a371-1f9c31218acc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:19.053257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fcd60f-1ad6-43f1-a371-1f9c31218acc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:19.053684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fcd60f-1ad6-43f1-a371-1f9c31218acc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:19.054363 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fcd60f-1ad6-43f1-a371-1f9c31218acc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:19.054802 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fcd60f-1ad6-43f1-a371-1f9c31218acc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:19.055214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-e1fcd60f-1ad6-43f1-a371-1f9c31218acc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:19.187808 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-e1fcd60f-1ad6-43f1-a371-1f9c31218acc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:19.196364 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-e1fcd60f-1ad6-43f1-a371-1f9c31218acc tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1498 microversion: 2.1 time: 0.154525 Aug 24 07:02:19.196996 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1404/2781] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:19 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:20.105099 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-750555fc-40d2-45a0-b0ff-1f9e675c15df tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:20.105707 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-750555fc-40d2-45a0-b0ff-1f9e675c15df tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:20.112404 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-750555fc-40d2-45a0-b0ff-1f9e675c15df tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:20.112958 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-750555fc-40d2-45a0-b0ff-1f9e675c15df tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:20.113387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-750555fc-40d2-45a0-b0ff-1f9e675c15df tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:20.114066 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-750555fc-40d2-45a0-b0ff-1f9e675c15df tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:20.114509 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-750555fc-40d2-45a0-b0ff-1f9e675c15df tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:20.114921 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-750555fc-40d2-45a0-b0ff-1f9e675c15df tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:20.139637 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-750555fc-40d2-45a0-b0ff-1f9e675c15df tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:02:20.451639 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-750555fc-40d2-45a0-b0ff-1f9e675c15df tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "DELETE /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 204 len: 0 microversion: 2.1 time: 0.349951 Aug 24 07:02:20.452231 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1378/2782] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 07:02:20 2022] DELETE /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:02:20.461102 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-b84b1e69-74db-4f43-b95c-96955778370a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:20.461751 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-b84b1e69-74db-4f43-b95c-96955778370a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:20.468156 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b84b1e69-74db-4f43-b95c-96955778370a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:20.468668 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b84b1e69-74db-4f43-b95c-96955778370a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:20.469123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b84b1e69-74db-4f43-b95c-96955778370a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:20.469815 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b84b1e69-74db-4f43-b95c-96955778370a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:20.470265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b84b1e69-74db-4f43-b95c-96955778370a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:20.470683 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-b84b1e69-74db-4f43-b95c-96955778370a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:20.599556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-b84b1e69-74db-4f43-b95c-96955778370a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:20.607600 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-b84b1e69-74db-4f43-b95c-96955778370a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1504 microversion: 2.1 time: 0.150399 Aug 24 07:02:20.608175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1405/2783] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:20 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:21.629829 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-661b7cf7-87ad-4945-b8f6-fcaa8f8c203a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:21.630515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-661b7cf7-87ad-4945-b8f6-fcaa8f8c203a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:21.636941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b7cf7-87ad-4945-b8f6-fcaa8f8c203a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:21.637419 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b7cf7-87ad-4945-b8f6-fcaa8f8c203a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:21.637845 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b7cf7-87ad-4945-b8f6-fcaa8f8c203a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:21.638543 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b7cf7-87ad-4945-b8f6-fcaa8f8c203a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:21.638977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b7cf7-87ad-4945-b8f6-fcaa8f8c203a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:21.639389 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-661b7cf7-87ad-4945-b8f6-fcaa8f8c203a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:21.774591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-661b7cf7-87ad-4945-b8f6-fcaa8f8c203a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:21.782694 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-661b7cf7-87ad-4945-b8f6-fcaa8f8c203a tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1504 microversion: 2.1 time: 0.157838 Aug 24 07:02:21.783619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1379/2784] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:21 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:22.304884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-56ce1bbb-222a-4391-b358-12bc390c55d7 req-e8a8ce4e-9ad9-4f95-9a5b-7a2b8b119562 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a92247a7-2c70-42e1-bc30-02c458136c07", "name": "network-vif-deleted", "tag": "036f692a-920d-4b29-a635-a4bfd06bc7bd"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:02:22.314721 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-56ce1bbb-222a-4391-b358-12bc390c55d7 req-e8a8ce4e-9ad9-4f95-9a5b-7a2b8b119562 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:22.315191 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-56ce1bbb-222a-4391-b358-12bc390c55d7 req-e8a8ce4e-9ad9-4f95-9a5b-7a2b8b119562 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:22.315613 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-56ce1bbb-222a-4391-b358-12bc390c55d7 req-e8a8ce4e-9ad9-4f95-9a5b-7a2b8b119562 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:22.329579 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-56ce1bbb-222a-4391-b358-12bc390c55d7 req-e8a8ce4e-9ad9-4f95-9a5b-7a2b8b119562 service nova] Creating event network-vif-deleted:036f692a-920d-4b29-a635-a4bfd06bc7bd for instance a92247a7-2c70-42e1-bc30-02c458136c07 on hv-cinder-85426 Aug 24 07:02:22.334601 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-56ce1bbb-222a-4391-b358-12bc390c55d7 req-e8a8ce4e-9ad9-4f95-9a5b-7a2b8b119562 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033464 Aug 24 07:02:22.335179 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1406/2785] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:02:22.804584 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2aa5d487-2bc2-4ee3-bacc-7fd30b0bbbb3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:22.805191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2aa5d487-2bc2-4ee3-bacc-7fd30b0bbbb3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:22.811615 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2aa5d487-2bc2-4ee3-bacc-7fd30b0bbbb3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:22.812092 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2aa5d487-2bc2-4ee3-bacc-7fd30b0bbbb3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:22.812541 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2aa5d487-2bc2-4ee3-bacc-7fd30b0bbbb3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:22.813228 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2aa5d487-2bc2-4ee3-bacc-7fd30b0bbbb3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:22.813682 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2aa5d487-2bc2-4ee3-bacc-7fd30b0bbbb3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:22.814104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2aa5d487-2bc2-4ee3-bacc-7fd30b0bbbb3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:22.879382 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2aa5d487-2bc2-4ee3-bacc-7fd30b0bbbb3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:22.887081 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2aa5d487-2bc2-4ee3-bacc-7fd30b0bbbb3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 200 len: 1299 microversion: 2.1 time: 0.086412 Aug 24 07:02:22.895708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1380/2786] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:22 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:23.910916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:23.911510 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: a92247a7-2c70-42e1-bc30-02c458136c07] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:23.917764 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:23.918241 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:23.920487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:23.920487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:23.920487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:23.920487 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:23.934127 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] HTTP exception thrown: Instance a92247a7-2c70-42e1-bc30-02c458136c07 could not be found. Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Request method failure captured: Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 HTTP/1.1 Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBczq0XyNHhjhO_OrKWXtxbrNCggh2tOxvuBC9NeIdxjeKU80aZiaGckKVPod7mRdgaiLQ4dwn_6xnVvbMz4XaxtRQKVJXIUzL8mTij1Wfd2iVfDmoFXMcpDHNuUb2Rsp2P1pU1juwH3sLqGBZUBuokRzltCX2hRVLFDf8dxfHdaDzF8 Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: 057aefc9bbcc4818ab055d3c0ddacdb5 Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-VolumesActionsTest-757681869 Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 07:02:23.935740 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/057aefc9bbcc4818ab055d3c0ddacdb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/057aefc9bbcc4818ab055d3c0ddacdb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/057aefc9bbcc4818ab055d3c0ddacdb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_057aefc9bbcc4818ab055d3c0ddacdb5", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-VolumesActionsTest-757681869 Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: 057aefc9bbcc4818ab055d3c0ddacdb5 Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-VolumesActionsTest-757681869 Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-VolumesActionsTest-757681869-project Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 3a2cc6be0c09472a9b3d319e82d95534 Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-VolumesActionsTest-757681869-project Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance a92247a7-2c70-42e1-bc30-02c458136c07 could not be found. Aug 24 07:02:23.937175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': 'a92247a7-2c70-42e1-bc30-02c458136c07'} Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92247a7-2c70-42e1-bc30-02c458136c07 could not be found. Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:02:23.937926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92247a7-2c70-42e1-bc30-02c458136c07 could not be found. Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92247a7-2c70-42e1-bc30-02c458136c07 could not be found. Aug 24 07:02:23.939915 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:02:23.941330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Returning 404 to user: Instance a92247a7-2c70-42e1-bc30-02c458136c07 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:02:23.941330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-7fee6fae-5e73-4c0b-81a7-6103dc44ecde tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07" status: 404 len: 111 microversion: 2.1 time: 0.031834 Aug 24 07:02:23.941330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1407/2787] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:23 2022] GET /compute/v2.1/servers/a92247a7-2c70-42e1-bc30-02c458136c07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:02:23.987145 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-379175604", "imageRef": "754195be-daba-4fa5-a7fb-97cdb34cac70", "flavorRef": "452", "networks": [{"uuid": "5c695ae6-97ca-4d30-9cc9-e74c4c45d506"}]}} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:02:24.040701 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.network.neutron [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] validate_networks() for [('5c695ae6-97ca-4d30-9cc9-e74c4c45d506', None, None, None, None, None)] {{(pid=121151) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 07:02:24.391043 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Flavor limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 07:02:24.391473 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Image limits 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 07:02:24.392696 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Flavor pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 07:02:24.392995 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Image pref 0:0:0 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 07:02:24.393414 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.virt.hardware [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121151) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 07:02:24.402407 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:24.402882 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:24.403338 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:24.404060 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:24.404527 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:24.404952 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:24.421734 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Getting quotas for project 057aefc9bbcc4818ab055d3c0ddacdb5. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 07:02:24.426813 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.quota [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Getting quotas for user 3a2cc6be0c09472a9b3d319e82d95534 and project 057aefc9bbcc4818ab055d3c0ddacdb5. Resources: {'cores', 'ram', 'instances'} {{(pid=121151) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 07:02:24.439306 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Going to run 1 instances... {{(pid=121151) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 07:02:24.441646 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='754195be-daba-4fa5-a7fb-97cdb34cac70',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121151) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 07:02:24.579982 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-d1160cca-203f-4e20-94c5-dbc460659de3 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596585 Aug 24 07:02:24.580670 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1381/2788] 10.222.0.62 () {60 vars in 1147 bytes} [Wed Aug 24 07:02:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 07:02:24.593020 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d89f893a-73c4-481d-b191-b854ad6dac48 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:24.593748 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d89f893a-73c4-481d-b191-b854ad6dac48 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:24.650144 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-d89f893a-73c4-481d-b191-b854ad6dac48 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:24.657552 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d89f893a-73c4-481d-b191-b854ad6dac48 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1213 microversion: 2.1 time: 0.068954 Aug 24 07:02:24.658125 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1408/2789] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:24 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:25.679708 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-329b5578-683d-4a74-ba31-a7a818bdb870 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:25.680315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-329b5578-683d-4a74-ba31-a7a818bdb870 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:25.687591 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-329b5578-683d-4a74-ba31-a7a818bdb870 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:25.688159 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-329b5578-683d-4a74-ba31-a7a818bdb870 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:25.688639 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-329b5578-683d-4a74-ba31-a7a818bdb870 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:25.689864 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-329b5578-683d-4a74-ba31-a7a818bdb870 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:25.690312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-329b5578-683d-4a74-ba31-a7a818bdb870 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:25.696531 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-329b5578-683d-4a74-ba31-a7a818bdb870 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:25.753634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-329b5578-683d-4a74-ba31-a7a818bdb870 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:25.761597 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-329b5578-683d-4a74-ba31-a7a818bdb870 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1217 microversion: 2.1 time: 0.086270 Aug 24 07:02:25.768648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1382/2790] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:25 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:26.783863 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ad79e5ca-24bc-479f-b5ac-57796d062beb tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:26.784516 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ad79e5ca-24bc-479f-b5ac-57796d062beb tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:26.790926 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad79e5ca-24bc-479f-b5ac-57796d062beb tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:26.791530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad79e5ca-24bc-479f-b5ac-57796d062beb tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:26.792064 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad79e5ca-24bc-479f-b5ac-57796d062beb tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:26.792825 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad79e5ca-24bc-479f-b5ac-57796d062beb tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:26.793347 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad79e5ca-24bc-479f-b5ac-57796d062beb tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:26.793821 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ad79e5ca-24bc-479f-b5ac-57796d062beb tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:26.861542 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-ad79e5ca-24bc-479f-b5ac-57796d062beb tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:26.869789 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ad79e5ca-24bc-479f-b5ac-57796d062beb tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1273 microversion: 2.1 time: 0.090491 Aug 24 07:02:26.870359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1409/2791] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:26 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:27.896031 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-a02f5052-04c3-4f13-b585-633aba6c2580 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:27.896688 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-a02f5052-04c3-4f13-b585-633aba6c2580 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:27.903128 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a02f5052-04c3-4f13-b585-633aba6c2580 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:27.903612 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a02f5052-04c3-4f13-b585-633aba6c2580 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:27.904054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a02f5052-04c3-4f13-b585-633aba6c2580 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:27.904784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a02f5052-04c3-4f13-b585-633aba6c2580 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:27.905238 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a02f5052-04c3-4f13-b585-633aba6c2580 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:27.905856 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-a02f5052-04c3-4f13-b585-633aba6c2580 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:28.040049 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-a02f5052-04c3-4f13-b585-633aba6c2580 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:28.048999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-a02f5052-04c3-4f13-b585-633aba6c2580 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1313 microversion: 2.1 time: 0.157262 Aug 24 07:02:28.049723 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1383/2792] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:27 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:28.383100 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-aed54ad2-ab2d-4d37-99f8-f19b102d3588 req-559c1ced-a5b7-4ab8-8ee2-17152007618e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca35f16-ae8b-4a4a-93d6-9ecc8bca8787", "tag": "2444a92a-b8f2-4340-be13-4a4aeb385ce1"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:02:28.393238 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-aed54ad2-ab2d-4d37-99f8-f19b102d3588 req-559c1ced-a5b7-4ab8-8ee2-17152007618e service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:28.393578 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-aed54ad2-ab2d-4d37-99f8-f19b102d3588 req-559c1ced-a5b7-4ab8-8ee2-17152007618e service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:28.394030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-aed54ad2-ab2d-4d37-99f8-f19b102d3588 req-559c1ced-a5b7-4ab8-8ee2-17152007618e service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:28.405543 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-aed54ad2-ab2d-4d37-99f8-f19b102d3588 req-559c1ced-a5b7-4ab8-8ee2-17152007618e service nova] Creating event network-changed:2444a92a-b8f2-4340-be13-4a4aeb385ce1 for instance cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 on hv-cinder-85426 Aug 24 07:02:28.410995 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-aed54ad2-ab2d-4d37-99f8-f19b102d3588 req-559c1ced-a5b7-4ab8-8ee2-17152007618e service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031630 Aug 24 07:02:28.411634 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1410/2793] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:02:29.069278 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-72a3db40-f979-4c3b-834e-7eaae7f93cee tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:29.069874 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-72a3db40-f979-4c3b-834e-7eaae7f93cee tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:29.076033 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72a3db40-f979-4c3b-834e-7eaae7f93cee tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:29.076795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72a3db40-f979-4c3b-834e-7eaae7f93cee tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:29.077225 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72a3db40-f979-4c3b-834e-7eaae7f93cee tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:29.077906 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72a3db40-f979-4c3b-834e-7eaae7f93cee tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:29.078354 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72a3db40-f979-4c3b-834e-7eaae7f93cee tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:29.078768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-72a3db40-f979-4c3b-834e-7eaae7f93cee tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:29.214925 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-72a3db40-f979-4c3b-834e-7eaae7f93cee tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:29.223311 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-72a3db40-f979-4c3b-834e-7eaae7f93cee tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1313 microversion: 2.1 time: 0.158172 Aug 24 07:02:29.223879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1384/2794] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:29 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:30.244905 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-78e91774-d845-4f46-b6ed-7791e1125ee5 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:30.245588 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-78e91774-d845-4f46-b6ed-7791e1125ee5 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:30.252194 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78e91774-d845-4f46-b6ed-7791e1125ee5 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:30.252693 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78e91774-d845-4f46-b6ed-7791e1125ee5 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:30.253116 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78e91774-d845-4f46-b6ed-7791e1125ee5 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:30.253785 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78e91774-d845-4f46-b6ed-7791e1125ee5 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:30.254258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78e91774-d845-4f46-b6ed-7791e1125ee5 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:30.254676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78e91774-d845-4f46-b6ed-7791e1125ee5 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:30.383744 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-78e91774-d845-4f46-b6ed-7791e1125ee5 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:30.391351 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-78e91774-d845-4f46-b6ed-7791e1125ee5 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1313 microversion: 2.1 time: 0.151120 Aug 24 07:02:30.392574 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1411/2795] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:30 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:31.414713 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ffc445c0-9216-4c06-86de-a92db7465e02 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:31.415301 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ffc445c0-9216-4c06-86de-a92db7465e02 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:31.421727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffc445c0-9216-4c06-86de-a92db7465e02 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:31.422191 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffc445c0-9216-4c06-86de-a92db7465e02 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:31.422618 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffc445c0-9216-4c06-86de-a92db7465e02 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:31.423344 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffc445c0-9216-4c06-86de-a92db7465e02 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:31.423784 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffc445c0-9216-4c06-86de-a92db7465e02 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:31.424203 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ffc445c0-9216-4c06-86de-a92db7465e02 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:31.554449 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ffc445c0-9216-4c06-86de-a92db7465e02 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:31.562091 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ffc445c0-9216-4c06-86de-a92db7465e02 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1313 microversion: 2.1 time: 0.151849 Aug 24 07:02:31.562691 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1385/2796] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:31 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:32.583456 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-22ac7dbe-33f0-48b2-97f1-5a458ec12d4b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:32.584089 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-22ac7dbe-33f0-48b2-97f1-5a458ec12d4b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:32.590431 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22ac7dbe-33f0-48b2-97f1-5a458ec12d4b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:32.590901 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22ac7dbe-33f0-48b2-97f1-5a458ec12d4b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:32.591391 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22ac7dbe-33f0-48b2-97f1-5a458ec12d4b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:32.592067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22ac7dbe-33f0-48b2-97f1-5a458ec12d4b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:32.592530 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22ac7dbe-33f0-48b2-97f1-5a458ec12d4b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:32.592944 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-22ac7dbe-33f0-48b2-97f1-5a458ec12d4b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:32.725676 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-22ac7dbe-33f0-48b2-97f1-5a458ec12d4b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:32.733880 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-22ac7dbe-33f0-48b2-97f1-5a458ec12d4b tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1313 microversion: 2.1 time: 0.154334 Aug 24 07:02:32.736655 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1412/2797] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:32 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:33.755206 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-94ef7b6d-4d52-454a-a3bc-a14bb650cbc4 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:33.755855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-94ef7b6d-4d52-454a-a3bc-a14bb650cbc4 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:33.762337 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ef7b6d-4d52-454a-a3bc-a14bb650cbc4 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:33.762815 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ef7b6d-4d52-454a-a3bc-a14bb650cbc4 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:33.763250 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ef7b6d-4d52-454a-a3bc-a14bb650cbc4 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:33.763932 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ef7b6d-4d52-454a-a3bc-a14bb650cbc4 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:33.764381 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ef7b6d-4d52-454a-a3bc-a14bb650cbc4 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:33.764831 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-94ef7b6d-4d52-454a-a3bc-a14bb650cbc4 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:33.894192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-94ef7b6d-4d52-454a-a3bc-a14bb650cbc4 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:33.901879 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-94ef7b6d-4d52-454a-a3bc-a14bb650cbc4 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1313 microversion: 2.1 time: 0.150662 Aug 24 07:02:33.902439 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1386/2798] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:33 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:34.643359 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-f04c191c-53c5-4cd7-86bb-311685630c68 req-496ba5d9-3868-4090-bf13-7b449c299f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca35f16-ae8b-4a4a-93d6-9ecc8bca8787", "name": "network-vif-plugged", "status": "completed", "tag": "2444a92a-b8f2-4340-be13-4a4aeb385ce1"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:02:34.653254 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-f04c191c-53c5-4cd7-86bb-311685630c68 req-496ba5d9-3868-4090-bf13-7b449c299f23 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:34.653725 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-f04c191c-53c5-4cd7-86bb-311685630c68 req-496ba5d9-3868-4090-bf13-7b449c299f23 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:34.654189 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-f04c191c-53c5-4cd7-86bb-311685630c68 req-496ba5d9-3868-4090-bf13-7b449c299f23 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:34.656822 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell0:SELECT=2 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:34.665756 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-f04c191c-53c5-4cd7-86bb-311685630c68 req-496ba5d9-3868-4090-bf13-7b449c299f23 service nova] Creating event network-vif-plugged:2444a92a-b8f2-4340-be13-4a4aeb385ce1 for instance cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 on hv-cinder-85426 Aug 24 07:02:34.670983 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-f04c191c-53c5-4cd7-86bb-311685630c68 req-496ba5d9-3868-4090-bf13-7b449c299f23 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031360 Aug 24 07:02:34.671644 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1413/2799] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:02:34.924127 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e63ca63b-999a-4456-9430-211c2e765ac6 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:34.924793 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e63ca63b-999a-4456-9430-211c2e765ac6 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:34.927009 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=2 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:34.927665 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell0:SELECT=6 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:34.929098 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:34.933912 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e63ca63b-999a-4456-9430-211c2e765ac6 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:34.934393 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e63ca63b-999a-4456-9430-211c2e765ac6 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:34.934824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e63ca63b-999a-4456-9430-211c2e765ac6 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:34.935568 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e63ca63b-999a-4456-9430-211c2e765ac6 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:34.936029 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e63ca63b-999a-4456-9430-211c2e765ac6 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:34.936432 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e63ca63b-999a-4456-9430-211c2e765ac6 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:34.940664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:35.072482 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-e63ca63b-999a-4456-9430-211c2e765ac6 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:35.081402 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e63ca63b-999a-4456-9430-211c2e765ac6 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1313 microversion: 2.1 time: 0.161885 Aug 24 07:02:35.081977 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1387/2800] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:34 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:36.103533 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-78612c98-1aec-40ee-9fcd-10c4507f87bd tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:36.104320 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-78612c98-1aec-40ee-9fcd-10c4507f87bd tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:36.111742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78612c98-1aec-40ee-9fcd-10c4507f87bd tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:36.112349 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78612c98-1aec-40ee-9fcd-10c4507f87bd tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:36.112884 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78612c98-1aec-40ee-9fcd-10c4507f87bd tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:36.113532 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78612c98-1aec-40ee-9fcd-10c4507f87bd tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:36.113986 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78612c98-1aec-40ee-9fcd-10c4507f87bd tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:36.114434 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-78612c98-1aec-40ee-9fcd-10c4507f87bd tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:36.117871 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=77 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:36.261265 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-78612c98-1aec-40ee-9fcd-10c4507f87bd tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:36.270480 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-78612c98-1aec-40ee-9fcd-10c4507f87bd tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1313 microversion: 2.1 time: 0.171654 Aug 24 07:02:36.271330 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1414/2801] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:36 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:37.291237 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-3c995bbb-dc5a-4404-9f2f-6ad0ccbfbd8d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:37.291840 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-3c995bbb-dc5a-4404-9f2f-6ad0ccbfbd8d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:37.300424 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c995bbb-dc5a-4404-9f2f-6ad0ccbfbd8d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:37.300927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c995bbb-dc5a-4404-9f2f-6ad0ccbfbd8d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:37.301362 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c995bbb-dc5a-4404-9f2f-6ad0ccbfbd8d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:37.302045 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c995bbb-dc5a-4404-9f2f-6ad0ccbfbd8d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:37.302495 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c995bbb-dc5a-4404-9f2f-6ad0ccbfbd8d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:37.302920 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-3c995bbb-dc5a-4404-9f2f-6ad0ccbfbd8d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:37.432598 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-3c995bbb-dc5a-4404-9f2f-6ad0ccbfbd8d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:37.441194 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-3c995bbb-dc5a-4404-9f2f-6ad0ccbfbd8d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1496 microversion: 2.1 time: 0.154839 Aug 24 07:02:37.441981 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1388/2802] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:37 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1496 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:38.517445 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-3d3a882d-76e9-42f4-ba21-81faf58b4856 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:38.517972 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3d3a882d-76e9-42f4-ba21-81faf58b4856 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:38.520273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=43 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:38.525231 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d3a882d-76e9-42f4-ba21-81faf58b4856 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:38.525708 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d3a882d-76e9-42f4-ba21-81faf58b4856 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:38.526149 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d3a882d-76e9-42f4-ba21-81faf58b4856 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:38.526817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d3a882d-76e9-42f4-ba21-81faf58b4856 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:38.527281 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d3a882d-76e9-42f4-ba21-81faf58b4856 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:38.527684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-3d3a882d-76e9-42f4-ba21-81faf58b4856 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:38.553681 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-3d3a882d-76e9-42f4-ba21-81faf58b4856 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Going to try to terminate instance {{(pid=121150) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:02:38.971477 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-3d3a882d-76e9-42f4-ba21-81faf58b4856 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 204 len: 0 microversion: 2.1 time: 0.458512 Aug 24 07:02:38.971989 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1415/2803] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 07:02:38 2022] DELETE /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:02:38.981305 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-0d7091de-2d6f-4d6f-8295-70c45ab5b028 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:38.986453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-0d7091de-2d6f-4d6f-8295-70c45ab5b028 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:38.990886 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d7091de-2d6f-4d6f-8295-70c45ab5b028 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:38.991435 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d7091de-2d6f-4d6f-8295-70c45ab5b028 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:38.991866 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d7091de-2d6f-4d6f-8295-70c45ab5b028 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:38.992596 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d7091de-2d6f-4d6f-8295-70c45ab5b028 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:38.993124 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d7091de-2d6f-4d6f-8295-70c45ab5b028 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:38.993549 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-0d7091de-2d6f-4d6f-8295-70c45ab5b028 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:39.135249 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-0d7091de-2d6f-4d6f-8295-70c45ab5b028 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:39.144993 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-0d7091de-2d6f-4d6f-8295-70c45ab5b028 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1502 microversion: 2.1 time: 0.168272 Aug 24 07:02:39.145582 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1389/2804] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:38 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:40.166103 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-bc4cb06d-5e8a-4548-889e-4fb227e0900d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:40.170907 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-bc4cb06d-5e8a-4548-889e-4fb227e0900d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:40.174782 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc4cb06d-5e8a-4548-889e-4fb227e0900d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:40.175257 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc4cb06d-5e8a-4548-889e-4fb227e0900d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:40.175685 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc4cb06d-5e8a-4548-889e-4fb227e0900d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:40.176360 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc4cb06d-5e8a-4548-889e-4fb227e0900d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:40.176844 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc4cb06d-5e8a-4548-889e-4fb227e0900d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:40.177259 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-bc4cb06d-5e8a-4548-889e-4fb227e0900d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:40.316338 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-bc4cb06d-5e8a-4548-889e-4fb227e0900d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:40.324240 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-bc4cb06d-5e8a-4548-889e-4fb227e0900d tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1502 microversion: 2.1 time: 0.162365 Aug 24 07:02:40.324850 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1416/2805] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:40 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:40.954742 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-315233e5-33f4-4848-9edf-db83bde1ef4b req-4f1b46d8-0768-45e9-8464-78fe5784bea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca35f16-ae8b-4a4a-93d6-9ecc8bca8787", "name": "network-vif-deleted", "tag": "2444a92a-b8f2-4340-be13-4a4aeb385ce1"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:02:40.964727 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-315233e5-33f4-4848-9edf-db83bde1ef4b req-4f1b46d8-0768-45e9-8464-78fe5784bea5 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:40.971479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-315233e5-33f4-4848-9edf-db83bde1ef4b req-4f1b46d8-0768-45e9-8464-78fe5784bea5 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:40.971479 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-315233e5-33f4-4848-9edf-db83bde1ef4b req-4f1b46d8-0768-45e9-8464-78fe5784bea5 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:40.977542 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-315233e5-33f4-4848-9edf-db83bde1ef4b req-4f1b46d8-0768-45e9-8464-78fe5784bea5 service nova] Creating event network-vif-deleted:2444a92a-b8f2-4340-be13-4a4aeb385ce1 for instance cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 on hv-cinder-85426 Aug 24 07:02:40.982664 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-315233e5-33f4-4848-9edf-db83bde1ef4b req-4f1b46d8-0768-45e9-8464-78fe5784bea5 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032724 Aug 24 07:02:40.983280 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1390/2806] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 07:02:41.346424 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:41.347032 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:41.353356 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:41.353835 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:41.354266 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:41.354943 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:41.355390 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:41.355807 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:41.386556 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:41.387022 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:41.387450 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:41.387889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lazy-loading 'fault' on Instance uuid cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:02:41.432684 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a2cc6be0c09472a9b3d319e82d95534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aefc9bbcc4818ab055d3c0ddacdb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:02:41.441009 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-9f8ccd01-b0de-4ca6-a3ea-9187608442cf tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 200 len: 1303 microversion: 2.1 time: 0.098610 Aug 24 07:02:41.441566 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1417/2807] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:41 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:02:42.463593 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:02:42.464387 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] [instance: cca35f16-ae8b-4a4a-93d6-9ecc8bca8787] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:02:42.471673 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:42.472192 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:42.472677 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:42.473413 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:02:42.473869 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:02:42.474296 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:02:42.491634 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] HTTP exception thrown: Instance cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 could not be found. Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Request method failure captured: Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 HTTP/1.1 Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBczq0XyNHhjhO_OrKWXtxbrNCggh2tOxvuBC9NeIdxjeKU80aZiaGckKVPod7mRdgaiLQ4dwn_6xnVvbMz4XaxtRQKVJXIUzL8mTij1Wfd2iVfDmoFXMcpDHNuUb2Rsp2P1pU1juwH3sLqGBZUBuokRzltCX2hRVLFDf8dxfHdaDzF8 Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: 057aefc9bbcc4818ab055d3c0ddacdb5 Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-VolumesActionsTest-757681869 Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 07:02:42.493453 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/057aefc9bbcc4818ab055d3c0ddacdb5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/057aefc9bbcc4818ab055d3c0ddacdb5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/057aefc9bbcc4818ab055d3c0ddacdb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_057aefc9bbcc4818ab055d3c0ddacdb5", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-VolumesActionsTest-757681869 Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: 057aefc9bbcc4818ab055d3c0ddacdb5 Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-VolumesActionsTest-757681869 Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-VolumesActionsTest-757681869-project Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 3a2cc6be0c09472a9b3d319e82d95534 Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-VolumesActionsTest-757681869-project Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 could not be found. Aug 24 07:02:42.495384 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': 'cca35f16-ae8b-4a4a-93d6-9ecc8bca8787'} Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 could not be found. Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:02:42.496358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 could not be found. Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 could not be found. Aug 24 07:02:42.497862 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:02:42.498924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] Returning 404 to user: Instance cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:02:42.498924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-244e281c-2001-48a7-96c0-05fdaa45c445 tempest-VolumesActionsTest-757681869 tempest-VolumesActionsTest-757681869-project] 10.222.0.62 "GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787" status: 404 len: 111 microversion: 2.1 time: 0.036525 Aug 24 07:02:42.498924 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1391/2808] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:02:42 2022] GET /compute/v2.1/servers/cca35f16-ae8b-4a4a-93d6-9ecc8bca8787 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:03:03.542301 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-ba6995f4-0566-47a3-bf24-a4f24621eb98 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:03.542804 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ba6995f4-0566-47a3-bf24-a4f24621eb98 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:03.561056 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_api:SELECT=9 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:03.564290 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG dbcounter [-] [121151] Writing DB stats nova_cell1:SELECT=21 {{(pid=121151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:03.565258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:03.568696 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG dbcounter [-] [121150] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:03.582490 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba6995f4-0566-47a3-bf24-a4f24621eb98 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:03.584113 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba6995f4-0566-47a3-bf24-a4f24621eb98 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:03.585447 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba6995f4-0566-47a3-bf24-a4f24621eb98 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:03.587058 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba6995f4-0566-47a3-bf24-a4f24621eb98 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:03.588849 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba6995f4-0566-47a3-bf24-a4f24621eb98 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:03.590030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-ba6995f4-0566-47a3-bf24-a4f24621eb98 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:03.658716 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-ba6995f4-0566-47a3-bf24-a4f24621eb98 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Going to try to terminate instance {{(pid=121150) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:03:03.707973 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-242dad4e-5862-49c2-a7d8-6527bdf0000d req-403f98eb-58f3-48fa-9c9d-930f3f2700f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16631f83-7406-45eb-ba93-111bab158415", "tag": "eaa5fdbb-3d06-4301-8062-937e7f5f549a"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:03:03.715927 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-242dad4e-5862-49c2-a7d8-6527bdf0000d req-403f98eb-58f3-48fa-9c9d-930f3f2700f8 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:03.716401 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-242dad4e-5862-49c2-a7d8-6527bdf0000d req-403f98eb-58f3-48fa-9c9d-930f3f2700f8 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:03.716892 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-242dad4e-5862-49c2-a7d8-6527bdf0000d req-403f98eb-58f3-48fa-9c9d-930f3f2700f8 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:03.738587 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-242dad4e-5862-49c2-a7d8-6527bdf0000d req-403f98eb-58f3-48fa-9c9d-930f3f2700f8 service nova] Creating event network-changed:eaa5fdbb-3d06-4301-8062-937e7f5f549a for instance 16631f83-7406-45eb-ba93-111bab158415 on hv-cinder-85426 Aug 24 07:03:03.746575 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-242dad4e-5862-49c2-a7d8-6527bdf0000d req-403f98eb-58f3-48fa-9c9d-930f3f2700f8 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199281 Aug 24 07:03:03.747631 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1392/2809] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:03:04.501786 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-ba6995f4-0566-47a3-bf24-a4f24621eb98 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "DELETE /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 204 len: 0 microversion: 2.1 time: 0.960421 Aug 24 07:03:04.504597 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1418/2810] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 07:03:03 2022] DELETE /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:03:04.509114 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-190000db-455e-429a-8897-82c06eb4465d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:04.509824 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-190000db-455e-429a-8897-82c06eb4465d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:04.521515 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-190000db-455e-429a-8897-82c06eb4465d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:04.522663 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-190000db-455e-429a-8897-82c06eb4465d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:04.523880 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-190000db-455e-429a-8897-82c06eb4465d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:04.524532 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-190000db-455e-429a-8897-82c06eb4465d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:04.524963 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-190000db-455e-429a-8897-82c06eb4465d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:04.525392 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-190000db-455e-429a-8897-82c06eb4465d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:04.681877 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-190000db-455e-429a-8897-82c06eb4465d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:03:04.698828 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-190000db-455e-429a-8897-82c06eb4465d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1459 microversion: 2.1 time: 0.193905 Aug 24 07:03:04.713464 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1393/2811] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:03:04 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1459 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:03:05.722830 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-91294ca5-4c8a-46b9-ace7-4d7723bb0e00 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:05.723625 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-91294ca5-4c8a-46b9-ace7-4d7723bb0e00 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:05.731576 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91294ca5-4c8a-46b9-ace7-4d7723bb0e00 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:05.732093 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91294ca5-4c8a-46b9-ace7-4d7723bb0e00 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:05.732565 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91294ca5-4c8a-46b9-ace7-4d7723bb0e00 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:05.733290 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91294ca5-4c8a-46b9-ace7-4d7723bb0e00 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:05.733769 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91294ca5-4c8a-46b9-ace7-4d7723bb0e00 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:05.734195 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-91294ca5-4c8a-46b9-ace7-4d7723bb0e00 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:05.874267 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-91294ca5-4c8a-46b9-ace7-4d7723bb0e00 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:03:05.881860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-91294ca5-4c8a-46b9-ace7-4d7723bb0e00 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1459 microversion: 2.1 time: 0.164278 Aug 24 07:03:05.882419 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1419/2812] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:03:05 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1459 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:03:06.682051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [req-be96bf08-e9fe-41ae-9c52-ef08ac8ddbc9 req-4089f072-ef98-423a-bf2f-5af20d38711b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16631f83-7406-45eb-ba93-111bab158415", "name": "network-vif-deleted", "tag": "eaa5fdbb-3d06-4301-8062-937e7f5f549a"}]} {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:03:06.695668 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-be96bf08-e9fe-41ae-9c52-ef08ac8ddbc9 req-4089f072-ef98-423a-bf2f-5af20d38711b service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:06.696136 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-be96bf08-e9fe-41ae-9c52-ef08ac8ddbc9 req-4089f072-ef98-423a-bf2f-5af20d38711b service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:06.696600 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [req-be96bf08-e9fe-41ae-9c52-ef08ac8ddbc9 req-4089f072-ef98-423a-bf2f-5af20d38711b service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:06.709051 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.compute.server_external_events [req-be96bf08-e9fe-41ae-9c52-ef08ac8ddbc9 req-4089f072-ef98-423a-bf2f-5af20d38711b service nova] Creating event network-vif-deleted:eaa5fdbb-3d06-4301-8062-937e7f5f549a for instance 16631f83-7406-45eb-ba93-111bab158415 on hv-cinder-85426 Aug 24 07:03:06.736709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [req-be96bf08-e9fe-41ae-9c52-ef08ac8ddbc9 req-4089f072-ef98-423a-bf2f-5af20d38711b service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035828 Aug 24 07:03:06.736709 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1394/2813] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:03:06.902590 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-17bfa466-ada2-40d2-b2fb-2b8d97937479 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:06.903258 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-17bfa466-ada2-40d2-b2fb-2b8d97937479 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:06.911010 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-17bfa466-ada2-40d2-b2fb-2b8d97937479 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:06.911663 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-17bfa466-ada2-40d2-b2fb-2b8d97937479 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:06.912438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-17bfa466-ada2-40d2-b2fb-2b8d97937479 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:06.913227 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-17bfa466-ada2-40d2-b2fb-2b8d97937479 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:06.913614 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-17bfa466-ada2-40d2-b2fb-2b8d97937479 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:06.914030 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-17bfa466-ada2-40d2-b2fb-2b8d97937479 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:06.990992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-17bfa466-ada2-40d2-b2fb-2b8d97937479 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:03:06.999602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-17bfa466-ada2-40d2-b2fb-2b8d97937479 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1225 microversion: 2.1 time: 0.100906 Aug 24 07:03:07.000742 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1420/2814] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:03:06 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:03:08.022039 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:08.022640 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:08.028861 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:08.029340 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:08.029768 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:08.030451 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:08.031391 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:08.031808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:08.065655 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:08.066132 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:08.066558 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:08.066997 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.objects.instance [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lazy-loading 'fault' on Instance uuid 16631f83-7406-45eb-ba93-111bab158415 {{(pid=121151) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:03:08.112266 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:03:08.120245 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-59e328db-bb3a-494d-80bd-3e8cb28647c1 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 200 len: 1230 microversion: 2.1 time: 0.103003 Aug 24 07:03:08.127297 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1395/2815] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:03:08 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:03:09.144236 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:09.144992 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 16631f83-7406-45eb-ba93-111bab158415] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:09.151346 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:09.151817 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:09.152248 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:09.152957 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:09.153407 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:09.153823 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:09.170454 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] HTTP exception thrown: Instance 16631f83-7406-45eb-ba93-111bab158415 could not be found. Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Request method failure captured: Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 HTTP/1.1 Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcuKa2ZjppihEYFUcT_dfj0QOF5SQhcB8_CykhTOKUrboZLWMiRrMEDRR470KQDBN2h6ypn-XVgrqE8z9Xi6MHlNOWk0sFXrf3jK2s4hF3o9w9xGggO16AOH32V9zdio038jhhQnHlkwGvnrltlTfRJKsjoeB3cKIN0YqfOS2FIfVKU Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: 01a59a0e0c9e4e8fa1c0e147e720eccb Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 07:03:09.172067 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_01a59a0e0c9e4e8fa1c0e147e720eccb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: 01a59a0e0c9e4e8fa1c0e147e720eccb Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-TestVolumeBootPattern-1712330690-project Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 86ff51618d4b4b71bfad73467ddc8585 Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-TestVolumeBootPattern-1712330690-project Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 16631f83-7406-45eb-ba93-111bab158415 could not be found. Aug 24 07:03:09.173596 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '16631f83-7406-45eb-ba93-111bab158415'} Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16631f83-7406-45eb-ba93-111bab158415 could not be found. Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:03:09.174558 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16631f83-7406-45eb-ba93-111bab158415 could not be found. Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16631f83-7406-45eb-ba93-111bab158415 could not be found. Aug 24 07:03:09.176076 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:03:09.177467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Returning 404 to user: Instance 16631f83-7406-45eb-ba93-111bab158415 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:03:09.177467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-d4faf7fd-9ad4-440d-b998-29cbd8284831 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415" status: 404 len: 111 microversion: 2.1 time: 0.033631 Aug 24 07:03:09.177467 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1421/2816] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:03:09 2022] GET /compute/v2.1/servers/16631f83-7406-45eb-ba93-111bab158415 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:03:12.995860 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-8cfa5eef-f74b-4157-b351-3af4aa8c3699 req-4681f339-20e6-4636-8c87-2be27788e844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4c673a-0707-4178-9dbc-236ddd8c0d51", "tag": "70e3bcc9-9005-4f9e-8a33-18bf4f587489"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:03:12.999941 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-29a285ab-2693-45bf-8f4b-6ac0dc7c2e0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:13.001004 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-29a285ab-2693-45bf-8f4b-6ac0dc7c2e0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:13.013546 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29a285ab-2693-45bf-8f4b-6ac0dc7c2e0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:13.014032 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29a285ab-2693-45bf-8f4b-6ac0dc7c2e0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:13.014463 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29a285ab-2693-45bf-8f4b-6ac0dc7c2e0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:13.017795 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29a285ab-2693-45bf-8f4b-6ac0dc7c2e0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:13.018594 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29a285ab-2693-45bf-8f4b-6ac0dc7c2e0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:13.019185 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29a285ab-2693-45bf-8f4b-6ac0dc7c2e0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:13.020262 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-8cfa5eef-f74b-4157-b351-3af4aa8c3699 req-4681f339-20e6-4636-8c87-2be27788e844 service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:13.021249 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-8cfa5eef-f74b-4157-b351-3af4aa8c3699 req-4681f339-20e6-4636-8c87-2be27788e844 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:13.022848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-8cfa5eef-f74b-4157-b351-3af4aa8c3699 req-4681f339-20e6-4636-8c87-2be27788e844 service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:13.036168 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-8cfa5eef-f74b-4157-b351-3af4aa8c3699 req-4681f339-20e6-4636-8c87-2be27788e844 service nova] Creating event network-changed:70e3bcc9-9005-4f9e-8a33-18bf4f587489 for instance cf4c673a-0707-4178-9dbc-236ddd8c0d51 on hv-cinder-85426 Aug 24 07:03:13.042875 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-8cfa5eef-f74b-4157-b351-3af4aa8c3699 req-4681f339-20e6-4636-8c87-2be27788e844 service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051275 Aug 24 07:03:13.043559 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1422/2817] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:03:13.064832 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-29a285ab-2693-45bf-8f4b-6ac0dc7c2e0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Going to try to terminate instance {{(pid=121151) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 07:03:13.672611 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-29a285ab-2693-45bf-8f4b-6ac0dc7c2e0d tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "DELETE /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 204 len: 0 microversion: 2.1 time: 0.682930 Aug 24 07:03:13.679001 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1396/2818] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 07:03:12 2022] DELETE /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 07:03:13.685502 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-6254697a-e16f-4f1b-990c-f1a88a124b1a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:13.686527 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-6254697a-e16f-4f1b-990c-f1a88a124b1a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:13.696891 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6254697a-e16f-4f1b-990c-f1a88a124b1a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:13.697378 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6254697a-e16f-4f1b-990c-f1a88a124b1a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:13.698297 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6254697a-e16f-4f1b-990c-f1a88a124b1a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:13.699348 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6254697a-e16f-4f1b-990c-f1a88a124b1a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:13.699820 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6254697a-e16f-4f1b-990c-f1a88a124b1a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:13.700242 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-6254697a-e16f-4f1b-990c-f1a88a124b1a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:13.877750 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-6254697a-e16f-4f1b-990c-f1a88a124b1a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:03:13.886273 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-6254697a-e16f-4f1b-990c-f1a88a124b1a tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1577 microversion: 2.1 time: 0.205540 Aug 24 07:03:13.886848 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1423/2819] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:03:13 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 07:03:14.909808 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-ecbd1bbd-62bb-4bfd-9568-fa80f3e8a100 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:14.910508 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-ecbd1bbd-62bb-4bfd-9568-fa80f3e8a100 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:14.916999 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecbd1bbd-62bb-4bfd-9568-fa80f3e8a100 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:14.917483 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecbd1bbd-62bb-4bfd-9568-fa80f3e8a100 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:14.917913 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecbd1bbd-62bb-4bfd-9568-fa80f3e8a100 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:14.918876 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecbd1bbd-62bb-4bfd-9568-fa80f3e8a100 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:14.919054 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecbd1bbd-62bb-4bfd-9568-fa80f3e8a100 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:14.919469 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-ecbd1bbd-62bb-4bfd-9568-fa80f3e8a100 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:15.071872 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-ecbd1bbd-62bb-4bfd-9568-fa80f3e8a100 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:03:15.087689 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-ecbd1bbd-62bb-4bfd-9568-fa80f3e8a100 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1459 microversion: 2.1 time: 0.181831 Aug 24 07:03:15.088619 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1397/2820] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:03:14 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1459 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:03:15.813889 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [req-55d15995-4d9c-4db5-aec7-e4a968c72451 req-81aa34e1-60ae-4b8a-a9f1-a4447399278d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4c673a-0707-4178-9dbc-236ddd8c0d51", "name": "network-vif-deleted", "tag": "70e3bcc9-9005-4f9e-8a33-18bf4f587489"}]} {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 07:03:15.825017 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-55d15995-4d9c-4db5-aec7-e4a968c72451 req-81aa34e1-60ae-4b8a-a9f1-a4447399278d service nova] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:15.825496 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-55d15995-4d9c-4db5-aec7-e4a968c72451 req-81aa34e1-60ae-4b8a-a9f1-a4447399278d service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:15.825930 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [req-55d15995-4d9c-4db5-aec7-e4a968c72451 req-81aa34e1-60ae-4b8a-a9f1-a4447399278d service nova] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:15.840092 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.compute.server_external_events [req-55d15995-4d9c-4db5-aec7-e4a968c72451 req-81aa34e1-60ae-4b8a-a9f1-a4447399278d service nova] Creating event network-vif-deleted:70e3bcc9-9005-4f9e-8a33-18bf4f587489 for instance cf4c673a-0707-4178-9dbc-236ddd8c0d51 on hv-cinder-85426 Aug 24 07:03:15.845792 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [req-55d15995-4d9c-4db5-aec7-e4a968c72451 req-81aa34e1-60ae-4b8a-a9f1-a4447399278d service nova] 10.222.0.62 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036373 Aug 24 07:03:15.846494 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1424/2821] 10.222.0.62 () {64 vars in 1317 bytes} [Wed Aug 24 07:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 07:03:16.123659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-2220a081-1fbb-4170-b142-95cc5dcfa8ed tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:16.124312 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-2220a081-1fbb-4170-b142-95cc5dcfa8ed tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:16.131848 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2220a081-1fbb-4170-b142-95cc5dcfa8ed tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:16.132358 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2220a081-1fbb-4170-b142-95cc5dcfa8ed tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:16.132842 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2220a081-1fbb-4170-b142-95cc5dcfa8ed tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:16.133573 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2220a081-1fbb-4170-b142-95cc5dcfa8ed tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:16.134037 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2220a081-1fbb-4170-b142-95cc5dcfa8ed tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:16.134461 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-2220a081-1fbb-4170-b142-95cc5dcfa8ed tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:16.241851 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.policy [None req-2220a081-1fbb-4170-b142-95cc5dcfa8ed tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121151) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:03:16.254797 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-2220a081-1fbb-4170-b142-95cc5dcfa8ed tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1225 microversion: 2.1 time: 0.134574 Aug 24 07:03:16.255871 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1398/2822] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:03:16 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1225 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:03:17.278894 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:17.279602 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:17.286186 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:17.286719 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:17.287197 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:17.287903 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:17.288382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:17.288887 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:17.323438 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:17.323916 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:17.324344 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:17.324834 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.objects.instance [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lazy-loading 'fault' on Instance uuid cf4c673a-0707-4178-9dbc-236ddd8c0d51 {{(pid=121150) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 07:03:17.380214 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.policy [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86ff51618d4b4b71bfad73467ddc8585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a59a0e0c9e4e8fa1c0e147e720eccb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121150) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 07:03:17.387911 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-a52df616-50db-4bcd-abe4-7011a8e5f0d7 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 200 len: 1184 microversion: 2.1 time: 0.113754 Aug 24 07:03:17.388518 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1425/2823] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:03:17 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 1184 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 07:03:18.411550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:18.412316 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: cf4c673a-0707-4178-9dbc-236ddd8c0d51] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:18.419133 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:18.419614 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:18.420047 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:18.420779 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:18.421258 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:18.421681 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:18.435472 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] HTTP exception thrown: Instance cf4c673a-0707-4178-9dbc-236ddd8c0d51 could not be found. Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Request method failure captured: Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 HTTP/1.1 Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcuKa2ZjppihEYFUcT_dfj0QOF5SQhcB8_CykhTOKUrboZLWMiRrMEDRR470KQDBN2h6ypn-XVgrqE8z9Xi6MHlNOWk0sFXrf3jK2s4hF3o9w9xGggO16AOH32V9zdio038jhhQnHlkwGvnrltlTfRJKsjoeB3cKIN0YqfOS2FIfVKU Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: 01a59a0e0c9e4e8fa1c0e147e720eccb Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 07:03:18.437716 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_01a59a0e0c9e4e8fa1c0e147e720eccb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: 01a59a0e0c9e4e8fa1c0e147e720eccb Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-TestVolumeBootPattern-1712330690-project Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 86ff51618d4b4b71bfad73467ddc8585 Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-TestVolumeBootPattern-1712330690-project Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance cf4c673a-0707-4178-9dbc-236ddd8c0d51 could not be found. Aug 24 07:03:18.439044 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': 'cf4c673a-0707-4178-9dbc-236ddd8c0d51'} Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf4c673a-0707-4178-9dbc-236ddd8c0d51 could not be found. Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:03:18.439846 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf4c673a-0707-4178-9dbc-236ddd8c0d51 could not be found. Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf4c673a-0707-4178-9dbc-236ddd8c0d51 could not be found. Aug 24 07:03:18.441215 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:03:18.442595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Returning 404 to user: Instance cf4c673a-0707-4178-9dbc-236ddd8c0d51 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:03:18.442595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-29b48f7e-c4d0-483c-bb54-ff5454b9d621 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51" status: 404 len: 111 microversion: 2.1 time: 0.033565 Aug 24 07:03:18.442595 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1399/2824] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:03:18 2022] GET /compute/v2.1/servers/cf4c673a-0707-4178-9dbc-236ddd8c0d51 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 07:03:19.106908 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:19.107396 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.compute.api [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121150) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:19.114129 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:19.114612 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:19.115041 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:19.115735 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:19.116173 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:19.116621 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG oslo_concurrency.lockutils [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:19.131836 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.wsgi [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] HTTP exception thrown: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Request method failure captured: Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: request: DELETE /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 HTTP/1.1 Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept: application/json Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Accept-Encoding: identity Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Connection: close Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Length: 0 Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Content-Type: application/json Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Host: 10.222.0.62 Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Openstack-System-Scope: None Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: User-Agent: python-urllib3/1.26.11 Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Auth-Token: gAAAAABjBcuKa2ZjppihEYFUcT_dfj0QOF5SQhcB8_CykhTOKUrboZLWMiRrMEDRR470KQDBN2h6ypn-XVgrqE8z9Xi6MHlNOWk0sFXrf3jK2s4hF3o9w9xGggO16AOH32V9zdio038jhhQnHlkwGvnrltlTfRJKsjoeB3cKIN0YqfOS2FIfVKU Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Id: None Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Domain-Name: None Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Identity-Status: Confirmed Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Is-Admin-Project: True Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Id: default Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Domain-Name: Default Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Id: 01a59a0e0c9e4e8fa1c0e147e720eccb Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Project-Name: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Role: reader,member Aug 24 07:03:19.134088 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Roles: reader,member Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_01a59a0e0c9e4e8fa1c0e147e720eccb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Id: 01a59a0e0c9e4e8fa1c0e147e720eccb Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User: tempest-TestVolumeBootPattern-1712330690-project Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Id: default Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Domain-Name: Default Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Id: 86ff51618d4b4b71bfad73467ddc8585 Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: X-User-Name: tempest-TestVolumeBootPattern-1712330690-project Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: method: > Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: exception: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 07:03:19.135375 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: action_args: {'id': '26d8732e-df71-4dc8-bd71-6b4661901014'} Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:03:19.136199 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 07:03:19.138123 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: ERROR nova.api.openstack.wsgi Aug 24 07:03:19.142966 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Returning 404 to user: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. {{(pid=121150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:03:19.142966 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-eb3b822e-9d93-447a-8b01-309c86c24461 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "DELETE /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 404 len: 111 microversion: 2.1 time: 0.032816 Aug 24 07:03:19.142966 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1426/2825] 10.222.0.62 () {58 vars in 1239 bytes} [Wed Aug 24 07:03:19 2022] DELETE /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:03:19.152632 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '>' {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:19.153275 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.compute.api [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] [instance: 26d8732e-df71-4dc8-bd71-6b4661901014] Fetching instance by UUID {{(pid=121151) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 07:03:19.176884 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:19.177397 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:19.177917 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:19.178678 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Acquiring lock "e60b15ba-de69-41e8-86da-b79c2f77052b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 07:03:19.179223 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 07:03:19.179648 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG oslo_concurrency.lockutils [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Lock "e60b15ba-de69-41e8-86da-b79c2f77052b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 07:03:19.195104 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.wsgi [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] HTTP exception thrown: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Request method failure captured: Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: request: GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 HTTP/1.1 Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept: application/json Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Accept-Encoding: identity Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Connection: close Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Length: 0 Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Content-Type: application/json Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Host: 10.222.0.62 Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Openstack-System-Scope: None Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: User-Agent: python-urllib3/1.26.11 Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Auth-Token: gAAAAABjBcuKa2ZjppihEYFUcT_dfj0QOF5SQhcB8_CykhTOKUrboZLWMiRrMEDRR470KQDBN2h6ypn-XVgrqE8z9Xi6MHlNOWk0sFXrf3jK2s4hF3o9w9xGggO16AOH32V9zdio038jhhQnHlkwGvnrltlTfRJKsjoeB3cKIN0YqfOS2FIfVKU Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Id: None Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Domain-Name: None Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Identity-Status: Confirmed Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Is-Admin-Project: True Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Id: default Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Domain-Name: Default Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Id: 01a59a0e0c9e4e8fa1c0e147e720eccb Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Project-Name: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Role: reader,member Aug 24 07:03:19.196686 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Roles: reader,member Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/volume/v3/01a59a0e0c9e4e8fa1c0e147e720eccb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62:8080/v1/AUTH_01a59a0e0c9e4e8fa1c0e147e720eccb", "adminURL": "http://10.222.0.62:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.62/placement"}]}] Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Id: 01a59a0e0c9e4e8fa1c0e147e720eccb Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-Tenant-Name: tempest-TestVolumeBootPattern-1712330690 Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User: tempest-TestVolumeBootPattern-1712330690-project Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Id: default Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Domain-Name: Default Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Id: 86ff51618d4b4b71bfad73467ddc8585 Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: X-User-Name: tempest-TestVolumeBootPattern-1712330690-project Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: method: > Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: exception: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 07:03:19.198550 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: action_args: {'id': '26d8732e-df71-4dc8-bd71-6b4661901014'} Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: {{(pid=121151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 07:03:19.203084 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. Aug 24 07:03:19.215267 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: ERROR nova.api.openstack.wsgi Aug 24 07:03:19.218365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: DEBUG nova.api.openstack.wsgi [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Returning 404 to user: Instance 26d8732e-df71-4dc8-bd71-6b4661901014 could not be found. {{(pid=121151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 07:03:19.218365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO nova.api.openstack.requestlog [None req-e2aa32cd-978b-43c4-a8a8-e2cb9af64a50 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014" status: 404 len: 111 microversion: 2.1 time: 0.056336 Aug 24 07:03:19.218365 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: [pid: 121151|app: 0|req: 1400/2826] 10.222.0.62 () {58 vars in 1236 bytes} [Wed Aug 24 07:03:19 2022] GET /compute/v2.1/servers/26d8732e-df71-4dc8-bd71-6b4661901014 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 07:03:19.988741 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:03:19.989423 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 07:03:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:03:21.166382 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: DEBUG nova.api.openstack.wsgi [None req-0d21464d-5eda-41bd-b81b-be55ddc99482 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] Calling method '.version_select at 0x7fcddc566b80>' {{(pid=121150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 07:03:21.310175 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO nova.api.openstack.requestlog [None req-0d21464d-5eda-41bd-b81b-be55ddc99482 tempest-TestVolumeBootPattern-1712330690 tempest-TestVolumeBootPattern-1712330690-project] 10.222.0.62 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1493528279" status: 202 len: 0 microversion: 2.1 time: 0.150855 Aug 24 07:03:21.310960 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: [pid: 121150|app: 0|req: 1427/2827] 10.222.0.62 () {58 vars in 1263 bytes} [Wed Aug 24 07:03:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1493528279 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 07:05:05.297659 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:05:05.298315 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 07:05:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:06:32.305332 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:06:32.305910 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 07:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:06:39.997165 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:06:39.997817 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 07:06:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:06:45.909554 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:06:45.910226 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 07:06:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:08:25.307188 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:08:25.307855 dv-cinder-854269-1-iscsi devstack@n-api.service[121151]: Wed Aug 24 07:08:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 07:08:39.531471 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 07:08:39.532094 dv-cinder-854269-1-iscsi devstack@n-api.service[121150]: Wed Aug 24 07:08:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!